-- Logs begin at Thu 2022-09-01 13:01:25 UTC, end at Thu 2022-09-01 14:19:23 UTC. -- Sep 01 13:33:26.295604 dv-cinder-839768-5-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Sep 01 13:33:26.303040 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 01 13:33:26.305065 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 13:33:26 2022] *** Sep 01 13:33:26.305065 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 13:33:26.305065 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 13:33:26.305065 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: nodename: dv-cinder-839768-5-iscsi Sep 01 13:33:26.305065 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: machine: x86_64 Sep 01 13:33:26.305065 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: clock source: unix Sep 01 13:33:26.305065 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: pcre jit disabled Sep 01 13:33:26.305065 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: detected number of CPU cores: 4 Sep 01 13:33:26.305601 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: current working directory: / Sep 01 13:33:26.305601 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: detected binary path: /usr/bin/uwsgi-core Sep 01 13:33:26.305601 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: your processes number limit is 47680 Sep 01 13:33:26.305601 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: your memory page size is 4096 bytes Sep 01 13:33:26.305601 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: detected max file descriptor number: 2048 Sep 01 13:33:26.305601 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: lock engine: pthread robust mutexes Sep 01 13:33:26.305601 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: thunder lock: enabled Sep 01 13:33:26.305601 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 01 13:33:26.305601 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 13:33:26.345600 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: Python main interpreter initialized at 0x563a891579c0 Sep 01 13:33:26.345600 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: python threads support enabled Sep 01 13:33:26.345600 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: your server socket listen backlog is limited to 100 connections Sep 01 13:33:26.345600 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: your mercy for graceful operations on workers is 90 seconds Sep 01 13:33:26.345982 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 13:33:26.346056 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: *** Operational MODE: preforking *** Sep 01 13:33:26.346342 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: *** uWSGI is running in multiple interpreter mode *** Sep 01 13:33:26.346342 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: spawned uWSGI master process (pid: 88411) Sep 01 13:33:26.346548 dv-cinder-839768-5-iscsi systemd[1]: Started Devstack devstack@keystone.service. Sep 01 13:33:26.351400 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: spawned uWSGI worker 1 (pid: 88417, cores: 1) Sep 01 13:33:26.351400 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: spawned uWSGI worker 2 (pid: 88418, cores: 1) Sep 01 13:33:26.351400 dv-cinder-839768-5-iscsi devstack@keystone.service[88411]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 13:33:30.651402 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 13:33:30.651402 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: from cryptography.utils import int_from_bytes Sep 01 13:33:30.652193 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 13:33:30.652193 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: from cryptography.utils import int_from_bytes Sep 01 13:33:30.652948 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 13:33:30.652948 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: from cryptography.utils import int_from_bytes Sep 01 13:33:30.653665 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 13:33:30.653665 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: from cryptography.utils import int_from_bytes Sep 01 13:33:30.702188 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 13:33:30.702359 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 13:33:30.702555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] command line args: [] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 13:33:30.702823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 13:33:30.702997 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ================================================================================ {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 13:33:30.703249 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] admin_token = **** {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.703523 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] config_dir = [] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.703710 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.703889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] config_source = [] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.704066 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] debug = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.704262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.704620 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 13:33:30.704704 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.704808 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.704908 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 13:33:30.705008 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] command line args: [] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 13:33:30.705105 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.705254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 13:33:30.705357 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.705457 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ================================================================================ {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 13:33:30.705558 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] list_limit = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.705670 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] log_config_append = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.705770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] admin_token = **** {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.705872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.705965 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] config_dir = [] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.706063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] log_dir = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.706162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] log_file = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.706259 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.706353 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] config_source = [] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.706453 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.706558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] debug = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.706633 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.706711 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.706854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.706940 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.707107 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.707186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.707307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.707404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.707531 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.707639 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.707765 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.707878 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] list_limit = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.707959 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.708062 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] log_config_append = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.708148 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.708244 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.708366 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.708441 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] log_dir = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.708591 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] log_file = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.708674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.708826 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.708910 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.709070 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.709205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.709305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.709384 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.709554 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.709640 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.709718 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.709900 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.710051 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.710176 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.710253 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] publish_errors = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.710448 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.710552 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.710672 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.710757 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.710849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.710925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.711094 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.711175 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.711324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.711475 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.711588 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] standard_threads = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.711665 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.711815 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.711896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.712054 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.712138 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.712214 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.712391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] use_journal = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.712566 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] use_json = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.712648 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.712724 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] use_stderr = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.712793 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] publish_errors = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.712898 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] use_syslog = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.712982 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.713126 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.713207 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.713367 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.713440 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.713605 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.713687 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.713843 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.713923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.714081 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] standard_threads = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.714157 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.714317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.714467 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.714545 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.714613 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.714731 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.714805 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.714940 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] use_journal = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.715023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.715093 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] use_json = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.715229 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.715312 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] use_stderr = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.715437 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] use_syslog = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.715513 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.715676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:33:30.715754 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.715934 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.716009 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.716176 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.716259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.716415 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.716497 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.716659 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.716736 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.716904 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.716985 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.717630 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.717721 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.717898 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.717975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.718150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.718232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.718393 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.718477 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.718627 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.718710 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.718877 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.718953 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.719128 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.719206 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.719390 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.719478 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.719634 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.719716 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.719860 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.719941 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.720090 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.720166 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.720318 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.720469 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.720548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.720623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.720783 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.720865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.721028 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.721116 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.721256 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.721333 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.721484 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.721559 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.721727 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.721866 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.721969 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.722131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.722205 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.722388 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.722464 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.722626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.722709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.722865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.722946 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.723096 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.723203 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.723326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.723447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.723577 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.723680 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.723813 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.723916 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.724042 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.724160 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.724276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.724355 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.724522 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.724607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.724749 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.724833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.724983 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.725063 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.725210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.725290 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.725444 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.725523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.725677 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.725762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.725921 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.726007 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.726134 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.726209 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.726372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.726452 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.726606 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.726683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.726838 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.726924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.727075 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.727152 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.727310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.727422 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.727569 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.727655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.727809 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.727884 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.728043 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.728118 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.728278 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.728371 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.728511 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.728589 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.728769 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.728846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.729006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.729090 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.729236 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.729314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.729472 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.729548 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.729708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.729792 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.729953 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.730028 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.730195 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.730271 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.730432 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.730515 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.730673 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.730749 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.730907 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.730983 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.731141 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.731225 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.731389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.731469 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.731640 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.731718 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.731876 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.732026 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.732099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.732177 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.732342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.732419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.732576 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.732664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.733673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.733761 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.733907 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.733984 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.734153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.734241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.734387 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.734470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.734621 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.734704 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.734856 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.734932 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.735093 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.735235 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.735331 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.735417 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.735605 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.735687 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.735842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.735921 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.736077 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.736155 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.736316 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.736391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.736547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.736624 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.736781 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.736857 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.737016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.737093 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.737247 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.737334 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.737477 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.737553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.737704 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.737780 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.737937 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.738014 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.738165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.738241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.738403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.738480 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.738637 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.738715 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.738884 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.738962 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.739121 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.739198 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.739416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.739499 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.739639 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.739715 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.739875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.739951 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.740107 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] auth.external = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.740188 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.740337 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.740413 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.740574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.740649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.740815 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.740893 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.741087 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] auth.password = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.741181 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.741297 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] auth.token = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.741402 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.741535 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.741613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.741768 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.741845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.742015 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.742093 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.742249 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.742327 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.742497 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.742577 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.742741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.742818 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.742973 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.743049 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] auth.external = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.743206 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.743283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] credential.caching = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.743473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.743552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.743722 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.743800 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.743972 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.744052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] auth.password = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.744205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] auth.token = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.744281 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.744442 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.744518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.744674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.744761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.744916 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.744994 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.745152 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.745235 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.745390 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.745523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.745700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.745816 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.745921 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.746057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.746149 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.746299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] credential.caching = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.746410 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.746554 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.746651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.746810 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.746959 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.747065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.747149 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] federation.caching = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.747325 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.747458 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.747599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.747689 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.747838 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.747914 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.748064 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.748140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.748308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.748387 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.748570 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.748647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.748825 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.748903 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.749063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.749141 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.749318 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.749395 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.749553 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.749630 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.749799 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.749877 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.750033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] identity.caching = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.750110 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.750282 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.750369 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] federation.caching = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.750526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.750606 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.750760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.750844 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.750994 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.751072 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.751239 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.751317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.751491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.751570 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.751728 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.751808 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.751978 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.752057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.752226 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.752303 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.752456 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.752535 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.752687 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.752777 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.752916 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.753031 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.753158 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.753236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] identity.caching = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.753403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.753482 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.753647 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.753724 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.753886 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.753963 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.754130 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.754209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.754384 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.754461 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.754618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.754694 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.754855 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.754934 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.755085 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.755161 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.755319 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.755439 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.755598 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.755682 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.755836 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.755914 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.756074 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.756160 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.756307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.756384 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.756553 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.756630 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.756840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.756973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.757057 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.757130 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.757260 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.757339 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.757493 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.757579 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.757736 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.757815 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.757981 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.758059 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.758210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.758295 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.758447 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.758525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.758676 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.758753 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.758912 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.758996 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.759144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.759221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.759402 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.759482 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.759640 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.759729 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.759874 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.759952 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.760126 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.760203 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.760368 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.760470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.760599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.760678 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.760828 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.760906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.761075 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.761162 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.761309 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.761385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.761544 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.761620 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.761793 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.761885 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.762011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.762151 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.762239 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.762318 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.762476 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.762563 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.762728 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.762806 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.762956 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.763040 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.763202 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.763289 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.763471 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.763551 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.763707 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.763783 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.763941 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.764029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.764192 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.764269 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.764425 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.764502 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.764657 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.764742 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.764888 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.764967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.765116 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.765194 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.765360 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.765445 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.765607 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.765722 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.765852 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.765927 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.766085 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.766170 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.766325 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.766402 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.766553 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.766630 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.766794 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.766880 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.767027 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.767105 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.767258 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.767334 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.767511 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.767604 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.767745 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.767825 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.767981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.768057 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.768217 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.768302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.768453 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.768541 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.768701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.768780 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.768931 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.769019 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.769174 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.769252 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.769408 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.769486 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.769642 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.769796 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.769871 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.769941 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.770118 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.770214 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.770360 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.770446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.770608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.770687 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.770846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.770924 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.771096 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.771182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] resource.caching = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.771349 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.771473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.771612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.771690 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.771862 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.771959 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.772098 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.772233 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.772347 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.772423 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.772579 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.772658 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.772814 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.772891 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.773048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.773124 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.773287 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.773366 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.773522 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] role.caching = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.773599 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.773756 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.773833 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] role.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.773993 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.774071 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.774234 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] resource.caching = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.774317 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.774479 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.774556 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.774725 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.774805 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.774960 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.775036 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.775203 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.775280 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.775471 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.775553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.775719 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.775797 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.775965 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.776042 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.776195 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.776275 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.776437 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.776513 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.776702 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.776790 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] role.caching = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.776915 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.776994 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] role.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.777156 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.777280 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.777405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.777576 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.777671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.777791 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.777925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.778012 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.778150 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.778232 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.778402 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.778527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.778643 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.778722 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.778888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.779012 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.779150 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.779237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.779392 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.779523 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.780154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.780257 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.780450 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.780567 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.780649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.780761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.780841 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.780968 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.781081 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.781298 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.781386 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.781539 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.781664 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.781786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.781868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.781982 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.782061 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.782214 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.782338 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.782481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] token.caching = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.782569 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.782748 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.782872 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.782949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.783068 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.783192 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.783272 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.783401 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.783479 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.783638 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.783761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.783888 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.783970 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.784086 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.784163 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.784335 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.784458 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.784582 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.784667 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.784825 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.784943 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.785023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.785139 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.785226 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.785346 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.785458 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.785541 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.785732 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.785857 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] token.caching = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.785980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.786071 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.786196 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.786273 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.786434 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.786513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.786690 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] database.connection = **** {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.786776 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.786931 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.787008 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.787170 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.787246 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.787424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.787519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.787666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.787744 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.787899 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.787980 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.788133 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.788219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.788373 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.788448 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.788613 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.788690 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.788866 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.788951 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.789143 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.789220 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.789376 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.789464 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.789607 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.789679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.789839 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.789926 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.790073 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.790150 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] database.connection = **** {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.790312 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.790438 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.790541 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.790628 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.790778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.790856 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.791010 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.791088 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.791179 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 13:33:30.791282 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.791567 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.791807 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.792048 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.792296 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.792535 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.792781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.793020 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.793271 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.793508 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.793755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.793989 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.794278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.794471 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:33:30.794642 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 13:33:30.820630 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:30.820849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:30.821070 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:30.824088 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:30.824329 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:30.824560 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:30.829907 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:30.833891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:30.859208 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:30.859457 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:30.861572 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:30.861850 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:30.912969 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:30.913960 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:30.961900 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:30.962127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:30.962968 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:30.963203 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.116835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.117059 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.117281 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.117398 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.117510 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.117635 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.117720 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.117861 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.117944 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.118085 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.118307 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.118527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.141615 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.141756 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.141841 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.142007 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.142090 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.142240 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.142323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.142469 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.142567 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.142688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.142770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.142900 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.142983 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.143140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.153983 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.154531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.167269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.167443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.167653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.167778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.167869 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.167985 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.168131 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.168223 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.168351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.168431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.168553 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88417) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.168668 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.168851 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.169099 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:33:31.185302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.185509 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 13:33:31.185851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.186568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.186660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 13:33:31.186825 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 13:33:31.186955 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.187091 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.187207 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.187335 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.187493 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 13:33:31.187613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.187959 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.188231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.188498 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.188818 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.197290 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.197564 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.197829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.198108 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.198474 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.198767 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.199064 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.199351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.205677 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.207081 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.208734 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.208915 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.209198 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.209476 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.209756 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.210018 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.210124 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.210286 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.210367 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.210556 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.210640 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.210822 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.210903 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.211093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.211174 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.211372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.211468 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.211711 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.212101 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.212398 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.212687 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.212965 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.234283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.235772 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.235958 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.236086 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.237452 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.237741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.240610 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.240894 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.241170 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.242384 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.242675 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.242982 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.247671 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.247959 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.250120 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.250409 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.252562 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.252867 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.253138 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.253424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.253724 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.254692 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.254994 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.255278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.255595 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.255773 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.255915 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.256060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.256146 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.256415 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.256546 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.256668 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.272052 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.272328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.273956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.274240 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.276237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.280574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.280667 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.280667 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.282004 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.282324 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.284553 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.286608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.287752 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.289766 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.290825 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.291126 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.291435 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.291720 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.292006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.292380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.293039 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.293355 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.293646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.293936 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.294318 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.294562 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.308940 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.309224 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.309489 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.309750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.311455 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.311455 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.311654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.311899 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.316532 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.318226 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.318904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.319774 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.320059 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.320455 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.321994 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.322276 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.322676 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.323003 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.323286 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.323592 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.323882 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.325038 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.325332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.325730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.326022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.326316 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.335203 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.335512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.335795 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.336075 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.336354 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.336634 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.336920 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.337736 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.338028 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.338410 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.338699 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.338991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.339278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.339598 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.352994 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.355731 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.356076 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.359558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.359778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.361203 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.362447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.362655 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.362936 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.363233 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.364181 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.365794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.366103 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.366407 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.369864 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.371330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.373051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.374229 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.374519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.374678 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.374856 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.375125 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.377771 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.378066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.378355 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.378681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.383103 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.383721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.383721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.386565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.386859 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.387147 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.390578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88417) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.390862 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.391143 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.391560 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.391832 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.392100 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.392385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.392661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.392938 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.393212 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.393481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.393740 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.394002 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.394082 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:33:31.394275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88417) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.394356 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.394632 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.394910 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.395208 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.395517 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.395805 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.396087 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.396369 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.396644 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.396919 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.397194 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.397523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.397809 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:33:31.429192 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563a891579c0 pid: 88417 (default app) Sep 01 13:33:31.432617 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9170cf4-83d4-4293-9a6f-a6edde10810a None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:31.432719 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563a891579c0 pid: 88418 (default app) Sep 01 13:33:31.432900 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9170cf4-83d4-4293-9a6f-a6edde10810a None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:31.433172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9170cf4-83d4-4293-9a6f-a6edde10810a None None] PATH_INFO: `/v3` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:31.437896 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 791 bytes} [Thu Sep 1 13:33:31 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:33:39.046000 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0084930-239d-4045-8aa0-448f8c4e705a None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:39.046553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0084930-239d-4045-8aa0-448f8c4e705a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:39.046553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0084930-239d-4045-8aa0-448f8c4e705a None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:39.050911 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1/2] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:33:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:33:39.056078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3777e-8164-49eb-8780-4f3c6fb88c1a None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:39.056609 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3777e-8164-49eb-8780-4f3c6fb88c1a None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:39.056609 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3777e-8164-49eb-8780-4f3c6fb88c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:39.129362 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: INFO dbcounter [None req-15d3777e-8164-49eb-8780-4f3c6fb88c1a None None] Registered counter for database keystone Sep 01 13:33:39.150425 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG oslo_db.sqlalchemy.engines [None req-15d3777e-8164-49eb-8780-4f3c6fb88c1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88417) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:33:39.156860 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writer thread running {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:33:39.340008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG passlib.handlers.bcrypt [None req-15d3777e-8164-49eb-8780-4f3c6fb88c1a None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88417) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 13:33:39.340425 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG passlib.handlers.bcrypt [None req-15d3777e-8164-49eb-8780-4f3c6fb88c1a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88417) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 13:33:39.399627 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-15d3777e-8164-49eb-8780-4f3c6fb88c1a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:33:39.401179 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-15d3777e-8164-49eb-8780-4f3c6fb88c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:33:39.531333 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 2/3] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:33:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 01 13:33:39.996571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0084930-239d-4045-8aa0-448f8c4e705a None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:40.065241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: INFO dbcounter [None req-f0084930-239d-4045-8aa0-448f8c4e705a None None] Registered counter for database keystone Sep 01 13:33:40.084577 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG oslo_db.sqlalchemy.engines [None req-f0084930-239d-4045-8aa0-448f8c4e705a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88418) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:33:40.090719 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writer thread running {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:33:40.210005 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0084930-239d-4045-8aa0-448f8c4e705a None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:40.215397 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9989252-bd45-4a7d-ab19-b1d62eb8840a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:40.216228 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9989252-bd45-4a7d-ab19-b1d62eb8840a admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:40.216598 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9989252-bd45-4a7d-ab19-b1d62eb8840a admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:40.217476 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9989252-bd45-4a7d-ab19-b1d62eb8840a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:40.228143 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9989252-bd45-4a7d-ab19-b1d62eb8840a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:40.289941 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a9989252-bd45-4a7d-ab19-b1d62eb8840a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 13:33:40.290285 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9989252-bd45-4a7d-ab19-b1d62eb8840a admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:40.300319 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 2/4] 10.222.0.50 () {58 vars in 1324 bytes} [Thu Sep 1 13:33:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 13:33:40.306185 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3777e-8164-49eb-8780-4f3c6fb88c1a None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:40.320261 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3777e-8164-49eb-8780-4f3c6fb88c1a None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:40.324694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6179f4-ed76-492c-be6c-65cf2b2f7535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:40.325782 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6179f4-ed76-492c-be6c-65cf2b2f7535 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:40.326063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6179f4-ed76-492c-be6c-65cf2b2f7535 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:40.326337 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6179f4-ed76-492c-be6c-65cf2b2f7535 admin admin] PATH_INFO: `/v3/projects/c52243fb4fdd4f1bb4f3291630bfbabe` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:40.327928 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6179f4-ed76-492c-be6c-65cf2b2f7535 admin admin] RBAC: Authorizing `identity:get_project(project_id=c52243fb4fdd4f1bb4f3291630bfbabe)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:40.380431 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0a6179f4-ed76-492c-be6c-65cf2b2f7535 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 13:33:40.380772 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6179f4-ed76-492c-be6c-65cf2b2f7535 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:40.385342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 3/5] 10.222.0.50 () {56 vars in 1207 bytes} [Thu Sep 1 13:33:40 2022] GET /identity/v3/projects/c52243fb4fdd4f1bb4f3291630bfbabe => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:33:42.233270 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f7cf5-cf7a-4b24-8468-024a304348b1 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:42.233780 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f7cf5-cf7a-4b24-8468-024a304348b1 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:42.233780 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f7cf5-cf7a-4b24-8468-024a304348b1 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:42.237898 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 3/6] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:33:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:33:42.243389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b033b30-7910-4f8a-bd91-9544222ee6d9 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:42.243828 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b033b30-7910-4f8a-bd91-9544222ee6d9 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:42.243959 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b033b30-7910-4f8a-bd91-9544222ee6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:42.264043 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-8b033b30-7910-4f8a-bd91-9544222ee6d9 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:33:42.265546 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-8b033b30-7910-4f8a-bd91-9544222ee6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:33:42.273206 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 4/7] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:33:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 01 13:33:42.535984 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f7cf5-cf7a-4b24-8468-024a304348b1 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:42.547934 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f7cf5-cf7a-4b24-8468-024a304348b1 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:42.552039 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184206f-c46e-44e9-8387-b1748b0446e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:42.552627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184206f-c46e-44e9-8387-b1748b0446e0 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:42.552928 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184206f-c46e-44e9-8387-b1748b0446e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:42.553170 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184206f-c46e-44e9-8387-b1748b0446e0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:42.561187 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184206f-c46e-44e9-8387-b1748b0446e0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:42.562936 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184206f-c46e-44e9-8387-b1748b0446e0 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:42.571894 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 4/8] 10.222.0.50 () {58 vars in 1324 bytes} [Thu Sep 1 13:33:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 13:33:42.578498 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b033b30-7910-4f8a-bd91-9544222ee6d9 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:42.588056 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b033b30-7910-4f8a-bd91-9544222ee6d9 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:42.593152 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97463e8-9629-45c9-bff7-9f9da7f1ab03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:42.593801 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97463e8-9629-45c9-bff7-9f9da7f1ab03 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:42.594084 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97463e8-9629-45c9-bff7-9f9da7f1ab03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:42.594361 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97463e8-9629-45c9-bff7-9f9da7f1ab03 admin admin] PATH_INFO: `/v3/users/f72e2116699d4d6889af55d666d2817d` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:42.595755 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97463e8-9629-45c9-bff7-9f9da7f1ab03 admin admin] RBAC: Authorizing `identity:get_user(user_id=f72e2116699d4d6889af55d666d2817d)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:42.597611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97463e8-9629-45c9-bff7-9f9da7f1ab03 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:42.599179 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 5/9] 10.222.0.50 () {56 vars in 1198 bytes} [Thu Sep 1 13:33:42 2022] GET /identity/v3/users/f72e2116699d4d6889af55d666d2817d => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:33:44.551435 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b675c-003b-442a-80f4-5eda69325e9b None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:44.551958 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b675c-003b-442a-80f4-5eda69325e9b None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:44.552059 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b675c-003b-442a-80f4-5eda69325e9b None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:44.553295 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 5/10] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:33:44.558378 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946b6d8-0efe-432f-aa0f-bbb77930ff47 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:44.558795 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946b6d8-0efe-432f-aa0f-bbb77930ff47 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:44.559076 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946b6d8-0efe-432f-aa0f-bbb77930ff47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:44.577759 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-1946b6d8-0efe-432f-aa0f-bbb77930ff47 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:33:44.578929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-1946b6d8-0efe-432f-aa0f-bbb77930ff47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:33:44.608515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d9875-2f46-46cd-8af4-7d5c3d33239e None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:44.608888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d9875-2f46-46cd-8af4-7d5c3d33239e None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:44.609186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d9875-2f46-46cd-8af4-7d5c3d33239e None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:44.610491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 6/11] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:33:44.615791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58410ee4-e48a-4c75-a1ed-cfca5a641518 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:44.616073 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58410ee4-e48a-4c75-a1ed-cfca5a641518 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:44.616346 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58410ee4-e48a-4c75-a1ed-cfca5a641518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:44.658381 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG passlib.handlers.bcrypt [None req-58410ee4-e48a-4c75-a1ed-cfca5a641518 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88418) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 13:33:44.658773 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG passlib.handlers.bcrypt [None req-58410ee4-e48a-4c75-a1ed-cfca5a641518 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88418) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 13:33:44.662741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 6/12] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:33:44.708123 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-58410ee4-e48a-4c75-a1ed-cfca5a641518 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:33:44.709744 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-58410ee4-e48a-4c75-a1ed-cfca5a641518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:33:44.806530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 7/13] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:33:44.925920 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946b6d8-0efe-432f-aa0f-bbb77930ff47 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:44.951838 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:33:45.033700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946b6d8-0efe-432f-aa0f-bbb77930ff47 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:45.068028 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58410ee4-e48a-4c75-a1ed-cfca5a641518 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:45.068201 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cb3e8-26d3-4b55-baeb-ccca07862646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:45.068790 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cb3e8-26d3-4b55-baeb-ccca07862646 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:45.069068 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cb3e8-26d3-4b55-baeb-ccca07862646 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:45.069376 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cb3e8-26d3-4b55-baeb-ccca07862646 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:45.080944 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16cb3e8-26d3-4b55-baeb-ccca07862646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:33:45.097369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-d16cb3e8-26d3-4b55-baeb-ccca07862646 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:33:45.097369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:33:45.097369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:33:45.097369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:33:45.097369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:33:45.097369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:33:45.097369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:33:45.097369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:33:45.097369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:33:45.097369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:33:45.097369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:33:45.097369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:33:45.097369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:33:45.097369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:33:45.097369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:33:45.097369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:33:45.098269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:33:45.098269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:33:45.098269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:33:45.098269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:33:45.098269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:33:45.098269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:33:45.098269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:33:45.098269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:33:45.098269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:33:45.098269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:33:45.098269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:33:45.098269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:33:45.098269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:33:45.098269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:33:45.098269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:33:45.098269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:33:45.099057 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:33:45.099057 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:33:45.099057 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:33:45.099057 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:33:45.099057 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:33:45.099057 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:33:45.099057 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:33:45.099057 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:33:45.099057 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:33:45.099057 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:33:45.099057 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:33:45.099057 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:33:45.099057 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 7/14] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:33:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:33:45.104178 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cb3e8-26d3-4b55-baeb-ccca07862646 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:45.166836 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58410ee4-e48a-4c75-a1ed-cfca5a641518 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:45.169096 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:33:45.185072 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:33:45.202637 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cb3e8-26d3-4b55-baeb-ccca07862646 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:45.204087 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e1ab6-aa71-47d8-a147-1325df499170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:45.204946 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e1ab6-aa71-47d8-a147-1325df499170 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:45.205226 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e1ab6-aa71-47d8-a147-1325df499170 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:45.205503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e1ab6-aa71-47d8-a147-1325df499170 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:45.238937 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28072d82-24d4-4767-a92f-156e97bd993e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:45.239580 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28072d82-24d4-4767-a92f-156e97bd993e None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:45.239872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28072d82-24d4-4767-a92f-156e97bd993e None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:45.240147 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28072d82-24d4-4767-a92f-156e97bd993e None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:45.240932 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28072d82-24d4-4767-a92f-156e97bd993e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:33:45.241247 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28072d82-24d4-4767-a92f-156e97bd993e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:45.242655 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28072d82-24d4-4767-a92f-156e97bd993e None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:45.256170 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 8/15] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:33:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:33:45.261804 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28072d82-24d4-4767-a92f-156e97bd993e None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:45.274686 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e1ab6-aa71-47d8-a147-1325df499170 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:45.276439 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e1ab6-aa71-47d8-a147-1325df499170 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:45.363931 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28072d82-24d4-4767-a92f-156e97bd993e None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:45.377161 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 8/16] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:33:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 13:33:45.382940 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e1ab6-aa71-47d8-a147-1325df499170 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:45.385806 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:33:45.398983 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102e6f9-405d-4db3-aa3b-6e5e5d581fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:45.399646 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102e6f9-405d-4db3-aa3b-6e5e5d581fdb None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:45.399920 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102e6f9-405d-4db3-aa3b-6e5e5d581fdb None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:45.400187 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102e6f9-405d-4db3-aa3b-6e5e5d581fdb None admin] PATH_INFO: `/v3/users/f72e2116699d4d6889af55d666d2817d` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:45.401361 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102e6f9-405d-4db3-aa3b-6e5e5d581fdb None admin] RBAC: Authorizing `identity:get_user(user_id=f72e2116699d4d6889af55d666d2817d)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:45.402824 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102e6f9-405d-4db3-aa3b-6e5e5d581fdb None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:45.404926 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 9/17] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:33:45 2022] GET /identity/v3/users/f72e2116699d4d6889af55d666d2817d => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:33:45.410364 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102e6f9-405d-4db3-aa3b-6e5e5d581fdb None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:45.426826 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:33:45.484762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e1ab6-aa71-47d8-a147-1325df499170 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:45.512720 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102e6f9-405d-4db3-aa3b-6e5e5d581fdb None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:45.517940 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b1524-2a97-45f8-97e2-7dff2c830b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:45.518798 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b1524-2a97-45f8-97e2-7dff2c830b0f None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:45.519085 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b1524-2a97-45f8-97e2-7dff2c830b0f None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:45.519384 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b1524-2a97-45f8-97e2-7dff2c830b0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:45.538060 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b1524-2a97-45f8-97e2-7dff2c830b0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:45.539588 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b1524-2a97-45f8-97e2-7dff2c830b0f None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:45.546747 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea372f-2844-41fe-9b99-47cf0b992e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:45.547400 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea372f-2844-41fe-9b99-47cf0b992e4e None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:45.547691 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea372f-2844-41fe-9b99-47cf0b992e4e None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:45.547971 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea372f-2844-41fe-9b99-47cf0b992e4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:45.549090 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea372f-2844-41fe-9b99-47cf0b992e4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:45.550556 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea372f-2844-41fe-9b99-47cf0b992e4e None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:45.552237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 10/18] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:33:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:33:45.557975 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea372f-2844-41fe-9b99-47cf0b992e4e None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:45.559196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-565b1524-2a97-45f8-97e2-7dff2c830b0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:33:45.559196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:33:45.559196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:33:45.559196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:33:45.559196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:33:45.559196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:33:45.559196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:33:45.559196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:33:45.559196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:33:45.559196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:33:45.559196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:33:45.559196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:33:45.559196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:33:45.559196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:33:45.559196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:33:45.559196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:33:45.560491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:33:45.560491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:33:45.560491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:33:45.560491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:33:45.560491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:33:45.560491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:33:45.560491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:33:45.560491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:33:45.560491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:33:45.560491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:33:45.560491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:33:45.560491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:33:45.560491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:33:45.560491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:33:45.560491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:33:45.560491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:33:45.560491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:33:45.561332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:33:45.561332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:33:45.561332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:33:45.561332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 9/19] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:33:45.566036 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b1524-2a97-45f8-97e2-7dff2c830b0f None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:45.621935 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:33:45.644118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:33:45.664129 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea372f-2844-41fe-9b99-47cf0b992e4e None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:45.665589 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b1524-2a97-45f8-97e2-7dff2c830b0f None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:45.699328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5835da7-3d41-4887-8c6e-5fa48a152141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:45.699566 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ad388-6470-4a82-84ec-6c31fb9c6a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:45.699963 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5835da7-3d41-4887-8c6e-5fa48a152141 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:45.700064 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ad388-6470-4a82-84ec-6c31fb9c6a94 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:45.700247 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ad388-6470-4a82-84ec-6c31fb9c6a94 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:45.700349 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5835da7-3d41-4887-8c6e-5fa48a152141 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:45.700518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ad388-6470-4a82-84ec-6c31fb9c6a94 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:45.700604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5835da7-3d41-4887-8c6e-5fa48a152141 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:45.701182 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ad388-6470-4a82-84ec-6c31fb9c6a94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:33:45.701272 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5835da7-3d41-4887-8c6e-5fa48a152141 None admin] RBAC: Adding query filter params (role.id=98ffd3c114804da292d7cb33721e9085, scope.domain.id=default, user.id=f72e2116699d4d6889af55d666d2817d) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:33:45.701481 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ad388-6470-4a82-84ec-6c31fb9c6a94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:45.701574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5835da7-3d41-4887-8c6e-5fa48a152141 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:45.702864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ad388-6470-4a82-84ec-6c31fb9c6a94 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:45.703023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5835da7-3d41-4887-8c6e-5fa48a152141 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:45.709818 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 11/20] 10.222.0.50 () {56 vars in 1322 bytes} [Thu Sep 1 13:33:45 2022] GET /identity/v3/role_assignments?user.id=f72e2116699d4d6889af55d666d2817d&scope.domain.id=default&role.id=98ffd3c114804da292d7cb33721e9085 => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:33:45.721694 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 10/21] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:33:47.817149 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d22c1-1458-4119-8516-564a4da0d7bf None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:47.817680 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d22c1-1458-4119-8516-564a4da0d7bf None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:47.817680 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d22c1-1458-4119-8516-564a4da0d7bf None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:47.819192 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 12/22] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:33:47.825508 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595f2cb-b38e-4acf-9533-ceada1fca880 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:47.826021 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595f2cb-b38e-4acf-9533-ceada1fca880 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:47.826249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595f2cb-b38e-4acf-9533-ceada1fca880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:47.862349 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-b595f2cb-b38e-4acf-9533-ceada1fca880 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:33:47.863848 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b595f2cb-b38e-4acf-9533-ceada1fca880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:33:47.942340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce82a50-56d1-4637-8326-1adb14b311fa None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:47.942666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce82a50-56d1-4637-8326-1adb14b311fa None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:47.942894 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce82a50-56d1-4637-8326-1adb14b311fa None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:47.944476 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 13/23] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:33:47.949686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fb7d1-07e6-44c5-b848-5809a4ae1ca3 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:47.950275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fb7d1-07e6-44c5-b848-5809a4ae1ca3 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:47.951151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fb7d1-07e6-44c5-b848-5809a4ae1ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:47.973786 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 11/24] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:33:47.985747 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-2e9fb7d1-07e6-44c5-b848-5809a4ae1ca3 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:33:47.987266 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-2e9fb7d1-07e6-44c5-b848-5809a4ae1ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:33:48.090616 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 14/25] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:33:48.178693 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf90072-32e8-47d1-8ec6-989a2a5b0a55 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:48.178977 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf90072-32e8-47d1-8ec6-989a2a5b0a55 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:48.179482 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf90072-32e8-47d1-8ec6-989a2a5b0a55 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:48.181260 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 12/26] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:33:48.186915 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba017baf-fb1f-408d-82cf-21f61d498162 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:48.187334 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba017baf-fb1f-408d-82cf-21f61d498162 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:48.187650 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba017baf-fb1f-408d-82cf-21f61d498162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:48.211115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-ba017baf-fb1f-408d-82cf-21f61d498162 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:33:48.212704 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-ba017baf-fb1f-408d-82cf-21f61d498162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:33:48.317801 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 15/27] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:33:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:33:48.546410 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf90072-32e8-47d1-8ec6-989a2a5b0a55 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:48.552012 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba017baf-fb1f-408d-82cf-21f61d498162 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:48.558002 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:33:48.645782 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:33:48.691535 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf90072-32e8-47d1-8ec6-989a2a5b0a55 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:48.741759 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba017baf-fb1f-408d-82cf-21f61d498162 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:48.742610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99907cea-dce0-4124-b29a-5faf7a624190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:48.743584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99907cea-dce0-4124-b29a-5faf7a624190 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:48.744032 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99907cea-dce0-4124-b29a-5faf7a624190 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:48.744545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99907cea-dce0-4124-b29a-5faf7a624190 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:48.756730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99907cea-dce0-4124-b29a-5faf7a624190 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:48.758586 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99907cea-dce0-4124-b29a-5faf7a624190 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:48.775450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-99907cea-dce0-4124-b29a-5faf7a624190 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:33:48.775450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:33:48.775450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:33:48.775450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:33:48.775450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:33:48.775450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:33:48.775450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:33:48.775450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:33:48.775450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:33:48.775450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:33:48.775450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:33:48.775450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:33:48.775450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:33:48.775450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:33:48.775450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:33:48.775450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:33:48.776537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:33:48.776537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:33:48.776537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:33:48.776537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:33:48.776537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:33:48.776537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:33:48.776537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:33:48.776537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:33:48.776537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:33:48.776537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:33:48.776537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:33:48.776537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:33:48.776537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:33:48.776537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:33:48.776537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:33:48.776537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:33:48.776537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:33:48.777386 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:33:48.777386 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:33:48.777386 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:33:48.778901 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 13/28] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:33:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:33:48.780343 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50038f9b-cc63-4e98-ba83-7da3199ea0ac None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:48.780870 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50038f9b-cc63-4e98-ba83-7da3199ea0ac None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:48.781351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50038f9b-cc63-4e98-ba83-7da3199ea0ac None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:48.782795 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 14/29] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:33:48.783700 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50038f9b-cc63-4e98-ba83-7da3199ea0ac None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:48.792173 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858780f-f71b-45df-b6b1-e20d52539da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:48.792841 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858780f-f71b-45df-b6b1-e20d52539da7 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:48.793119 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858780f-f71b-45df-b6b1-e20d52539da7 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:48.793399 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858780f-f71b-45df-b6b1-e20d52539da7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:48.809738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858780f-f71b-45df-b6b1-e20d52539da7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:33:48.815787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-6858780f-f71b-45df-b6b1-e20d52539da7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:33:48.815787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:33:48.815787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:33:48.815787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:33:48.815787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:33:48.815787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:33:48.815787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:33:48.815787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:33:48.815787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:33:48.815787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:33:48.815787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:33:48.815787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:33:48.815787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:33:48.815787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:33:48.815787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:33:48.815787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:33:48.816686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:33:48.816686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:33:48.816686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:33:48.816686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:33:48.816686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:33:48.816686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:33:48.816686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:33:48.816686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:33:48.816686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:33:48.816686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:33:48.816686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:33:48.816686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:33:48.816686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:33:48.816686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:33:48.816686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:33:48.816686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:33:48.817849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:33:48.817849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:33:48.817849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:33:48.817849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:33:48.817849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:33:48.817849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:33:48.817849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:33:48.817849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:33:48.817849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:33:48.817849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:33:48.817849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:33:48.817849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:33:48.817849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 16/30] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:33:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:33:48.818878 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e11e1-8d46-403c-9e24-cf88541c7a21 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:48.818998 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e11e1-8d46-403c-9e24-cf88541c7a21 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:48.819256 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e11e1-8d46-403c-9e24-cf88541c7a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:48.842880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-585e11e1-8d46-403c-9e24-cf88541c7a21 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:33:48.844150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-585e11e1-8d46-403c-9e24-cf88541c7a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:33:48.914702 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:33:48.920917 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:33:48.922434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50038f9b-cc63-4e98-ba83-7da3199ea0ac None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:48.929882 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 17/31] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:33:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:33:48.930866 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e11e1-8d46-403c-9e24-cf88541c7a21 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:48.994175 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39501a9b-503e-4054-9594-e377439fd577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:48.995096 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39501a9b-503e-4054-9594-e377439fd577 None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:48.995566 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39501a9b-503e-4054-9594-e377439fd577 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:48.996914 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39501a9b-503e-4054-9594-e377439fd577 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:48.998294 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39501a9b-503e-4054-9594-e377439fd577 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:49.002616 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39501a9b-503e-4054-9594-e377439fd577 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:49.076336 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e11e1-8d46-403c-9e24-cf88541c7a21 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:49.111391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b4d17-0b33-41d8-b8b5-f93139112de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:49.112271 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b4d17-0b33-41d8-b8b5-f93139112de8 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:49.112689 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b4d17-0b33-41d8-b8b5-f93139112de8 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:49.113097 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b4d17-0b33-41d8-b8b5-f93139112de8 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:49.113872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b4d17-0b33-41d8-b8b5-f93139112de8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:33:49.114309 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b4d17-0b33-41d8-b8b5-f93139112de8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:49.115911 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b4d17-0b33-41d8-b8b5-f93139112de8 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:49.133521 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 18/32] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:33:49.140021 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b4d17-0b33-41d8-b8b5-f93139112de8 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:49.199810 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:33:49.244129 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b4d17-0b33-41d8-b8b5-f93139112de8 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:49.280276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa00f3-0284-4110-812e-7e3b4d8fb24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:49.281147 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa00f3-0284-4110-812e-7e3b4d8fb24e None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:49.281563 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa00f3-0284-4110-812e-7e3b4d8fb24e None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:49.281968 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa00f3-0284-4110-812e-7e3b4d8fb24e None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:49.282767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa00f3-0284-4110-812e-7e3b4d8fb24e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:33:49.283219 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa00f3-0284-4110-812e-7e3b4d8fb24e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:49.284778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa00f3-0284-4110-812e-7e3b4d8fb24e None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:49.294009 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 19/33] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:33:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:33:49.295099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa00f3-0284-4110-812e-7e3b4d8fb24e None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:49.303185 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 15/34] 10.222.0.50 () {60 vars in 1131 bytes} [Thu Sep 1 13:33:48 2022] POST /identity/v3/roles => generated 219 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:33:49.304224 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39501a9b-503e-4054-9594-e377439fd577 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:49.403559 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa00f3-0284-4110-812e-7e3b4d8fb24e None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:49.423897 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:33:49.467449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b368f0a-c255-45bb-97b3-55a629dafd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:49.468536 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b368f0a-c255-45bb-97b3-55a629dafd93 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:49.469050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b368f0a-c255-45bb-97b3-55a629dafd93 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:49.469542 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b368f0a-c255-45bb-97b3-55a629dafd93 None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:49.470435 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b368f0a-c255-45bb-97b3-55a629dafd93 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:49.472271 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b368f0a-c255-45bb-97b3-55a629dafd93 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:49.478513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39501a9b-503e-4054-9594-e377439fd577 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:49.524483 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83533a5c-b4bc-43df-a18a-22fd2b4eb4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:49.526454 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83533a5c-b4bc-43df-a18a-22fd2b4eb4d5 None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:49.526454 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83533a5c-b4bc-43df-a18a-22fd2b4eb4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:49.526454 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83533a5c-b4bc-43df-a18a-22fd2b4eb4d5 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:49.527158 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83533a5c-b4bc-43df-a18a-22fd2b4eb4d5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:49.529242 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83533a5c-b4bc-43df-a18a-22fd2b4eb4d5 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:49.645167 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 16/35] 10.222.0.50 () {60 vars in 1131 bytes} [Thu Sep 1 13:33:49 2022] POST /identity/v3/roles => generated 225 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:33:49.646416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83533a5c-b4bc-43df-a18a-22fd2b4eb4d5 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:49.695978 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:33:49.737783 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 20/36] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Sep 1 13:33:49 2022] POST /identity/v3/projects => generated 301 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:33:49.739335 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1ca7f-ace0-4a9c-a924-8ebaa481fe55 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:49.739651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1ca7f-ace0-4a9c-a924-8ebaa481fe55 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:49.739930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1ca7f-ace0-4a9c-a924-8ebaa481fe55 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:49.741257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 21/37] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:33:49.755109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d6ce6-8635-42b6-88b5-228f2b65e99a None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:49.755109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d6ce6-8635-42b6-88b5-228f2b65e99a None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:49.755109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d6ce6-8635-42b6-88b5-228f2b65e99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:49.795710 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83533a5c-b4bc-43df-a18a-22fd2b4eb4d5 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:49.851013 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6473435-aed1-4289-a5a1-f14250155a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:49.852077 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6473435-aed1-4289-a5a1-f14250155a69 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:49.852553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6473435-aed1-4289-a5a1-f14250155a69 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:49.853069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6473435-aed1-4289-a5a1-f14250155a69 None admin] PATH_INFO: `/v3/users/f72e2116699d4d6889af55d666d2817d` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:49.855127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6473435-aed1-4289-a5a1-f14250155a69 None admin] RBAC: Authorizing `identity:get_user(user_id=f72e2116699d4d6889af55d666d2817d)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:49.857528 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6473435-aed1-4289-a5a1-f14250155a69 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:49.859790 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 17/38] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:33:49 2022] GET /identity/v3/users/f72e2116699d4d6889af55d666d2817d => generated 247 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:33:49.861358 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329e8c2-959c-493f-b20d-868c501f52ae None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:49.861823 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329e8c2-959c-493f-b20d-868c501f52ae None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:49.862236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329e8c2-959c-493f-b20d-868c501f52ae None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:49.863801 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 18/39] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:33:49.865646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329e8c2-959c-493f-b20d-868c501f52ae None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:49.904845 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-539d6ce6-8635-42b6-88b5-228f2b65e99a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:33:49.905779 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-539d6ce6-8635-42b6-88b5-228f2b65e99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:33:49.981407 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:33:49.999475 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 22/40] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:33:50.000775 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd10f1d-d8ad-4ebd-8f65-224123adcbc7 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:50.001021 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329e8c2-959c-493f-b20d-868c501f52ae None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:50.002569 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd10f1d-d8ad-4ebd-8f65-224123adcbc7 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:50.002569 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd10f1d-d8ad-4ebd-8f65-224123adcbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:50.020057 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-acd10f1d-d8ad-4ebd-8f65-224123adcbc7 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:33:50.021265 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-acd10f1d-d8ad-4ebd-8f65-224123adcbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:33:50.039192 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cf684-60fa-46b9-aefb-56a3fabd59d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:50.039867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cf684-60fa-46b9-aefb-56a3fabd59d7 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:50.040148 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cf684-60fa-46b9-aefb-56a3fabd59d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:50.040418 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cf684-60fa-46b9-aefb-56a3fabd59d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:50.041699 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877cf684-60fa-46b9-aefb-56a3fabd59d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:50.043132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877cf684-60fa-46b9-aefb-56a3fabd59d7 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:50.045569 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 19/41] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:33:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:33:50.050866 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cf684-60fa-46b9-aefb-56a3fabd59d7 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:50.092680 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 23/42] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:33:50.156626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cf684-60fa-46b9-aefb-56a3fabd59d7 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:50.191808 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a0301-8236-4919-b3c1-fc42db878b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:50.192473 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a0301-8236-4919-b3c1-fc42db878b45 None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:50.192751 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a0301-8236-4919-b3c1-fc42db878b45 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:50.193026 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a0301-8236-4919-b3c1-fc42db878b45 None admin] PATH_INFO: `/v3/domains/default/users/f72e2116699d4d6889af55d666d2817d/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:50.194929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a0301-8236-4919-b3c1-fc42db878b45 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f72e2116699d4d6889af55d666d2817d, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:50.196392 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a0301-8236-4919-b3c1-fc42db878b45 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:50.277618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd10f1d-d8ad-4ebd-8f65-224123adcbc7 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:50.299129 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 20/43] 10.222.0.50 () {58 vars in 1361 bytes} [Thu Sep 1 13:33:50 2022] PUT /identity/v3/domains/default/users/f72e2116699d4d6889af55d666d2817d/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:33:50.311642 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:33:50.361454 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a0301-8236-4919-b3c1-fc42db878b45 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:50.380176 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:33:50.404723 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd10f1d-d8ad-4ebd-8f65-224123adcbc7 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:50.461248 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01110e58-6558-4ee9-a0cc-f81d0d15bb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:50.461892 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01110e58-6558-4ee9-a0cc-f81d0d15bb66 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:50.462179 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01110e58-6558-4ee9-a0cc-f81d0d15bb66 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:50.462454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01110e58-6558-4ee9-a0cc-f81d0d15bb66 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:50.463227 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01110e58-6558-4ee9-a0cc-f81d0d15bb66 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:50.464904 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01110e58-6558-4ee9-a0cc-f81d0d15bb66 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:50.481533 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a0301-8236-4919-b3c1-fc42db878b45 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:50.518707 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cb2eb-0077-46b4-9a1e-f50cc878b9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:50.519425 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cb2eb-0077-46b4-9a1e-f50cc878b9e0 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:50.519697 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cb2eb-0077-46b4-9a1e-f50cc878b9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:50.519973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cb2eb-0077-46b4-9a1e-f50cc878b9e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:50.521066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cb2eb-0077-46b4-9a1e-f50cc878b9e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:50.522514 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cb2eb-0077-46b4-9a1e-f50cc878b9e0 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:50.524332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 21/44] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:33:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:33:50.530695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cb2eb-0077-46b4-9a1e-f50cc878b9e0 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:50.535250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 24/45] 10.222.0.50 () {60 vars in 1131 bytes} [Thu Sep 1 13:33:50 2022] POST /identity/v3/roles => generated 223 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:33:50.629819 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:33:50.651302 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cb2eb-0077-46b4-9a1e-f50cc878b9e0 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:50.692112 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9fb18-153f-4fd0-af53-97a3b4628796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:50.692734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9fb18-153f-4fd0-af53-97a3b4628796 None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:50.693019 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9fb18-153f-4fd0-af53-97a3b4628796 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:50.693301 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9fb18-153f-4fd0-af53-97a3b4628796 None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:50.693970 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9fb18-153f-4fd0-af53-97a3b4628796 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:50.695445 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9fb18-153f-4fd0-af53-97a3b4628796 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:50.788582 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 22/46] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Sep 1 13:33:50 2022] POST /identity/v3/projects => generated 312 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:33:52.233284 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d330d0-2b24-4411-8da7-507b3fccfc8c None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:52.233771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d330d0-2b24-4411-8da7-507b3fccfc8c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:52.233771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d330d0-2b24-4411-8da7-507b3fccfc8c None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:52.235145 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 25/47] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:33:52.240538 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5228b-9f6d-4f6f-9624-8700af247bcf None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:52.240972 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5228b-9f6d-4f6f-9624-8700af247bcf None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:52.241104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5228b-9f6d-4f6f-9624-8700af247bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:52.260228 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-add5228b-9f6d-4f6f-9624-8700af247bcf None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:33:52.261753 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-add5228b-9f6d-4f6f-9624-8700af247bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:33:52.336778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 23/48] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:33:52.608224 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d330d0-2b24-4411-8da7-507b3fccfc8c None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:52.699070 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:33:52.711626 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d330d0-2b24-4411-8da7-507b3fccfc8c None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:52.736933 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429b4ef-e71d-482e-b659-9436e7ce565a None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:52.737293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429b4ef-e71d-482e-b659-9436e7ce565a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:52.737650 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429b4ef-e71d-482e-b659-9436e7ce565a None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:52.739099 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 24/49] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:33:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:33:52.744406 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad8671-32de-4c94-a567-ac611cbfcf76 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:52.744698 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad8671-32de-4c94-a567-ac611cbfcf76 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:52.745018 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad8671-32de-4c94-a567-ac611cbfcf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:52.750315 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767c09f-03b9-48a1-b8e9-dd4f166ae20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:52.750954 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767c09f-03b9-48a1-b8e9-dd4f166ae20a None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:52.751241 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767c09f-03b9-48a1-b8e9-dd4f166ae20a None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:52.751566 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767c09f-03b9-48a1-b8e9-dd4f166ae20a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:52.762740 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767c09f-03b9-48a1-b8e9-dd4f166ae20a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:33:52.767941 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-d767c09f-03b9-48a1-b8e9-dd4f166ae20a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:33:52.767941 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:33:52.767941 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:33:52.767941 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:33:52.767941 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:33:52.767941 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:33:52.767941 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:33:52.767941 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:33:52.767941 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:33:52.767941 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:33:52.767941 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:33:52.767941 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:33:52.767941 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:33:52.767941 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:33:52.767941 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:33:52.767941 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:33:52.768823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:33:52.768823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:33:52.768823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:33:52.768823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:33:52.768823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:33:52.768823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:33:52.768823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:33:52.768823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:33:52.768823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:33:52.768823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:33:52.768823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:33:52.768823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:33:52.768823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:33:52.768823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:33:52.768823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:33:52.768823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:33:52.769555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:33:52.769555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:33:52.769555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:33:52.769555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:33:52.769555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:33:52.769555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:33:52.769555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:33:52.769555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:33:52.769555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:33:52.769555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:33:52.769555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:33:52.769555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:33:52.769555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 26/50] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:33:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:33:52.775314 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767c09f-03b9-48a1-b8e9-dd4f166ae20a None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:52.869096 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-d7ad8671-32de-4c94-a567-ac611cbfcf76 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:33:52.870215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-d7ad8671-32de-4c94-a567-ac611cbfcf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:33:52.886713 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767c09f-03b9-48a1-b8e9-dd4f166ae20a None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:52.922268 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f49ca-4e3b-4b78-bd01-c3f88064ffbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:52.922888 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f49ca-4e3b-4b78-bd01-c3f88064ffbe None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:52.923173 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f49ca-4e3b-4b78-bd01-c3f88064ffbe None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:52.923479 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f49ca-4e3b-4b78-bd01-c3f88064ffbe None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:52.924160 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f49ca-4e3b-4b78-bd01-c3f88064ffbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:33:52.924473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f49ca-4e3b-4b78-bd01-c3f88064ffbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:52.925898 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f49ca-4e3b-4b78-bd01-c3f88064ffbe None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:52.929992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:33:52.934472 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 27/51] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:33:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:33:52.938322 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 25/52] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:33:52.940302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f49ca-4e3b-4b78-bd01-c3f88064ffbe None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:52.953533 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:33:53.042621 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f49ca-4e3b-4b78-bd01-c3f88064ffbe None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:53.076565 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c590f6f-8495-4ea8-8ea7-8482a8561283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:53.077205 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c590f6f-8495-4ea8-8ea7-8482a8561283 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:53.077497 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c590f6f-8495-4ea8-8ea7-8482a8561283 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:53.077775 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c590f6f-8495-4ea8-8ea7-8482a8561283 None admin] PATH_INFO: `/v3/users/f72e2116699d4d6889af55d666d2817d` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:53.078930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c590f6f-8495-4ea8-8ea7-8482a8561283 None admin] RBAC: Authorizing `identity:get_user(user_id=f72e2116699d4d6889af55d666d2817d)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:53.080438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c590f6f-8495-4ea8-8ea7-8482a8561283 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:53.082062 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 28/53] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:33:52 2022] GET /identity/v3/users/f72e2116699d4d6889af55d666d2817d => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:33:53.087742 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad8671-32de-4c94-a567-ac611cbfcf76 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:53.188414 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad8671-32de-4c94-a567-ac611cbfcf76 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:53.207149 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c590f6f-8495-4ea8-8ea7-8482a8561283 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:53.226493 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23399f59-a9a2-44e8-b7dc-d0c3c1fe4b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:53.227133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23399f59-a9a2-44e8-b7dc-d0c3c1fe4b62 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:53.227453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23399f59-a9a2-44e8-b7dc-d0c3c1fe4b62 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:53.227737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23399f59-a9a2-44e8-b7dc-d0c3c1fe4b62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:53.228901 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23399f59-a9a2-44e8-b7dc-d0c3c1fe4b62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:53.230355 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23399f59-a9a2-44e8-b7dc-d0c3c1fe4b62 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:53.232934 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 26/54] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:33:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:33:53.238663 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23399f59-a9a2-44e8-b7dc-d0c3c1fe4b62 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:53.290581 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:33:53.305245 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:33:53.312482 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c590f6f-8495-4ea8-8ea7-8482a8561283 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:53.345349 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23399f59-a9a2-44e8-b7dc-d0c3c1fe4b62 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:53.351349 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b71131-a892-4594-b246-5012dc660d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:53.352031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b71131-a892-4594-b246-5012dc660d1b None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:53.352316 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b71131-a892-4594-b246-5012dc660d1b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:53.352595 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b71131-a892-4594-b246-5012dc660d1b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:53.353713 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b71131-a892-4594-b246-5012dc660d1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:53.355171 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b71131-a892-4594-b246-5012dc660d1b None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:53.356871 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 29/55] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:33:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:33:53.362651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b71131-a892-4594-b246-5012dc660d1b None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:53.379915 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad1eeb-5d03-4419-aa09-56d65b9baf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:53.380536 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad1eeb-5d03-4419-aa09-56d65b9baf0d None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:53.380817 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad1eeb-5d03-4419-aa09-56d65b9baf0d None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:53.381093 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad1eeb-5d03-4419-aa09-56d65b9baf0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:53.381824 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad1eeb-5d03-4419-aa09-56d65b9baf0d None admin] RBAC: Adding query filter params (role.id=98ffd3c114804da292d7cb33721e9085, scope.domain.id=default, user.id=f72e2116699d4d6889af55d666d2817d) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:33:53.382137 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad1eeb-5d03-4419-aa09-56d65b9baf0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:53.383595 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad1eeb-5d03-4419-aa09-56d65b9baf0d None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:53.395167 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 27/56] 10.222.0.50 () {56 vars in 1322 bytes} [Thu Sep 1 13:33:53 2022] GET /identity/v3/role_assignments?user.id=f72e2116699d4d6889af55d666d2817d&scope.domain.id=default&role.id=98ffd3c114804da292d7cb33721e9085 => generated 530 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:33:53.471505 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b71131-a892-4594-b246-5012dc660d1b None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:53.507575 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cea32a-1559-420c-96e9-7ceeab6cd7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:53.508210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cea32a-1559-420c-96e9-7ceeab6cd7ed None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:53.508493 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cea32a-1559-420c-96e9-7ceeab6cd7ed None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:53.508774 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cea32a-1559-420c-96e9-7ceeab6cd7ed None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:53.509447 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cea32a-1559-420c-96e9-7ceeab6cd7ed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:53.510931 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cea32a-1559-420c-96e9-7ceeab6cd7ed None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:53.598270 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:33:53.605109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 30/57] 10.222.0.50 () {60 vars in 1140 bytes} [Thu Sep 1 13:33:53 2022] POST /identity/v3/projects => generated 298 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:33:55.530135 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7cb5c-2248-45ea-aa35-cda3422e55eb None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:55.530688 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7cb5c-2248-45ea-aa35-cda3422e55eb None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:55.530688 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7cb5c-2248-45ea-aa35-cda3422e55eb None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:55.532054 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 28/58] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:33:55.537171 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa9a27-0c4d-4961-be87-4e3c01b84ed7 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:55.537593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa9a27-0c4d-4961-be87-4e3c01b84ed7 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:55.537727 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa9a27-0c4d-4961-be87-4e3c01b84ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:55.556220 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-67aa9a27-0c4d-4961-be87-4e3c01b84ed7 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:33:55.557418 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-67aa9a27-0c4d-4961-be87-4e3c01b84ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:33:55.623926 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 31/59] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:33:55.891492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7cb5c-2248-45ea-aa35-cda3422e55eb None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:55.991969 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7cb5c-2248-45ea-aa35-cda3422e55eb None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:56.018723 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:33:56.027012 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c0944-dc45-41f2-9d42-3c4e65afd928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:56.027681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c0944-dc45-41f2-9d42-3c4e65afd928 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:56.027965 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c0944-dc45-41f2-9d42-3c4e65afd928 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:56.028243 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c0944-dc45-41f2-9d42-3c4e65afd928 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:56.029399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c0944-dc45-41f2-9d42-3c4e65afd928 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:56.030863 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c0944-dc45-41f2-9d42-3c4e65afd928 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:56.032485 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 29/60] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:33:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:33:56.038093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa9a27-0c4d-4961-be87-4e3c01b84ed7 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:56.136440 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa9a27-0c4d-4961-be87-4e3c01b84ed7 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:56.162951 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:33:56.170598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9955a2-403d-4de0-baa6-899d46f71bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:33:56.171220 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9955a2-403d-4de0-baa6-899d46f71bd4 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:56.171537 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9955a2-403d-4de0-baa6-899d46f71bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:56.171809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9955a2-403d-4de0-baa6-899d46f71bd4 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:56.172472 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9955a2-403d-4de0-baa6-899d46f71bd4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:33:56.173970 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9955a2-403d-4de0-baa6-899d46f71bd4 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:33:56.344886 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 32/61] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 1 13:33:56 2022] POST /identity/v3/users => generated 275 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:33:59.285795 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497e0d7-44eb-4190-850e-e91b521d178c None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:59.286790 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497e0d7-44eb-4190-850e-e91b521d178c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:59.287299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497e0d7-44eb-4190-850e-e91b521d178c None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:59.289005 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 30/62] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:33:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:33:59.295092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45029598-00d8-48e5-8d36-f06a37a49d6a None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:59.295546 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45029598-00d8-48e5-8d36-f06a37a49d6a None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:59.295680 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45029598-00d8-48e5-8d36-f06a37a49d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:59.320023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-45029598-00d8-48e5-8d36-f06a37a49d6a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:33:59.321626 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-45029598-00d8-48e5-8d36-f06a37a49d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:33:59.364433 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e2012-131e-4b21-b1d7-90958294404d None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:59.365039 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e2012-131e-4b21-b1d7-90958294404d None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:59.365510 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e2012-131e-4b21-b1d7-90958294404d None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:59.367042 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 31/63] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:33:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:33:59.373012 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa81fd6-ff3b-49c0-ad72-bbb950042246 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:59.373548 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa81fd6-ff3b-49c0-ad72-bbb950042246 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:59.374036 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa81fd6-ff3b-49c0-ad72-bbb950042246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:59.408538 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-6aa81fd6-ff3b-49c0-ad72-bbb950042246 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:33:59.410126 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-6aa81fd6-ff3b-49c0-ad72-bbb950042246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:33:59.413649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 33/64] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:33:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:33:59.516688 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 32/65] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:33:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:33:59.653100 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5055b-a680-4030-9f7b-34c4fd731537 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:59.653100 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5055b-a680-4030-9f7b-34c4fd731537 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:59.653100 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5055b-a680-4030-9f7b-34c4fd731537 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:59.655312 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 34/66] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:33:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:33:59.660726 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ba224-4ac0-4b4b-9a27-6b97e89b3f9e None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:33:59.661019 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ba224-4ac0-4b4b-9a27-6b97e89b3f9e None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:33:59.661299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ba224-4ac0-4b4b-9a27-6b97e89b3f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:33:59.685785 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-2f0ba224-4ac0-4b4b-9a27-6b97e89b3f9e None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:33:59.687162 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-2f0ba224-4ac0-4b4b-9a27-6b97e89b3f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:33:59.780785 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 33/67] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:33:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:33:59.793127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5055b-a680-4030-9f7b-34c4fd731537 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:59.896297 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ba224-4ac0-4b4b-9a27-6b97e89b3f9e None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:33:59.965094 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5055b-a680-4030-9f7b-34c4fd731537 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:33:59.988920 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:33:59.995720 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:00.040653 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ba224-4ac0-4b4b-9a27-6b97e89b3f9e None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:00.048148 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e6abc-264c-4537-b14e-8503974cbd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:00.049085 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e6abc-264c-4537-b14e-8503974cbd42 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:00.049526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e6abc-264c-4537-b14e-8503974cbd42 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:00.049956 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e6abc-264c-4537-b14e-8503974cbd42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:00.074850 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e6abc-264c-4537-b14e-8503974cbd42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:00.084276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-102e6abc-264c-4537-b14e-8503974cbd42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:34:00.084276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:00.084276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:00.084276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:00.084276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:00.084276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:00.084276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:00.084276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:00.084276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:00.084276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:00.084276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:00.084276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:00.084276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:00.084276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:00.084276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:00.084276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:00.085162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:00.085162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:00.085162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:00.085162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:00.085162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:00.085162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:00.085162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:00.085162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:00.085162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:00.085162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:00.085162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:00.085162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:00.085162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:00.085162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:00.085162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:00.085162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:00.086336 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:00.086336 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:00.086336 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:00.086336 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:00.086336 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:00.086336 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:00.086336 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:00.086336 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:00.086336 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:00.086336 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:00.086336 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:34:00.086336 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:00.086336 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 35/68] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:33:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:00.086980 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a040f-4444-4d0b-ad78-3258d0c5a352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:00.086980 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a040f-4444-4d0b-ad78-3258d0c5a352 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:00.087115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5cf15-cf9e-4dab-be03-29ca1608cc63 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:00.087186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a040f-4444-4d0b-ad78-3258d0c5a352 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:00.087255 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5cf15-cf9e-4dab-be03-29ca1608cc63 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:00.087318 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a040f-4444-4d0b-ad78-3258d0c5a352 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:00.091580 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5cf15-cf9e-4dab-be03-29ca1608cc63 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:00.093100 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 36/69] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:00.098392 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5cf15-cf9e-4dab-be03-29ca1608cc63 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:00.108145 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a040f-4444-4d0b-ad78-3258d0c5a352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:00.117608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-3d8a040f-4444-4d0b-ad78-3258d0c5a352 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:00.117608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:00.117608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:00.117608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:00.117608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:00.117608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:00.117608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:00.117608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:00.117608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:00.117608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:00.117608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:00.117608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:00.117608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:00.117608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:00.117608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:00.117608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:00.118558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:00.118558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:00.118558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:00.118558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:00.118558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:00.118558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:00.118558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:00.118558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:00.118558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:00.118558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:00.118558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:00.118558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:00.118558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:00.118558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:00.118558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:00.118558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:00.119923 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:00.119923 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:00.119923 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:00.119923 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:00.119923 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:00.119923 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:00.119923 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:00.119923 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:00.119923 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:00.119923 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:00.119923 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:00.119923 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:00.119923 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 34/70] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:33:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:00.120732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e1331-6dcb-4e7c-a950-84a1092c4b63 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:00.121881 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e1331-6dcb-4e7c-a950-84a1092c4b63 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:00.121881 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e1331-6dcb-4e7c-a950-84a1092c4b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:00.144995 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-911e1331-6dcb-4e7c-a950-84a1092c4b63 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:00.146590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-911e1331-6dcb-4e7c-a950-84a1092c4b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:00.216700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5cf15-cf9e-4dab-be03-29ca1608cc63 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:00.227388 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 35/71] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:00.227388 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e1331-6dcb-4e7c-a950-84a1092c4b63 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:00.257002 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b0708-c4e0-43e1-bc78-976c3cadf087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:00.257617 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b0708-c4e0-43e1-bc78-976c3cadf087 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:00.257918 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b0708-c4e0-43e1-bc78-976c3cadf087 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:00.258173 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b0708-c4e0-43e1-bc78-976c3cadf087 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:00.258869 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b0708-c4e0-43e1-bc78-976c3cadf087 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:00.259180 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b0708-c4e0-43e1-bc78-976c3cadf087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:00.260778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b0708-c4e0-43e1-bc78-976c3cadf087 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:00.270455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 37/72] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:00.275069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:00.276760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b0708-c4e0-43e1-bc78-976c3cadf087 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:00.315649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:00.328826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e1331-6dcb-4e7c-a950-84a1092c4b63 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:00.363681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce839a04-e6c0-4f11-b1dc-a9d055abe2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:00.364285 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce839a04-e6c0-4f11-b1dc-a9d055abe2f8 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:00.364565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce839a04-e6c0-4f11-b1dc-a9d055abe2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:00.364838 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce839a04-e6c0-4f11-b1dc-a9d055abe2f8 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:00.365498 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce839a04-e6c0-4f11-b1dc-a9d055abe2f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:00.365805 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce839a04-e6c0-4f11-b1dc-a9d055abe2f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:00.367247 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce839a04-e6c0-4f11-b1dc-a9d055abe2f8 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:00.379143 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 36/73] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 1 13:34:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:00.380211 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143fc90-ce2d-4dc6-802e-cf113bd8feda None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:00.380500 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143fc90-ce2d-4dc6-802e-cf113bd8feda None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:00.380776 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143fc90-ce2d-4dc6-802e-cf113bd8feda None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:00.382094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 37/74] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:00.386577 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143fc90-ce2d-4dc6-802e-cf113bd8feda None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:00.391275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b0708-c4e0-43e1-bc78-976c3cadf087 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:00.429881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9b379-dd76-4dbd-88c8-a55eb7ad2004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:00.430517 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9b379-dd76-4dbd-88c8-a55eb7ad2004 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:00.430799 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9b379-dd76-4dbd-88c8-a55eb7ad2004 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:00.431074 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9b379-dd76-4dbd-88c8-a55eb7ad2004 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:00.442586 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9b379-dd76-4dbd-88c8-a55eb7ad2004 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:00.447863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-14f9b379-dd76-4dbd-88c8-a55eb7ad2004 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:34:00.447863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:00.447863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:00.447863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:00.447863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:00.447863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:00.447863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:00.447863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:00.447863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:00.447863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:00.447863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:00.447863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:00.447863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:00.447863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:00.447863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:00.447863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:00.448721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:00.448721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:00.448721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:00.448721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:00.448721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:00.448721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:00.448721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:00.448721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:00.448721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:00.448721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:00.448721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:00.448721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:00.448721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:00.448721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:00.448721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:00.448721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:00.449468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:00.449468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:00.449468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:00.449468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:00.449468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:00.449468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:00.449468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:00.449468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:00.449468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:00.449468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:00.449468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:34:00.449468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:00.449468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 38/75] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 1 13:34:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:00.452185 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9b379-dd76-4dbd-88c8-a55eb7ad2004 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:00.499203 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143fc90-ce2d-4dc6-802e-cf113bd8feda None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:00.506612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:00.533080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47393c1a-d723-4b83-a50c-d29cd22a1268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:00.533909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47393c1a-d723-4b83-a50c-d29cd22a1268 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:00.534224 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47393c1a-d723-4b83-a50c-d29cd22a1268 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:00.534500 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47393c1a-d723-4b83-a50c-d29cd22a1268 None admin] PATH_INFO: `/v3/users/f72e2116699d4d6889af55d666d2817d` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:00.535653 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47393c1a-d723-4b83-a50c-d29cd22a1268 None admin] RBAC: Authorizing `identity:get_user(user_id=f72e2116699d4d6889af55d666d2817d)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:00.537093 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47393c1a-d723-4b83-a50c-d29cd22a1268 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:00.538657 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 38/76] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:00 2022] GET /identity/v3/users/f72e2116699d4d6889af55d666d2817d => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:00.539801 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c3870-d8ea-40e3-8797-150ecfe0b988 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:00.540078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c3870-d8ea-40e3-8797-150ecfe0b988 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:00.540349 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c3870-d8ea-40e3-8797-150ecfe0b988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:00.554012 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:00.558881 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-f05c3870-d8ea-40e3-8797-150ecfe0b988 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:00.560184 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9b379-dd76-4dbd-88c8-a55eb7ad2004 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:00.560604 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-f05c3870-d8ea-40e3-8797-150ecfe0b988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:00.595844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bfb07-a5b2-4de8-aa33-fa38d67ff410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:00.596479 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bfb07-a5b2-4de8-aa33-fa38d67ff410 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:00.596762 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bfb07-a5b2-4de8-aa33-fa38d67ff410 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:00.597040 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bfb07-a5b2-4de8-aa33-fa38d67ff410 None admin] PATH_INFO: `/v3/users/0d6402310bab4e4d9246f710d3c2eba1` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:00.611123 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bfb07-a5b2-4de8-aa33-fa38d67ff410 None admin] RBAC: Authorizing `identity:get_user(user_id=0d6402310bab4e4d9246f710d3c2eba1)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:00.612647 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bfb07-a5b2-4de8-aa33-fa38d67ff410 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:00.619122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 39/77] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:00 2022] GET /identity/v3/users/0d6402310bab4e4d9246f710d3c2eba1 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:00.619122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bfb07-a5b2-4de8-aa33-fa38d67ff410 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:00.628744 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 39/78] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:00.629639 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c3870-d8ea-40e3-8797-150ecfe0b988 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:00.726541 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bfb07-a5b2-4de8-aa33-fa38d67ff410 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:00.728318 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c3870-d8ea-40e3-8797-150ecfe0b988 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:00.730804 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:00.763673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323cd1f-dca0-41fb-baed-cc23c94268ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:00.764487 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323cd1f-dca0-41fb-baed-cc23c94268ad None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:00.764911 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323cd1f-dca0-41fb-baed-cc23c94268ad None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:00.765119 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05329a03-ae0b-45ba-8532-98033de62a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:00.765617 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323cd1f-dca0-41fb-baed-cc23c94268ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:00.765734 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05329a03-ae0b-45ba-8532-98033de62a2b None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:00.766005 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05329a03-ae0b-45ba-8532-98033de62a2b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:00.766284 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05329a03-ae0b-45ba-8532-98033de62a2b None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:00.767004 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05329a03-ae0b-45ba-8532-98033de62a2b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:00.767317 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05329a03-ae0b-45ba-8532-98033de62a2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:00.769210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05329a03-ae0b-45ba-8532-98033de62a2b None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:00.778427 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 40/79] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:34:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:00.783263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05329a03-ae0b-45ba-8532-98033de62a2b None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:00.784061 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323cd1f-dca0-41fb-baed-cc23c94268ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:00.789025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-b323cd1f-dca0-41fb-baed-cc23c94268ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:00.789025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:00.789025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:00.789025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:00.789025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:00.789025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:00.789025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:00.789025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:00.789025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:00.789025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:00.789025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:00.789025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:00.789025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:00.789025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:00.789025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:00.789025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:00.789868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:00.789868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:00.789868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:00.789868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:00.789868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:00.789868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:00.789868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:00.789868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:00.789868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:00.789868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:00.789868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:00.789868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:00.789868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:00.789868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:00.789868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:00.789868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:00.790610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:00.790610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:00.790610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:00.790610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:00.790610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:00.790610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:00.790610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:00.790610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:00.790610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:00.790610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:00.790610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:00.790610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:00.790610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 40/80] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:00.791815 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323cd1f-dca0-41fb-baed-cc23c94268ad None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:00.809053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:00.898772 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323cd1f-dca0-41fb-baed-cc23c94268ad None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:00.906641 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05329a03-ae0b-45ba-8532-98033de62a2b None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:00.933462 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec137871-3044-4f1e-9b8f-f5cc5c028b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:00.934066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec137871-3044-4f1e-9b8f-f5cc5c028b26 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:00.934350 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec137871-3044-4f1e-9b8f-f5cc5c028b26 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:00.935182 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec137871-3044-4f1e-9b8f-f5cc5c028b26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:00.941263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59bf888-5b6a-4b9b-870e-8ea635f82ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:00.941883 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bf888-5b6a-4b9b-870e-8ea635f82ba0 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:00.942169 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bf888-5b6a-4b9b-870e-8ea635f82ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:00.942448 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bf888-5b6a-4b9b-870e-8ea635f82ba0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:00.965906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:01.004374 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec137871-3044-4f1e-9b8f-f5cc5c028b26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:01.005849 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec137871-3044-4f1e-9b8f-f5cc5c028b26 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:01.008896 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59bf888-5b6a-4b9b-870e-8ea635f82ba0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:01.010415 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59bf888-5b6a-4b9b-870e-8ea635f82ba0 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:01.026936 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:01.103028 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 41/81] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:01.103924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec137871-3044-4f1e-9b8f-f5cc5c028b26 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:01.109294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 41/82] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:01.110135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59bf888-5b6a-4b9b-870e-8ea635f82ba0 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:01.165417 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:01.203689 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec137871-3044-4f1e-9b8f-f5cc5c028b26 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:01.207813 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59bf888-5b6a-4b9b-870e-8ea635f82ba0 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:01.224266 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:01.238600 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f355d-4c38-416d-937e-7e09bd209398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:01.239233 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f355d-4c38-416d-937e-7e09bd209398 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:01.239550 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f355d-4c38-416d-937e-7e09bd209398 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:01.239829 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f355d-4c38-416d-937e-7e09bd209398 None admin] PATH_INFO: `/v3/users/0d6402310bab4e4d9246f710d3c2eba1` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:01.240940 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f355d-4c38-416d-937e-7e09bd209398 None admin] RBAC: Authorizing `identity:get_user(user_id=0d6402310bab4e4d9246f710d3c2eba1)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:01.241992 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f49c12-8431-47ac-a85d-db0cab715d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:01.242429 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f355d-4c38-416d-937e-7e09bd209398 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:01.242605 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f49c12-8431-47ac-a85d-db0cab715d8f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:01.242888 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f49c12-8431-47ac-a85d-db0cab715d8f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:01.243164 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f49c12-8431-47ac-a85d-db0cab715d8f None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:01.243854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f49c12-8431-47ac-a85d-db0cab715d8f None admin] RBAC: Adding query filter params (name=member) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:01.244086 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 42/83] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:01 2022] GET /identity/v3/users/0d6402310bab4e4d9246f710d3c2eba1 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:01.244199 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f49c12-8431-47ac-a85d-db0cab715d8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:01.244855 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f355d-4c38-416d-937e-7e09bd209398 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:01.245530 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f49c12-8431-47ac-a85d-db0cab715d8f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:01.259407 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 42/84] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 1 13:34:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:01.260779 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f49c12-8431-47ac-a85d-db0cab715d8f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:01.353389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f355d-4c38-416d-937e-7e09bd209398 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:01.366704 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f49c12-8431-47ac-a85d-db0cab715d8f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:01.383906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:01.390094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7ebd6-927f-4df5-b1b6-575b4afc399c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:01.398244 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7ebd6-927f-4df5-b1b6-575b4afc399c None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:01.398244 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7ebd6-927f-4df5-b1b6-575b4afc399c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:01.398244 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7ebd6-927f-4df5-b1b6-575b4afc399c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:01.398244 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7ebd6-927f-4df5-b1b6-575b4afc399c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:01.398244 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7ebd6-927f-4df5-b1b6-575b4afc399c None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:01.398244 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 43/85] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:34:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:01.398658 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7ebd6-927f-4df5-b1b6-575b4afc399c None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:01.404770 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040c8ac-ce8c-4b71-bf42-13ef6fa7b7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:01.405450 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040c8ac-ce8c-4b71-bf42-13ef6fa7b7b3 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:01.405767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040c8ac-ce8c-4b71-bf42-13ef6fa7b7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:01.406008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040c8ac-ce8c-4b71-bf42-13ef6fa7b7b3 None admin] PATH_INFO: `/v3/projects/4ab598b3074241ac9c1da0a539adebc9` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:01.407125 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040c8ac-ce8c-4b71-bf42-13ef6fa7b7b3 None admin] RBAC: Authorizing `identity:get_project(project_id=4ab598b3074241ac9c1da0a539adebc9)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:01.408625 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040c8ac-ce8c-4b71-bf42-13ef6fa7b7b3 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:01.410274 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 43/86] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:01 2022] GET /identity/v3/projects/4ab598b3074241ac9c1da0a539adebc9 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:01.411037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040c8ac-ce8c-4b71-bf42-13ef6fa7b7b3 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:01.458059 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:01.503906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7ebd6-927f-4df5-b1b6-575b4afc399c None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:01.510922 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040c8ac-ce8c-4b71-bf42-13ef6fa7b7b3 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:01.536944 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd4483-f537-4e69-9371-bce23ef12792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:01.537571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd4483-f537-4e69-9371-bce23ef12792 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:01.537855 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd4483-f537-4e69-9371-bce23ef12792 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:01.538125 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd4483-f537-4e69-9371-bce23ef12792 None admin] PATH_INFO: `/v3/projects/4ab598b3074241ac9c1da0a539adebc9` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:01.539218 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd4483-f537-4e69-9371-bce23ef12792 None admin] RBAC: Authorizing `identity:get_project(project_id=4ab598b3074241ac9c1da0a539adebc9)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:01.540706 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd4483-f537-4e69-9371-bce23ef12792 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:01.542323 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 44/87] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:01 2022] GET /identity/v3/projects/4ab598b3074241ac9c1da0a539adebc9 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:01.547129 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd4483-f537-4e69-9371-bce23ef12792 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:01.549452 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6c4a1-6c8c-426f-82c9-0c5d52741a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:01.550063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6c4a1-6c8c-426f-82c9-0c5d52741a1b None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:01.550345 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6c4a1-6c8c-426f-82c9-0c5d52741a1b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:01.550617 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6c4a1-6c8c-426f-82c9-0c5d52741a1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:01.612309 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:01.617197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6c4a1-6c8c-426f-82c9-0c5d52741a1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:01.618727 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6c4a1-6c8c-426f-82c9-0c5d52741a1b None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:01.645774 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd4483-f537-4e69-9371-bce23ef12792 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:01.663416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:01.678787 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f9703-4314-4669-b9f3-58516aeff374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:01.679847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f9703-4314-4669-b9f3-58516aeff374 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:01.694061 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f9703-4314-4669-b9f3-58516aeff374 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:01.694061 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f9703-4314-4669-b9f3-58516aeff374 None admin] PATH_INFO: `/v3/users/0d6402310bab4e4d9246f710d3c2eba1` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:01.694061 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f9703-4314-4669-b9f3-58516aeff374 None admin] RBAC: Authorizing `identity:get_user(user_id=0d6402310bab4e4d9246f710d3c2eba1)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:01.694061 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f9703-4314-4669-b9f3-58516aeff374 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:01.694061 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 45/88] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:01 2022] GET /identity/v3/users/0d6402310bab4e4d9246f710d3c2eba1 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:01.694061 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f9703-4314-4669-b9f3-58516aeff374 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:01.721560 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 44/89] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:01.722386 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6c4a1-6c8c-426f-82c9-0c5d52741a1b None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:01.785995 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f9703-4314-4669-b9f3-58516aeff374 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:01.819175 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fd34b-d765-4e7b-ba74-ab7e1f49c94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:01.819384 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6c4a1-6c8c-426f-82c9-0c5d52741a1b None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:01.819951 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fd34b-d765-4e7b-ba74-ab7e1f49c94c None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:01.820304 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fd34b-d765-4e7b-ba74-ab7e1f49c94c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:01.820674 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fd34b-d765-4e7b-ba74-ab7e1f49c94c None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:01.821398 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046fd34b-d765-4e7b-ba74-ab7e1f49c94c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:01.822919 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046fd34b-d765-4e7b-ba74-ab7e1f49c94c None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:01.836022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:01.858896 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a2a3c-8560-497b-9141-f0623ec54644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:01.859567 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a2a3c-8560-497b-9141-f0623ec54644 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:01.859856 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a2a3c-8560-497b-9141-f0623ec54644 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:01.860134 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a2a3c-8560-497b-9141-f0623ec54644 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:01.860869 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a2a3c-8560-497b-9141-f0623ec54644 None admin] RBAC: Adding query filter params (role.id=3654765b6c2644779fda2924f119aef7, scope.project.id=4ab598b3074241ac9c1da0a539adebc9, user.id=0d6402310bab4e4d9246f710d3c2eba1) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:01.861183 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a2a3c-8560-497b-9141-f0623ec54644 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:01.862776 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a2a3c-8560-497b-9141-f0623ec54644 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:01.868098 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 45/90] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:34:01 2022] GET /identity/v3/role_assignments?user.id=0d6402310bab4e4d9246f710d3c2eba1&scope.project.id=4ab598b3074241ac9c1da0a539adebc9&role.id=3654765b6c2644779fda2924f119aef7 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:01.868881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a2a3c-8560-497b-9141-f0623ec54644 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:01.886969 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:01.941600 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 46/91] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 1 13:34:01 2022] POST /identity/v3/users => generated 289 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:34:01.942300 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fd34b-d765-4e7b-ba74-ab7e1f49c94c None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:02.027175 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a2a3c-8560-497b-9141-f0623ec54644 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:02.066460 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85493257-7606-45a2-bede-3b68cc94f408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:02.067508 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85493257-7606-45a2-bede-3b68cc94f408 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:02.068004 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85493257-7606-45a2-bede-3b68cc94f408 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:02.068513 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85493257-7606-45a2-bede-3b68cc94f408 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:02.069497 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85493257-7606-45a2-bede-3b68cc94f408 None admin] RBAC: Adding query filter params (role.id=98ffd3c114804da292d7cb33721e9085, scope.project.id=4ab598b3074241ac9c1da0a539adebc9, user.id=f72e2116699d4d6889af55d666d2817d) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:02.070032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85493257-7606-45a2-bede-3b68cc94f408 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:02.071862 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85493257-7606-45a2-bede-3b68cc94f408 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:02.077268 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fd34b-d765-4e7b-ba74-ab7e1f49c94c None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:02.078690 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 46/92] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:34:01 2022] GET /identity/v3/role_assignments?user.id=f72e2116699d4d6889af55d666d2817d&scope.project.id=4ab598b3074241ac9c1da0a539adebc9&role.id=98ffd3c114804da292d7cb33721e9085 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:02.079877 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85493257-7606-45a2-bede-3b68cc94f408 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:02.134473 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd0709-ca63-44ff-a651-42340961f302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:02.135140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd0709-ca63-44ff-a651-42340961f302 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:02.135335 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd0709-ca63-44ff-a651-42340961f302 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:02.135608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd0709-ca63-44ff-a651-42340961f302 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:02.172280 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:02.208306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85493257-7606-45a2-bede-3b68cc94f408 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:02.259677 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30cd0b0-4bd8-4c49-a355-6855d26ff32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:02.260735 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cd0b0-4bd8-4c49-a355-6855d26ff32c None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:02.261330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cd0b0-4bd8-4c49-a355-6855d26ff32c None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:02.261813 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cd0b0-4bd8-4c49-a355-6855d26ff32c None admin] PATH_INFO: `/v3/projects/4ab598b3074241ac9c1da0a539adebc9` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:02.264250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30cd0b0-4bd8-4c49-a355-6855d26ff32c None admin] RBAC: Authorizing `identity:get_project(project_id=4ab598b3074241ac9c1da0a539adebc9)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:02.266619 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30cd0b0-4bd8-4c49-a355-6855d26ff32c None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:02.268813 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 47/93] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:02 2022] GET /identity/v3/projects/4ab598b3074241ac9c1da0a539adebc9 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:02.275238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30cd0b0-4bd8-4c49-a355-6855d26ff32c None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:02.279746 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:02.292462 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd0709-ca63-44ff-a651-42340961f302 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:02.294163 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd0709-ca63-44ff-a651-42340961f302 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:02.402051 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30cd0b0-4bd8-4c49-a355-6855d26ff32c None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:02.460466 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 47/94] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:02.463265 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a4881-9b0b-4880-bb8d-ba548f1535eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:02.463933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a4881-9b0b-4880-bb8d-ba548f1535eb None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:02.464213 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a4881-9b0b-4880-bb8d-ba548f1535eb None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:02.464489 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a4881-9b0b-4880-bb8d-ba548f1535eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:02.465286 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a4881-9b0b-4880-bb8d-ba548f1535eb None admin] RBAC: Adding query filter params (role.id=f0d2493c03664449802df928b8e8fa53, scope.project.id=4ab598b3074241ac9c1da0a539adebc9, user.id=0d6402310bab4e4d9246f710d3c2eba1) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:02.465579 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a4881-9b0b-4880-bb8d-ba548f1535eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:02.467678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a4881-9b0b-4880-bb8d-ba548f1535eb None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:02.467947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd0709-ca63-44ff-a651-42340961f302 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:02.475399 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 48/95] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:34:02 2022] GET /identity/v3/role_assignments?user.id=0d6402310bab4e4d9246f710d3c2eba1&scope.project.id=4ab598b3074241ac9c1da0a539adebc9&role.id=f0d2493c03664449802df928b8e8fa53 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:02.625202 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:02.641899 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd0709-ca63-44ff-a651-42340961f302 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:02.690109 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a09aa-0f9f-48ee-8170-f89438a3e77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:02.691048 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a09aa-0f9f-48ee-8170-f89438a3e77c None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:02.691545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a09aa-0f9f-48ee-8170-f89438a3e77c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:02.692025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a09aa-0f9f-48ee-8170-f89438a3e77c None admin] PATH_INFO: `/v3/projects/6cbea0e244dd4dcdbed94848ae3aff3c` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:02.693406 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a09aa-0f9f-48ee-8170-f89438a3e77c None admin] RBAC: Authorizing `identity:get_project(project_id=6cbea0e244dd4dcdbed94848ae3aff3c)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:02.695076 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a09aa-0f9f-48ee-8170-f89438a3e77c None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:02.696991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 48/96] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:02 2022] GET /identity/v3/projects/6cbea0e244dd4dcdbed94848ae3aff3c => generated 312 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:02.703773 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a4881-9b0b-4880-bb8d-ba548f1535eb None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:02.717440 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:02.836711 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a4881-9b0b-4880-bb8d-ba548f1535eb None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:02.873133 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b46e8-4f94-4d50-9759-34457fd676d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:02.873753 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b46e8-4f94-4d50-9759-34457fd676d7 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:02.874031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b46e8-4f94-4d50-9759-34457fd676d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:02.874303 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b46e8-4f94-4d50-9759-34457fd676d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:02.875041 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b46e8-4f94-4d50-9759-34457fd676d7 None admin] RBAC: Adding query filter params (role.id=3654765b6c2644779fda2924f119aef7, scope.project.id=6cbea0e244dd4dcdbed94848ae3aff3c, user.id=0d6402310bab4e4d9246f710d3c2eba1) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:02.875346 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b46e8-4f94-4d50-9759-34457fd676d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:02.876827 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b46e8-4f94-4d50-9759-34457fd676d7 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:02.882901 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 49/97] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:34:02 2022] GET /identity/v3/role_assignments?user.id=0d6402310bab4e4d9246f710d3c2eba1&scope.project.id=6cbea0e244dd4dcdbed94848ae3aff3c&role.id=3654765b6c2644779fda2924f119aef7 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:04.032862 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa50f1-9225-4ff2-b527-738dab8fabf4 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:04.033364 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa50f1-9225-4ff2-b527-738dab8fabf4 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:04.033435 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa50f1-9225-4ff2-b527-738dab8fabf4 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:04.034765 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 49/98] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:04.042232 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870bff6-5c8b-4945-8d8f-05c76eeacbf2 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:04.042646 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870bff6-5c8b-4945-8d8f-05c76eeacbf2 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:04.042819 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870bff6-5c8b-4945-8d8f-05c76eeacbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:04.075725 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-0870bff6-5c8b-4945-8d8f-05c76eeacbf2 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:04.077039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-0870bff6-5c8b-4945-8d8f-05c76eeacbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:04.156307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:04.165082 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 50/99] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:34:04.710127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa50f1-9225-4ff2-b527-738dab8fabf4 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:04.839293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa50f1-9225-4ff2-b527-738dab8fabf4 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:04.883073 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32a27d-94fa-4843-9e52-0ec23e4ca177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:04.883743 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32a27d-94fa-4843-9e52-0ec23e4ca177 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:04.884025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32a27d-94fa-4843-9e52-0ec23e4ca177 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:04.884299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32a27d-94fa-4843-9e52-0ec23e4ca177 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:04.900537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32a27d-94fa-4843-9e52-0ec23e4ca177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:04.905737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-ce32a27d-94fa-4843-9e52-0ec23e4ca177 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:04.905737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:04.905737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:04.905737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:04.905737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:04.905737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:04.905737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:04.905737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:04.905737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:04.905737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:04.905737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:04.905737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:04.905737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:04.905737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:04.905737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:04.905737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:04.906541 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:04.906541 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:04.906541 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:04.906541 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:04.906541 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:04.906541 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:04.906541 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:04.906541 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:04.906541 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:04.906541 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:04.906541 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:04.906541 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:04.906541 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:04.906541 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:04.906541 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:04.906541 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:04.907278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:04.907278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:04.907278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:04.907278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:04.907278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:04.907278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:04.907278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:04.907278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:04.907278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:04.907278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:04.907278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:04.907278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:04.907278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 50/100] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:04.912939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870bff6-5c8b-4945-8d8f-05c76eeacbf2 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:05.061173 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870bff6-5c8b-4945-8d8f-05c76eeacbf2 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:05.108713 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9afb37-b425-4dd4-9ce9-80e6f046b352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:05.109337 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9afb37-b425-4dd4-9ce9-80e6f046b352 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:05.109625 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9afb37-b425-4dd4-9ce9-80e6f046b352 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:05.109905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9afb37-b425-4dd4-9ce9-80e6f046b352 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:05.110624 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9afb37-b425-4dd4-9ce9-80e6f046b352 None admin] RBAC: Adding query filter params (name=member) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:05.110935 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9afb37-b425-4dd4-9ce9-80e6f046b352 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:05.112368 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9afb37-b425-4dd4-9ce9-80e6f046b352 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:05.127791 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 51/101] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 1 13:34:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:05.133480 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32a27d-94fa-4843-9e52-0ec23e4ca177 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:05.216434 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161d573-e2bf-4175-853b-3e476dcd1ed3 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:05.216721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161d573-e2bf-4175-853b-3e476dcd1ed3 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:05.217164 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161d573-e2bf-4175-853b-3e476dcd1ed3 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:05.217275 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:05.220151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 52/102] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:05.224764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb15df2-4bfd-4d50-9165-6d46d05e7529 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:05.231877 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb15df2-4bfd-4d50-9165-6d46d05e7529 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:05.231877 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb15df2-4bfd-4d50-9165-6d46d05e7529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:05.272464 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-4cb15df2-4bfd-4d50-9165-6d46d05e7529 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:05.273693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-4cb15df2-4bfd-4d50-9165-6d46d05e7529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:05.299024 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32a27d-94fa-4843-9e52-0ec23e4ca177 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:05.359661 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367bc55-661d-4ea2-bd1a-720652733a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:05.360620 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367bc55-661d-4ea2-bd1a-720652733a0c None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:05.362511 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367bc55-661d-4ea2-bd1a-720652733a0c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:05.362984 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367bc55-661d-4ea2-bd1a-720652733a0c None admin] PATH_INFO: `/v3/users/0d6402310bab4e4d9246f710d3c2eba1` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:05.365258 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367bc55-661d-4ea2-bd1a-720652733a0c None admin] RBAC: Authorizing `identity:get_user(user_id=0d6402310bab4e4d9246f710d3c2eba1)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:05.366948 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367bc55-661d-4ea2-bd1a-720652733a0c None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:05.369824 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 51/103] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:05 2022] GET /identity/v3/users/0d6402310bab4e4d9246f710d3c2eba1 => generated 275 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:05.372639 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2620cd-a481-4047-95c8-fec4c5d3c46d None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:05.373933 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2620cd-a481-4047-95c8-fec4c5d3c46d None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:05.377160 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2620cd-a481-4047-95c8-fec4c5d3c46d None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:05.378706 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 52/104] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:05.384853 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2620cd-a481-4047-95c8-fec4c5d3c46d None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:05.395740 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:05.416945 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 53/105] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:05.418281 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a87628-d7fa-4344-8105-62c3eb619cb6 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:05.419121 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a87628-d7fa-4344-8105-62c3eb619cb6 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:05.419421 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a87628-d7fa-4344-8105-62c3eb619cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:05.445738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-e6a87628-d7fa-4344-8105-62c3eb619cb6 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:05.446949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-e6a87628-d7fa-4344-8105-62c3eb619cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:05.524812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:05.555604 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2620cd-a481-4047-95c8-fec4c5d3c46d None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:05.584726 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 54/106] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:05.589712 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98fd1d-f36f-429c-96cc-edf37ee202b1 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:05.590004 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98fd1d-f36f-429c-96cc-edf37ee202b1 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:05.590283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98fd1d-f36f-429c-96cc-edf37ee202b1 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:05.592346 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 55/107] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:05.598509 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c7a69-4e87-4145-ad1f-e0f378be512e None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:05.598801 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c7a69-4e87-4145-ad1f-e0f378be512e None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:05.599083 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c7a69-4e87-4145-ad1f-e0f378be512e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:05.621082 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a67735-df77-42dc-9b8b-88a7ec6cf5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:05.621676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a67735-df77-42dc-9b8b-88a7ec6cf5f3 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:05.621965 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a67735-df77-42dc-9b8b-88a7ec6cf5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:05.622243 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a67735-df77-42dc-9b8b-88a7ec6cf5f3 None admin] PATH_INFO: `/v3/projects/4ab598b3074241ac9c1da0a539adebc9` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:05.624449 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a67735-df77-42dc-9b8b-88a7ec6cf5f3 None admin] RBAC: Authorizing `identity:get_project(project_id=4ab598b3074241ac9c1da0a539adebc9)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:05.625913 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a67735-df77-42dc-9b8b-88a7ec6cf5f3 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:05.627604 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 53/108] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:05 2022] GET /identity/v3/projects/4ab598b3074241ac9c1da0a539adebc9 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:05.632117 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-be5c7a69-4e87-4145-ad1f-e0f378be512e None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:05.633193 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a67735-df77-42dc-9b8b-88a7ec6cf5f3 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:05.634707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-be5c7a69-4e87-4145-ad1f-e0f378be512e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:05.706531 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 56/109] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:05.708023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e82a29-5e2b-4a19-a68d-ec3d6f81f7f3 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:05.708318 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e82a29-5e2b-4a19-a68d-ec3d6f81f7f3 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:05.708600 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e82a29-5e2b-4a19-a68d-ec3d6f81f7f3 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:05.710144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 57/110] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:05.720617 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4477a68-957d-4aa4-b2be-74d942903f8b None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:05.720906 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4477a68-957d-4aa4-b2be-74d942903f8b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:05.721190 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4477a68-957d-4aa4-b2be-74d942903f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:05.748401 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-e4477a68-957d-4aa4-b2be-74d942903f8b None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:05.749622 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-e4477a68-957d-4aa4-b2be-74d942903f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:05.828469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:05.856792 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 58/111] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:05.858078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4477a68-957d-4aa4-b2be-74d942903f8b None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:05.865656 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a67735-df77-42dc-9b8b-88a7ec6cf5f3 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:05.929268 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79e020-e6ca-4830-840e-bbb0060ae259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:05.930479 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79e020-e6ca-4830-840e-bbb0060ae259 None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:05.931545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79e020-e6ca-4830-840e-bbb0060ae259 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:05.932038 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79e020-e6ca-4830-840e-bbb0060ae259 None admin] PATH_INFO: `/v3/projects/4ab598b3074241ac9c1da0a539adebc9/users/0d6402310bab4e4d9246f710d3c2eba1/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:05.935548 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79e020-e6ca-4830-840e-bbb0060ae259 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ab598b3074241ac9c1da0a539adebc9, user_id=0d6402310bab4e4d9246f710d3c2eba1, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:05.937201 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79e020-e6ca-4830-840e-bbb0060ae259 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:05.966081 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4477a68-957d-4aa4-b2be-74d942903f8b None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:06.002197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b7791-5ca0-4273-b853-6028f8ce2679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:06.002835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b7791-5ca0-4273-b853-6028f8ce2679 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:06.003126 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b7791-5ca0-4273-b853-6028f8ce2679 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:06.003433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b7791-5ca0-4273-b853-6028f8ce2679 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:06.014484 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b7791-5ca0-4273-b853-6028f8ce2679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:06.019519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-721b7791-5ca0-4273-b853-6028f8ce2679 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:34:06.019519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:06.019519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:06.019519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:06.019519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:06.019519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:06.019519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:06.019519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:06.019519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:06.019519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:06.019519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:06.019519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:06.019519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:06.019519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:06.019519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:06.019519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:06.020353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:06.020353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:06.020353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:06.020353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:06.020353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:06.020353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:06.020353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:06.020353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:06.020353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:06.020353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:06.020353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:06.020353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:06.020353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:06.020353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:06.020353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:06.020353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:06.021092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:06.021092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:06.021092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:06.021092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:06.021092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:06.021092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:06.021092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:06.021092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:06.021092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:06.021092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:06.021092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:34:06.021092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:06.021092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 59/112] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 1 13:34:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:06.022247 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a3521-8a8d-41d0-8626-45912123b60c None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:06.022247 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a3521-8a8d-41d0-8626-45912123b60c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:06.022467 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a3521-8a8d-41d0-8626-45912123b60c None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:06.023701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 60/113] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:06.029060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a3521-8a8d-41d0-8626-45912123b60c None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:06.030908 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 54/114] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 1 13:34:05 2022] PUT /identity/v3/projects/4ab598b3074241ac9c1da0a539adebc9/users/0d6402310bab4e4d9246f710d3c2eba1/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:34:06.032074 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79e020-e6ca-4830-840e-bbb0060ae259 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:06.062902 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:06.085188 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:06.164956 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a3521-8a8d-41d0-8626-45912123b60c None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:06.182833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79e020-e6ca-4830-840e-bbb0060ae259 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:06.206511 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e5aef-314f-4d4c-bc1d-df1ad104869b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:06.207151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e5aef-314f-4d4c-bc1d-df1ad104869b None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:06.207470 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e5aef-314f-4d4c-bc1d-df1ad104869b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:06.207753 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e5aef-314f-4d4c-bc1d-df1ad104869b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:06.218915 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e5aef-314f-4d4c-bc1d-df1ad104869b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:06.223509 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29194a25-91e3-4546-a2d1-7550d32c4ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:06.224140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29194a25-91e3-4546-a2d1-7550d32c4ec1 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:06.224424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-b81e5aef-314f-4d4c-bc1d-df1ad104869b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:34:06.224424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:06.224424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:06.224424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:06.224424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:06.224424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:06.224424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:06.224424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:06.224424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:06.224424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:06.224424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:06.224424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:06.224424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:06.224424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:06.224424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:06.224424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:06.225250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:06.225250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:06.225250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:06.225250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:06.225250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:06.225250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:06.225250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:06.225250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:06.225250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:06.225250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:06.225250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:06.225250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:06.225250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:06.225250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:06.225250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:06.225250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:06.225995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:06.225995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:06.225995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:06.225995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:06.225995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:06.225995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:06.225995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:06.225995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:06.225995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:06.225995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:06.225995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:34:06.225995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:06.226580 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29194a25-91e3-4546-a2d1-7550d32c4ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:06.226580 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29194a25-91e3-4546-a2d1-7550d32c4ec1 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:06.226580 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29194a25-91e3-4546-a2d1-7550d32c4ec1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:06.226739 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 61/115] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:34:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:06.226812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29194a25-91e3-4546-a2d1-7550d32c4ec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:06.226882 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206d528-c2c9-4de4-ae71-5a3651c9cb15 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:06.226952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206d528-c2c9-4de4-ae71-5a3651c9cb15 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:06.227015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29194a25-91e3-4546-a2d1-7550d32c4ec1 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:06.227941 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206d528-c2c9-4de4-ae71-5a3651c9cb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:06.240017 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 55/116] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:34:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:06.245610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29194a25-91e3-4546-a2d1-7550d32c4ec1 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:06.246932 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-e206d528-c2c9-4de4-ae71-5a3651c9cb15 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:06.248165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-e206d528-c2c9-4de4-ae71-5a3651c9cb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:06.334955 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 62/117] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:06.340347 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206d528-c2c9-4de4-ae71-5a3651c9cb15 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:06.343511 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:06.368163 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29194a25-91e3-4546-a2d1-7550d32c4ec1 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:06.372904 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:06.416779 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea5b93-ba5e-4401-aa0f-0e8c94483a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:06.417767 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea5b93-ba5e-4401-aa0f-0e8c94483a1a None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:06.418180 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea5b93-ba5e-4401-aa0f-0e8c94483a1a None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:06.418584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea5b93-ba5e-4401-aa0f-0e8c94483a1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:06.432116 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea5b93-ba5e-4401-aa0f-0e8c94483a1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:06.465122 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-2cea5b93-ba5e-4401-aa0f-0e8c94483a1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:06.465122 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:06.465122 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:06.465122 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:06.465122 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:06.465122 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:06.465122 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:06.465122 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:06.465122 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:06.465122 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:06.465122 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:06.465122 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:06.465122 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:06.465122 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:06.465122 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:06.465122 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:06.466641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:06.466641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:06.466641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:06.466641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:06.466641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:06.466641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:06.466641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:06.466641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:06.466641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:06.466641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:06.466641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:06.466641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:06.466641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:06.466641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:06.466641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:06.466641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:06.467434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:06.467434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:06.467434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:06.467434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:06.467434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:06.467434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:06.467434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:06.467434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:06.467434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:06.467434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:06.467434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:06.467434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:06.467434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 56/118] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:06.467434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea5b93-ba5e-4401-aa0f-0e8c94483a1a None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:06.498449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206d528-c2c9-4de4-ae71-5a3651c9cb15 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:06.545956 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169ec38-d326-48da-9a90-b365fa74a8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:06.546950 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169ec38-d326-48da-9a90-b365fa74a8ef None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:06.547560 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169ec38-d326-48da-9a90-b365fa74a8ef None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:06.548046 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169ec38-d326-48da-9a90-b365fa74a8ef None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:06.549524 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169ec38-d326-48da-9a90-b365fa74a8ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:06.550048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169ec38-d326-48da-9a90-b365fa74a8ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:06.552703 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169ec38-d326-48da-9a90-b365fa74a8ef None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:06.564575 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 63/119] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:06.566065 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169ec38-d326-48da-9a90-b365fa74a8ef None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:06.579385 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea5b93-ba5e-4401-aa0f-0e8c94483a1a None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:06.618449 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234c092-36b9-4e73-b183-df1d8d451047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:06.619477 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234c092-36b9-4e73-b183-df1d8d451047 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:06.619989 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234c092-36b9-4e73-b183-df1d8d451047 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:06.620564 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234c092-36b9-4e73-b183-df1d8d451047 None admin] PATH_INFO: `/v3/users/0d6402310bab4e4d9246f710d3c2eba1` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:06.622053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234c092-36b9-4e73-b183-df1d8d451047 None admin] RBAC: Authorizing `identity:get_user(user_id=0d6402310bab4e4d9246f710d3c2eba1)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:06.623763 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234c092-36b9-4e73-b183-df1d8d451047 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:06.625803 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 57/120] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:06 2022] GET /identity/v3/users/0d6402310bab4e4d9246f710d3c2eba1 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:06.631267 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234c092-36b9-4e73-b183-df1d8d451047 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:06.641635 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:06.681751 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:06.690525 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169ec38-d326-48da-9a90-b365fa74a8ef None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:06.729293 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0920dd-99c3-4c1a-9bee-8db7f13ea44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:06.730185 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0920dd-99c3-4c1a-9bee-8db7f13ea44c None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:06.730635 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0920dd-99c3-4c1a-9bee-8db7f13ea44c None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:06.731681 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0920dd-99c3-4c1a-9bee-8db7f13ea44c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:06.744210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0920dd-99c3-4c1a-9bee-8db7f13ea44c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:06.749559 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234c092-36b9-4e73-b183-df1d8d451047 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:06.749870 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-3f0920dd-99c3-4c1a-9bee-8db7f13ea44c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:34:06.749870 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:06.749870 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:06.749870 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:06.749870 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:06.749870 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:06.749870 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:06.749870 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:06.749870 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:06.749870 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:06.749870 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:06.749870 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:06.749870 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:06.749870 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:06.749870 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:06.749870 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:06.750784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:06.750784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:06.750784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:06.750784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:06.750784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:06.750784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:06.750784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:06.750784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:06.750784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:06.750784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:06.750784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:06.750784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:06.750784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:06.750784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:06.750784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:06.750784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:06.751661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:06.751661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:06.751661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:06.751661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:06.751661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:06.751661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:06.751661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:06.751661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:06.751661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:06.751661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:06.751661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:34:06.751661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:06.753736 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 64/121] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:06.754752 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0920dd-99c3-4c1a-9bee-8db7f13ea44c None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:06.793315 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c6604-0cf6-4ecc-bdc7-700a9af881ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:06.793978 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c6604-0cf6-4ecc-bdc7-700a9af881ec None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:06.794266 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c6604-0cf6-4ecc-bdc7-700a9af881ec None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:06.794558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c6604-0cf6-4ecc-bdc7-700a9af881ec None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:06.795221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c6604-0cf6-4ecc-bdc7-700a9af881ec None admin] RBAC: Adding query filter params (name=member) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:06.795565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c6604-0cf6-4ecc-bdc7-700a9af881ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:06.796951 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c6604-0cf6-4ecc-bdc7-700a9af881ec None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:06.806857 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 58/122] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 1 13:34:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:06.809577 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c6604-0cf6-4ecc-bdc7-700a9af881ec None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:06.883745 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0920dd-99c3-4c1a-9bee-8db7f13ea44c None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:06.885313 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:06.919486 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40dc66-4cce-4bdc-8594-aa25c282c5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:06.920131 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40dc66-4cce-4bdc-8594-aa25c282c5ac None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:06.920416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40dc66-4cce-4bdc-8594-aa25c282c5ac None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:06.920700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40dc66-4cce-4bdc-8594-aa25c282c5ac None admin] PATH_INFO: `/v3/users/f72e2116699d4d6889af55d666d2817d` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:06.921834 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40dc66-4cce-4bdc-8594-aa25c282c5ac None admin] RBAC: Authorizing `identity:get_user(user_id=f72e2116699d4d6889af55d666d2817d)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:06.922650 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c6604-0cf6-4ecc-bdc7-700a9af881ec None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:06.923308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40dc66-4cce-4bdc-8594-aa25c282c5ac None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:06.925113 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 65/123] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:06 2022] GET /identity/v3/users/f72e2116699d4d6889af55d666d2817d => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:06.925805 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40dc66-4cce-4bdc-8594-aa25c282c5ac None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:06.952481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:06.966087 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83f511-dea1-4103-b21c-646274e13e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:06.967122 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83f511-dea1-4103-b21c-646274e13e88 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:06.967603 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83f511-dea1-4103-b21c-646274e13e88 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:06.968028 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83f511-dea1-4103-b21c-646274e13e88 None admin] PATH_INFO: `/v3/projects/4ab598b3074241ac9c1da0a539adebc9` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:06.969338 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83f511-dea1-4103-b21c-646274e13e88 None admin] RBAC: Authorizing `identity:get_project(project_id=4ab598b3074241ac9c1da0a539adebc9)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:06.971078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83f511-dea1-4103-b21c-646274e13e88 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:06.973185 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 59/124] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:06 2022] GET /identity/v3/projects/4ab598b3074241ac9c1da0a539adebc9 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:06.974175 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83f511-dea1-4103-b21c-646274e13e88 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:07.037040 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40dc66-4cce-4bdc-8594-aa25c282c5ac None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:07.073378 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319df72-b9b9-44cf-9356-b83f68abe796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:07.074051 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319df72-b9b9-44cf-9356-b83f68abe796 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:07.074338 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319df72-b9b9-44cf-9356-b83f68abe796 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:07.074619 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319df72-b9b9-44cf-9356-b83f68abe796 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:07.076286 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319df72-b9b9-44cf-9356-b83f68abe796 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:07.077763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319df72-b9b9-44cf-9356-b83f68abe796 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:07.083520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 66/125] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:34:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:07.083520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319df72-b9b9-44cf-9356-b83f68abe796 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:07.090989 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83f511-dea1-4103-b21c-646274e13e88 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:07.129735 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54065a8e-d8f4-4793-8c97-d370bf9e39e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:07.130359 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54065a8e-d8f4-4793-8c97-d370bf9e39e3 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:07.130638 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54065a8e-d8f4-4793-8c97-d370bf9e39e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:07.130917 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54065a8e-d8f4-4793-8c97-d370bf9e39e3 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:07.131615 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54065a8e-d8f4-4793-8c97-d370bf9e39e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:07.131921 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54065a8e-d8f4-4793-8c97-d370bf9e39e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:07.133297 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54065a8e-d8f4-4793-8c97-d370bf9e39e3 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:07.135904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:07.147469 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 60/126] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 1 13:34:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:07.147469 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54065a8e-d8f4-4793-8c97-d370bf9e39e3 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:07.193709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:07.201807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319df72-b9b9-44cf-9356-b83f68abe796 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:07.254288 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91baed6-2000-415c-8a12-9b9da8fe96bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:07.255420 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91baed6-2000-415c-8a12-9b9da8fe96bc None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:07.256088 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91baed6-2000-415c-8a12-9b9da8fe96bc None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:07.256642 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91baed6-2000-415c-8a12-9b9da8fe96bc None admin] PATH_INFO: `/v3/users/0d6402310bab4e4d9246f710d3c2eba1` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:07.258036 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91baed6-2000-415c-8a12-9b9da8fe96bc None admin] RBAC: Authorizing `identity:get_user(user_id=0d6402310bab4e4d9246f710d3c2eba1)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:07.260219 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91baed6-2000-415c-8a12-9b9da8fe96bc None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:07.262221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 67/127] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:07 2022] GET /identity/v3/users/0d6402310bab4e4d9246f710d3c2eba1 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:07.263596 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91baed6-2000-415c-8a12-9b9da8fe96bc None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:07.278613 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54065a8e-d8f4-4793-8c97-d370bf9e39e3 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:07.329577 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01b318-8e76-412d-887f-03359b770b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:07.330637 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01b318-8e76-412d-887f-03359b770b1f None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:07.331123 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01b318-8e76-412d-887f-03359b770b1f None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:07.331638 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01b318-8e76-412d-887f-03359b770b1f None admin] PATH_INFO: `/v3/projects/4ab598b3074241ac9c1da0a539adebc9` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:07.333480 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01b318-8e76-412d-887f-03359b770b1f None admin] RBAC: Authorizing `identity:get_project(project_id=4ab598b3074241ac9c1da0a539adebc9)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:07.336127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01b318-8e76-412d-887f-03359b770b1f None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:07.339193 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 61/128] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:07 2022] GET /identity/v3/projects/4ab598b3074241ac9c1da0a539adebc9 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:07.340928 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01b318-8e76-412d-887f-03359b770b1f None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:07.380882 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91baed6-2000-415c-8a12-9b9da8fe96bc None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:07.411483 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:07.419992 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d224b-968e-4e27-8642-dd9e27a09180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:07.426848 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d224b-968e-4e27-8642-dd9e27a09180 None admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:07.426848 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d224b-968e-4e27-8642-dd9e27a09180 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:07.426848 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d224b-968e-4e27-8642-dd9e27a09180 None admin] PATH_INFO: `/v3/projects/4ab598b3074241ac9c1da0a539adebc9/users/0d6402310bab4e4d9246f710d3c2eba1/roles/f0d2493c03664449802df928b8e8fa53` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:07.426848 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d224b-968e-4e27-8642-dd9e27a09180 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ab598b3074241ac9c1da0a539adebc9, user_id=0d6402310bab4e4d9246f710d3c2eba1, role_id=f0d2493c03664449802df928b8e8fa53)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:07.426848 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d224b-968e-4e27-8642-dd9e27a09180 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:07.446745 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01b318-8e76-412d-887f-03359b770b1f None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:07.493288 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651b99a-05a6-41c4-94bf-4bbe520eb7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:07.493288 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651b99a-05a6-41c4-94bf-4bbe520eb7a9 None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:07.493288 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651b99a-05a6-41c4-94bf-4bbe520eb7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:07.493288 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651b99a-05a6-41c4-94bf-4bbe520eb7a9 None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:07.493677 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651b99a-05a6-41c4-94bf-4bbe520eb7a9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:07.493677 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651b99a-05a6-41c4-94bf-4bbe520eb7a9 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:07.551528 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 68/129] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 1 13:34:07 2022] PUT /identity/v3/projects/4ab598b3074241ac9c1da0a539adebc9/users/0d6402310bab4e4d9246f710d3c2eba1/roles/f0d2493c03664449802df928b8e8fa53 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:34:07.552377 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d224b-968e-4e27-8642-dd9e27a09180 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:07.575660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:07.595593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 62/130] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Sep 1 13:34:07 2022] POST /identity/v3/projects => generated 302 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:34:07.595593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651b99a-05a6-41c4-94bf-4bbe520eb7a9 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:07.744701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d224b-968e-4e27-8642-dd9e27a09180 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:07.776218 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651b99a-05a6-41c4-94bf-4bbe520eb7a9 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:07.787068 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f8dd8-924e-4a81-9366-513d2e5d9ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:07.787746 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f8dd8-924e-4a81-9366-513d2e5d9ac9 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:07.788035 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f8dd8-924e-4a81-9366-513d2e5d9ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:07.788318 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f8dd8-924e-4a81-9366-513d2e5d9ac9 None admin] PATH_INFO: `/v3/users/e0579d90faf74645a2fe0f5b8fcd6761` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:07.802122 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:07.802808 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f8dd8-924e-4a81-9366-513d2e5d9ac9 None admin] RBAC: Authorizing `identity:get_user(user_id=e0579d90faf74645a2fe0f5b8fcd6761)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:07.804755 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f8dd8-924e-4a81-9366-513d2e5d9ac9 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:07.806775 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 69/131] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:07 2022] GET /identity/v3/users/e0579d90faf74645a2fe0f5b8fcd6761 => generated 289 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:07.807581 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f8dd8-924e-4a81-9366-513d2e5d9ac9 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:07.817628 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf521d-a9c8-4f42-9567-35483c7df6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:07.818695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf521d-a9c8-4f42-9567-35483c7df6b8 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:07.818695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf521d-a9c8-4f42-9567-35483c7df6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:07.818966 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf521d-a9c8-4f42-9567-35483c7df6b8 None admin] PATH_INFO: `/v3/projects/6cbea0e244dd4dcdbed94848ae3aff3c` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:07.820143 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf521d-a9c8-4f42-9567-35483c7df6b8 None admin] RBAC: Authorizing `identity:get_project(project_id=6cbea0e244dd4dcdbed94848ae3aff3c)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:07.821597 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf521d-a9c8-4f42-9567-35483c7df6b8 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:07.823638 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 63/132] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:07 2022] GET /identity/v3/projects/6cbea0e244dd4dcdbed94848ae3aff3c => generated 312 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:07.830627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf521d-a9c8-4f42-9567-35483c7df6b8 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:07.916658 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:07.950822 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f8dd8-924e-4a81-9366-513d2e5d9ac9 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:07.969880 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf521d-a9c8-4f42-9567-35483c7df6b8 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:08.003108 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad2d97-d336-446b-961a-3fe88c607ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:08.004112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad2d97-d336-446b-961a-3fe88c607ce9 None admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:08.004399 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad2d97-d336-446b-961a-3fe88c607ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:08.004683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad2d97-d336-446b-961a-3fe88c607ce9 None admin] PATH_INFO: `/v3/projects/4ab598b3074241ac9c1da0a539adebc9/users/f72e2116699d4d6889af55d666d2817d/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:08.008789 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad2d97-d336-446b-961a-3fe88c607ce9 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ab598b3074241ac9c1da0a539adebc9, user_id=f72e2116699d4d6889af55d666d2817d, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:08.010578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad2d97-d336-446b-961a-3fe88c607ce9 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:08.022784 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391be98-73b7-44ba-b51b-60d7f87a1497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:08.031991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391be98-73b7-44ba-b51b-60d7f87a1497 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:08.031991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391be98-73b7-44ba-b51b-60d7f87a1497 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:08.031991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391be98-73b7-44ba-b51b-60d7f87a1497 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:08.083189 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 70/133] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 1 13:34:07 2022] PUT /identity/v3/projects/4ab598b3074241ac9c1da0a539adebc9/users/f72e2116699d4d6889af55d666d2817d/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:34:08.088178 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad2d97-d336-446b-961a-3fe88c607ce9 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:08.110175 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:08.148607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391be98-73b7-44ba-b51b-60d7f87a1497 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:08.150157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391be98-73b7-44ba-b51b-60d7f87a1497 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:08.286878 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad2d97-d336-446b-961a-3fe88c607ce9 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:08.337159 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6a7af-2e2a-4ad3-8c74-b10f3adb0c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:08.338122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6a7af-2e2a-4ad3-8c74-b10f3adb0c48 None admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:08.338569 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6a7af-2e2a-4ad3-8c74-b10f3adb0c48 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:08.339007 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6a7af-2e2a-4ad3-8c74-b10f3adb0c48 None admin] PATH_INFO: `/v3/projects/6cbea0e244dd4dcdbed94848ae3aff3c/users/0d6402310bab4e4d9246f710d3c2eba1/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:08.344531 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6a7af-2e2a-4ad3-8c74-b10f3adb0c48 None admin] RBAC: Authorizing `identity:create_grant(project_id=6cbea0e244dd4dcdbed94848ae3aff3c, user_id=0d6402310bab4e4d9246f710d3c2eba1, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:08.346273 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 64/134] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:08.347302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6a7af-2e2a-4ad3-8c74-b10f3adb0c48 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:08.351099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:08.352693 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b97a7-7acd-42bc-bdc7-3a2ee34ae0c3 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:08.353210 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b97a7-7acd-42bc-bdc7-3a2ee34ae0c3 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:08.353496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b97a7-7acd-42bc-bdc7-3a2ee34ae0c3 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:08.355069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 65/135] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:08.355619 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b97a7-7acd-42bc-bdc7-3a2ee34ae0c3 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:08.443567 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 71/136] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 1 13:34:08 2022] PUT /identity/v3/projects/6cbea0e244dd4dcdbed94848ae3aff3c/users/0d6402310bab4e4d9246f710d3c2eba1/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:34:08.445290 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da095bf9-eba7-46f8-8386-f4dadc114ba9 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:08.445833 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da095bf9-eba7-46f8-8386-f4dadc114ba9 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:08.446278 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da095bf9-eba7-46f8-8386-f4dadc114ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:08.484942 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:08.487635 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-da095bf9-eba7-46f8-8386-f4dadc114ba9 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:08.489049 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-da095bf9-eba7-46f8-8386-f4dadc114ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:08.509040 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b97a7-7acd-42bc-bdc7-3a2ee34ae0c3 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:08.562829 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17ffe6-1085-417f-b80e-e49e0171c3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:08.563610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17ffe6-1085-417f-b80e-e49e0171c3f9 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:08.563909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17ffe6-1085-417f-b80e-e49e0171c3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:08.564191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17ffe6-1085-417f-b80e-e49e0171c3f9 None admin] PATH_INFO: `/v3/projects/4ab598b3074241ac9c1da0a539adebc9` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:08.565329 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17ffe6-1085-417f-b80e-e49e0171c3f9 None admin] RBAC: Authorizing `identity:get_project(project_id=4ab598b3074241ac9c1da0a539adebc9)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:08.567858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 72/137] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:08.572317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17ffe6-1085-417f-b80e-e49e0171c3f9 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:08.574342 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 66/138] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:08 2022] GET /identity/v3/projects/4ab598b3074241ac9c1da0a539adebc9 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:08.581240 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da095bf9-eba7-46f8-8386-f4dadc114ba9 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:08.709332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da095bf9-eba7-46f8-8386-f4dadc114ba9 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:08.744119 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:08.749670 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdffd98-e354-42f4-9429-eded99d25056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:08.750289 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdffd98-e354-42f4-9429-eded99d25056 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:08.750568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdffd98-e354-42f4-9429-eded99d25056 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:08.750839 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdffd98-e354-42f4-9429-eded99d25056 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:08.751609 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdffd98-e354-42f4-9429-eded99d25056 None admin] RBAC: Adding query filter params (role.id=38b6cb84b0e04d4db8dc3ae0793aee31, scope.project.id=4ab598b3074241ac9c1da0a539adebc9, user.id=e0579d90faf74645a2fe0f5b8fcd6761) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:08.751915 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdffd98-e354-42f4-9429-eded99d25056 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:08.753473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdffd98-e354-42f4-9429-eded99d25056 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:08.759936 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 73/139] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:34:08 2022] GET /identity/v3/role_assignments?user.id=e0579d90faf74645a2fe0f5b8fcd6761&scope.project.id=4ab598b3074241ac9c1da0a539adebc9&role.id=38b6cb84b0e04d4db8dc3ae0793aee31 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:09.157165 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17ffe6-1085-417f-b80e-e49e0171c3f9 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:09.283598 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17ffe6-1085-417f-b80e-e49e0171c3f9 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:09.318239 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33373831-540e-4c64-9c6d-b0ab1345a87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:09.318883 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33373831-540e-4c64-9c6d-b0ab1345a87c None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:09.319168 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33373831-540e-4c64-9c6d-b0ab1345a87c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:09.319470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33373831-540e-4c64-9c6d-b0ab1345a87c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:09.330610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33373831-540e-4c64-9c6d-b0ab1345a87c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:09.335465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-33373831-540e-4c64-9c6d-b0ab1345a87c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:09.335465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:09.335465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:09.335465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:09.335465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:09.335465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:09.335465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:09.335465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:09.335465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:09.335465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:09.335465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:09.335465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:09.335465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:09.335465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:09.335465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:09.335465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:09.336314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:09.336314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:09.336314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:09.336314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:09.336314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:09.336314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:09.336314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:09.336314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:09.336314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:09.336314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:09.336314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:09.336314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:09.336314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:09.336314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:09.336314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:09.336314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:09.337078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:09.337078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:09.337078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:09.337078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:09.337078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:09.337078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:09.337078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:09.337078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:09.337078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:09.337078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:09.337078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:09.337078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:09.337078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 67/140] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:34:09.343918 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdffd98-e354-42f4-9429-eded99d25056 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:09.479263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdffd98-e354-42f4-9429-eded99d25056 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:09.517122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233c720-b12a-4e82-bb0b-0ac7dbb5b10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:09.517763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233c720-b12a-4e82-bb0b-0ac7dbb5b10b None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:09.518048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233c720-b12a-4e82-bb0b-0ac7dbb5b10b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:09.518325 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233c720-b12a-4e82-bb0b-0ac7dbb5b10b None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:09.518997 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233c720-b12a-4e82-bb0b-0ac7dbb5b10b None admin] RBAC: Adding query filter params (name=member) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:09.519303 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233c720-b12a-4e82-bb0b-0ac7dbb5b10b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:09.520747 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233c720-b12a-4e82-bb0b-0ac7dbb5b10b None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:09.534410 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 74/141] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 1 13:34:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:09.535815 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33373831-540e-4c64-9c6d-b0ab1345a87c None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:09.558773 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:09.666419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33373831-540e-4c64-9c6d-b0ab1345a87c None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:09.719033 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb609d2b-ec3c-4966-902f-4e1338c634f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:09.719796 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb609d2b-ec3c-4966-902f-4e1338c634f7 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:09.720092 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb609d2b-ec3c-4966-902f-4e1338c634f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:09.720365 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb609d2b-ec3c-4966-902f-4e1338c634f7 None admin] PATH_INFO: `/v3/users/0d6402310bab4e4d9246f710d3c2eba1` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:09.721606 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb609d2b-ec3c-4966-902f-4e1338c634f7 None admin] RBAC: Authorizing `identity:get_user(user_id=0d6402310bab4e4d9246f710d3c2eba1)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:09.723108 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb609d2b-ec3c-4966-902f-4e1338c634f7 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:09.729163 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 68/142] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:09 2022] GET /identity/v3/users/0d6402310bab4e4d9246f710d3c2eba1 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:09.731713 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233c720-b12a-4e82-bb0b-0ac7dbb5b10b None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:09.802622 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:09.863459 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233c720-b12a-4e82-bb0b-0ac7dbb5b10b None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:09.910473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa9214-60a3-48f3-8c35-1cd904987399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:09.911106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa9214-60a3-48f3-8c35-1cd904987399 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:09.911445 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa9214-60a3-48f3-8c35-1cd904987399 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:09.911746 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa9214-60a3-48f3-8c35-1cd904987399 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:10.011124 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa9214-60a3-48f3-8c35-1cd904987399 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:10.012632 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa9214-60a3-48f3-8c35-1cd904987399 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:10.073448 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:10.130800 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 75/143] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:10.134407 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb609d2b-ec3c-4966-902f-4e1338c634f7 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:10.252470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:10.271763 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb609d2b-ec3c-4966-902f-4e1338c634f7 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:10.325542 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d157bed-6f63-45ce-9254-6fcd057101b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:10.326187 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d157bed-6f63-45ce-9254-6fcd057101b6 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:10.326471 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d157bed-6f63-45ce-9254-6fcd057101b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:10.326744 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d157bed-6f63-45ce-9254-6fcd057101b6 None admin] PATH_INFO: `/v3/projects/4ab598b3074241ac9c1da0a539adebc9` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:10.332047 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d157bed-6f63-45ce-9254-6fcd057101b6 None admin] RBAC: Authorizing `identity:get_project(project_id=4ab598b3074241ac9c1da0a539adebc9)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:10.333511 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d157bed-6f63-45ce-9254-6fcd057101b6 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:10.335167 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 69/144] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:10 2022] GET /identity/v3/projects/4ab598b3074241ac9c1da0a539adebc9 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:10.342079 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa9214-60a3-48f3-8c35-1cd904987399 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:10.385432 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb44e91-9f8a-48be-a9de-1f8d5eaf718f None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:10.385747 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb44e91-9f8a-48be-a9de-1f8d5eaf718f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:10.386153 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb44e91-9f8a-48be-a9de-1f8d5eaf718f None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:10.387977 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 70/145] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:34:10.400265 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10185b97-64b8-4af7-9d63-9a00c042bcfc None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:10.400543 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10185b97-64b8-4af7-9d63-9a00c042bcfc None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:10.400825 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10185b97-64b8-4af7-9d63-9a00c042bcfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:10.432325 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-10185b97-64b8-4af7-9d63-9a00c042bcfc None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:10.433541 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-10185b97-64b8-4af7-9d63-9a00c042bcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:10.522208 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa9214-60a3-48f3-8c35-1cd904987399 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:10.559795 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bf9b4-7849-434c-8af2-f257a8fb9692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:10.560535 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bf9b4-7849-434c-8af2-f257a8fb9692 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:10.560813 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bf9b4-7849-434c-8af2-f257a8fb9692 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:10.561080 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bf9b4-7849-434c-8af2-f257a8fb9692 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:10.561827 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bf9b4-7849-434c-8af2-f257a8fb9692 None admin] RBAC: Adding query filter params (role.id=3654765b6c2644779fda2924f119aef7, scope.project.id=4ab598b3074241ac9c1da0a539adebc9, user.id=0d6402310bab4e4d9246f710d3c2eba1) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:10.562128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bf9b4-7849-434c-8af2-f257a8fb9692 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:10.563801 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bf9b4-7849-434c-8af2-f257a8fb9692 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:10.570274 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 76/146] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:34:10 2022] GET /identity/v3/role_assignments?user.id=0d6402310bab4e4d9246f710d3c2eba1&scope.project.id=4ab598b3074241ac9c1da0a539adebc9&role.id=3654765b6c2644779fda2924f119aef7 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:10.571562 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a614b04-7e44-4904-a936-d8fc5a908fba None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:10.571847 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a614b04-7e44-4904-a936-d8fc5a908fba None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:10.572151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a614b04-7e44-4904-a936-d8fc5a908fba None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:10.573462 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 77/147] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:10.579099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc268d44-4f37-4d71-ade2-769517b476ef None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:10.579443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc268d44-4f37-4d71-ade2-769517b476ef None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:10.579694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc268d44-4f37-4d71-ade2-769517b476ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:10.587681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 71/148] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:10.598915 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-dc268d44-4f37-4d71-ade2-769517b476ef None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:10.600140 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-dc268d44-4f37-4d71-ade2-769517b476ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:10.613262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:10.677986 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 78/149] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:10.947982 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10185b97-64b8-4af7-9d63-9a00c042bcfc None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:11.035670 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:11.055673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10185b97-64b8-4af7-9d63-9a00c042bcfc None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:11.093952 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d82c93-f7ca-41d0-b62c-7821331404ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:11.096251 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d82c93-f7ca-41d0-b62c-7821331404ee None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:11.096251 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d82c93-f7ca-41d0-b62c-7821331404ee None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:11.096251 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d82c93-f7ca-41d0-b62c-7821331404ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:11.105983 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d82c93-f7ca-41d0-b62c-7821331404ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:11.111058 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-75d82c93-f7ca-41d0-b62c-7821331404ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:34:11.111058 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:11.111058 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:11.111058 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:11.111058 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:11.111058 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:11.111058 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:11.111058 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:11.111058 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:11.111058 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:11.111058 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:11.111058 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:11.111058 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:11.111058 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:11.111058 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:11.111058 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:11.111967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:11.111967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:11.111967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:11.111967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:11.111967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:11.111967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:11.111967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:11.111967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:11.111967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:11.111967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:11.111967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:11.111967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:11.111967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:11.111967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:11.111967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:11.111967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:11.112703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:11.112703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:11.112703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:11.112703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:11.112703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:11.112703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:11.112703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:11.112703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:11.112703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:11.112703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:11.112703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:34:11.112703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:11.112703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 72/150] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 1 13:34:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:11.118214 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc268d44-4f37-4d71-ade2-769517b476ef None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:11.179851 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d82c93-f7ca-41d0-b62c-7821331404ee None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:11.246669 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc268d44-4f37-4d71-ade2-769517b476ef None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:11.286494 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691b7f7-02b3-42ba-8460-7cff3af30bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:11.287477 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691b7f7-02b3-42ba-8460-7cff3af30bad None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:11.287751 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691b7f7-02b3-42ba-8460-7cff3af30bad None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:11.288020 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691b7f7-02b3-42ba-8460-7cff3af30bad None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:11.288688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691b7f7-02b3-42ba-8460-7cff3af30bad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:11.288985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691b7f7-02b3-42ba-8460-7cff3af30bad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:11.290368 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691b7f7-02b3-42ba-8460-7cff3af30bad None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:11.299099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 79/151] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:34:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:11.299827 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d82c93-f7ca-41d0-b62c-7821331404ee None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:11.300520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb9a62-1e9c-49e0-97c1-7ad47eef9d1f None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:11.300929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb9a62-1e9c-49e0-97c1-7ad47eef9d1f None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:11.301322 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb9a62-1e9c-49e0-97c1-7ad47eef9d1f None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:11.302684 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 80/152] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:11.307942 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417f8df-60e5-45e2-9892-d6ad2556d5eb None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:11.308226 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417f8df-60e5-45e2-9892-d6ad2556d5eb None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:11.308499 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417f8df-60e5-45e2-9892-d6ad2556d5eb None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:11.309896 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 81/153] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:11.310447 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417f8df-60e5-45e2-9892-d6ad2556d5eb None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:11.331198 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:11.351997 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ed5b1-7414-48aa-9c08-32aca2598696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:11.352553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ed5b1-7414-48aa-9c08-32aca2598696 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:11.352834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ed5b1-7414-48aa-9c08-32aca2598696 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:11.353250 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ed5b1-7414-48aa-9c08-32aca2598696 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:11.354407 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ed5b1-7414-48aa-9c08-32aca2598696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:11.355999 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ed5b1-7414-48aa-9c08-32aca2598696 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:11.357825 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 73/154] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:34:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:11.358957 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ec618-311d-4cd2-9989-e87497e7f868 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:11.359240 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ec618-311d-4cd2-9989-e87497e7f868 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:11.359543 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ec618-311d-4cd2-9989-e87497e7f868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:11.377333 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-913ec618-311d-4cd2-9989-e87497e7f868 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:11.378511 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-913ec618-311d-4cd2-9989-e87497e7f868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:11.380639 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:11.432810 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417f8df-60e5-45e2-9892-d6ad2556d5eb None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:11.456327 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 74/155] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:11.458235 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b8faf-f65f-4905-ba80-90b8040ecfc6 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:11.458593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b8faf-f65f-4905-ba80-90b8040ecfc6 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:11.458949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b8faf-f65f-4905-ba80-90b8040ecfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:11.474380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da787732-f2ae-4bcd-a286-726cdc9c6439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:11.475348 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da787732-f2ae-4bcd-a286-726cdc9c6439 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:11.475847 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da787732-f2ae-4bcd-a286-726cdc9c6439 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:11.476293 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da787732-f2ae-4bcd-a286-726cdc9c6439 None admin] PATH_INFO: `/v3/users/0d6402310bab4e4d9246f710d3c2eba1` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:11.477798 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da787732-f2ae-4bcd-a286-726cdc9c6439 None admin] RBAC: Authorizing `identity:get_user(user_id=0d6402310bab4e4d9246f710d3c2eba1)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:11.479470 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da787732-f2ae-4bcd-a286-726cdc9c6439 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:11.481686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 82/156] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:11 2022] GET /identity/v3/users/0d6402310bab4e4d9246f710d3c2eba1 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:11.482961 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da787732-f2ae-4bcd-a286-726cdc9c6439 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:11.488320 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-800b8faf-f65f-4905-ba80-90b8040ecfc6 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:11.490971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-800b8faf-f65f-4905-ba80-90b8040ecfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:11.577583 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:11.581207 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 75/157] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:11.590714 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b8faf-f65f-4905-ba80-90b8040ecfc6 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:11.622625 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da787732-f2ae-4bcd-a286-726cdc9c6439 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:11.685757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb5309-23c0-43d0-a2f1-ce1e3fb12015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:11.686391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb5309-23c0-43d0-a2f1-ce1e3fb12015 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:11.686673 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb5309-23c0-43d0-a2f1-ce1e3fb12015 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:11.686947 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb5309-23c0-43d0-a2f1-ce1e3fb12015 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:11.687632 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb5309-23c0-43d0-a2f1-ce1e3fb12015 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:11.689087 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb5309-23c0-43d0-a2f1-ce1e3fb12015 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:11.718306 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:11.755337 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b8faf-f65f-4905-ba80-90b8040ecfc6 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:11.792122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 83/158] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 1 13:34:11 2022] POST /identity/v3/users => generated 283 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:34:11.793409 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb5309-23c0-43d0-a2f1-ce1e3fb12015 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:11.798504 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca433a3-fbf1-4d11-9b6e-c7d63d2281cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:11.799151 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca433a3-fbf1-4d11-9b6e-c7d63d2281cd None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:11.799458 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca433a3-fbf1-4d11-9b6e-c7d63d2281cd None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:11.799731 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca433a3-fbf1-4d11-9b6e-c7d63d2281cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:11.898313 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca433a3-fbf1-4d11-9b6e-c7d63d2281cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:11.900752 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca433a3-fbf1-4d11-9b6e-c7d63d2281cd None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:11.961661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb5309-23c0-43d0-a2f1-ce1e3fb12015 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:11.992520 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:12.001621 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:12.006604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bdd8c9-24da-4e24-b3a3-47806eb50f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:12.007244 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdd8c9-24da-4e24-b3a3-47806eb50f2d None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:12.008006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdd8c9-24da-4e24-b3a3-47806eb50f2d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:12.008006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdd8c9-24da-4e24-b3a3-47806eb50f2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:12.020225 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bdd8c9-24da-4e24-b3a3-47806eb50f2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:12.025115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-77bdd8c9-24da-4e24-b3a3-47806eb50f2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:12.025115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:12.025115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:12.025115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:12.025115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:12.025115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:12.025115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:12.025115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:12.025115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:12.025115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:12.025115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:12.025115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:12.025115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:12.025115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:12.025115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:12.025115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:12.030645 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:12.030645 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:12.030645 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:12.030645 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:12.030645 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:12.030645 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:12.030645 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:12.030645 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:12.030645 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:12.030645 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:12.030645 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:12.030645 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:12.030645 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:12.030645 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:12.030645 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:12.030645 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:12.031551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:12.031551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:12.031551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:12.031551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:12.031551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:12.031551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:12.031551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:12.031551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:12.031551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:12.031551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:12.031551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:12.031551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:12.031551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 84/159] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:12.031551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bdd8c9-24da-4e24-b3a3-47806eb50f2d None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:12.039059 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 76/160] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:12.040813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed076785-2ca0-4084-9ecc-c232d7e8deb1 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:12.041425 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed076785-2ca0-4084-9ecc-c232d7e8deb1 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:12.041909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed076785-2ca0-4084-9ecc-c232d7e8deb1 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:12.044009 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 77/161] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:12.044863 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed076785-2ca0-4084-9ecc-c232d7e8deb1 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:12.156387 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bdd8c9-24da-4e24-b3a3-47806eb50f2d None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:12.187444 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed076785-2ca0-4084-9ecc-c232d7e8deb1 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:12.199034 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365fa77-d864-47da-a24a-f5e5da4a0c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:12.200457 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365fa77-d864-47da-a24a-f5e5da4a0c61 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:12.200991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365fa77-d864-47da-a24a-f5e5da4a0c61 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:12.201432 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365fa77-d864-47da-a24a-f5e5da4a0c61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:12.217289 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365fa77-d864-47da-a24a-f5e5da4a0c61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:12.223980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-b365fa77-d864-47da-a24a-f5e5da4a0c61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:34:12.223980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:12.223980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:12.223980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:12.223980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:12.223980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:12.223980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:12.223980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:12.223980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:12.223980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:12.223980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:12.223980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:12.223980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:12.223980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:12.223980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:12.223980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:12.225032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:12.225032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:12.225032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:12.225032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:12.225032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:12.225032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:12.225032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:12.225032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:12.225032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:12.225032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:12.225032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:12.225032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:12.225032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:12.225032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:12.225032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:12.225032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:12.226023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:12.226023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:12.226023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:12.226023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:12.226023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:12.226023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:12.226023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:12.226023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:12.226023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:12.226023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:12.226023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:34:12.226023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:12.228494 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 85/162] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:34:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:12.229003 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365fa77-d864-47da-a24a-f5e5da4a0c61 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:12.232317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355599d5-edf9-46ab-bc0a-4524da5c1b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:12.233189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355599d5-edf9-46ab-bc0a-4524da5c1b9c None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:12.233465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355599d5-edf9-46ab-bc0a-4524da5c1b9c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:12.233734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355599d5-edf9-46ab-bc0a-4524da5c1b9c None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:12.234503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355599d5-edf9-46ab-bc0a-4524da5c1b9c None admin] RBAC: Adding query filter params (name=member) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:12.234704 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355599d5-edf9-46ab-bc0a-4524da5c1b9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:12.236619 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355599d5-edf9-46ab-bc0a-4524da5c1b9c None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:12.245916 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 78/163] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 1 13:34:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:12.252475 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9281e-2853-4d59-9062-5e0c40f32090 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:12.252761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9281e-2853-4d59-9062-5e0c40f32090 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:12.253037 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9281e-2853-4d59-9062-5e0c40f32090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:12.276416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-d4a9281e-2853-4d59-9062-5e0c40f32090 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:12.277653 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-d4a9281e-2853-4d59-9062-5e0c40f32090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:12.301552 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:12.305951 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:12.365078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 79/164] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:12.366361 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9281e-2853-4d59-9062-5e0c40f32090 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:12.372709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365fa77-d864-47da-a24a-f5e5da4a0c61 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:12.421876 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06885f-e9a6-43fb-b71a-2715febd1742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:12.422434 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06885f-e9a6-43fb-b71a-2715febd1742 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:12.422750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06885f-e9a6-43fb-b71a-2715febd1742 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:12.423068 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06885f-e9a6-43fb-b71a-2715febd1742 None admin] PATH_INFO: `/v3/projects/4ab598b3074241ac9c1da0a539adebc9` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:12.424770 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06885f-e9a6-43fb-b71a-2715febd1742 None admin] RBAC: Authorizing `identity:get_project(project_id=4ab598b3074241ac9c1da0a539adebc9)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:12.426689 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06885f-e9a6-43fb-b71a-2715febd1742 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:12.428834 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 86/165] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:12 2022] GET /identity/v3/projects/4ab598b3074241ac9c1da0a539adebc9 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:12.429691 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06885f-e9a6-43fb-b71a-2715febd1742 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:12.501013 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9281e-2853-4d59-9062-5e0c40f32090 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:12.548695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40a99a-f4ca-4400-bb51-048b1f9dd41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:12.549845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40a99a-f4ca-4400-bb51-048b1f9dd41a None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:12.550606 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40a99a-f4ca-4400-bb51-048b1f9dd41a None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:12.551113 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40a99a-f4ca-4400-bb51-048b1f9dd41a None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:12.552140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e40a99a-f4ca-4400-bb51-048b1f9dd41a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:12.552655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e40a99a-f4ca-4400-bb51-048b1f9dd41a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:12.555162 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e40a99a-f4ca-4400-bb51-048b1f9dd41a None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:12.567472 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 80/166] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:12.568622 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40a99a-f4ca-4400-bb51-048b1f9dd41a None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:12.569372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06885f-e9a6-43fb-b71a-2715febd1742 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:12.595204 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:12.612303 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64918440-707f-4198-b082-809371e834b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:12.623913 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64918440-707f-4198-b082-809371e834b3 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:12.623913 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64918440-707f-4198-b082-809371e834b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:12.623913 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64918440-707f-4198-b082-809371e834b3 None admin] PATH_INFO: `/v3/users/0d6402310bab4e4d9246f710d3c2eba1` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:12.623913 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64918440-707f-4198-b082-809371e834b3 None admin] RBAC: Authorizing `identity:get_user(user_id=0d6402310bab4e4d9246f710d3c2eba1)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:12.623913 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64918440-707f-4198-b082-809371e834b3 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:12.623913 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 87/167] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:12 2022] GET /identity/v3/users/0d6402310bab4e4d9246f710d3c2eba1 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:12.624330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64918440-707f-4198-b082-809371e834b3 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:12.627705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:12.747008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64918440-707f-4198-b082-809371e834b3 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:12.787687 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515736b8-09b9-4272-8f22-134a49cfcc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:12.788480 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515736b8-09b9-4272-8f22-134a49cfcc3f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:12.788766 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515736b8-09b9-4272-8f22-134a49cfcc3f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:12.789225 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515736b8-09b9-4272-8f22-134a49cfcc3f None admin] PATH_INFO: `/v3/users/f72e2116699d4d6889af55d666d2817d` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:12.790656 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515736b8-09b9-4272-8f22-134a49cfcc3f None admin] RBAC: Authorizing `identity:get_user(user_id=f72e2116699d4d6889af55d666d2817d)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:12.792380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515736b8-09b9-4272-8f22-134a49cfcc3f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:12.795105 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 88/168] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:12 2022] GET /identity/v3/users/f72e2116699d4d6889af55d666d2817d => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:12.795919 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515736b8-09b9-4272-8f22-134a49cfcc3f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:12.836595 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40a99a-f4ca-4400-bb51-048b1f9dd41a None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:12.864757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:12.912652 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955a296-f9dd-4430-adc8-bf9c49ac8d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:12.913425 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955a296-f9dd-4430-adc8-bf9c49ac8d57 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:12.913703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955a296-f9dd-4430-adc8-bf9c49ac8d57 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:12.913971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955a296-f9dd-4430-adc8-bf9c49ac8d57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:12.915131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955a296-f9dd-4430-adc8-bf9c49ac8d57 None admin] RBAC: Adding query filter params (role.id=f0d2493c03664449802df928b8e8fa53, scope.project.id=4ab598b3074241ac9c1da0a539adebc9, user.id=0d6402310bab4e4d9246f710d3c2eba1) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:12.915131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955a296-f9dd-4430-adc8-bf9c49ac8d57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:12.915311 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515736b8-09b9-4272-8f22-134a49cfcc3f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:12.916478 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955a296-f9dd-4430-adc8-bf9c49ac8d57 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:12.929362 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 81/169] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:34:12 2022] GET /identity/v3/role_assignments?user.id=0d6402310bab4e4d9246f710d3c2eba1&scope.project.id=4ab598b3074241ac9c1da0a539adebc9&role.id=f0d2493c03664449802df928b8e8fa53 => generated 608 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:12.930222 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955a296-f9dd-4430-adc8-bf9c49ac8d57 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:12.958065 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e67cf-99bd-4702-aa95-1e7fc4db6508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:12.958700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e67cf-99bd-4702-aa95-1e7fc4db6508 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:12.958984 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e67cf-99bd-4702-aa95-1e7fc4db6508 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:12.959268 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e67cf-99bd-4702-aa95-1e7fc4db6508 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:13.041751 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e67cf-99bd-4702-aa95-1e7fc4db6508 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:13.043823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e67cf-99bd-4702-aa95-1e7fc4db6508 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:13.173251 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:13.184248 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:13.209728 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955a296-f9dd-4430-adc8-bf9c49ac8d57 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:13.251788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 89/170] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:13.252898 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e67cf-99bd-4702-aa95-1e7fc4db6508 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:13.281486 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8686355-5b3c-4b2c-b4d4-f41805735478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:13.283148 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8686355-5b3c-4b2c-b4d4-f41805735478 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:13.283767 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8686355-5b3c-4b2c-b4d4-f41805735478 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:13.285346 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8686355-5b3c-4b2c-b4d4-f41805735478 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:13.408067 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e67cf-99bd-4702-aa95-1e7fc4db6508 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:13.430975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8686355-5b3c-4b2c-b4d4-f41805735478 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:13.432493 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8686355-5b3c-4b2c-b4d4-f41805735478 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:13.460069 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0ae32-7c6a-4d20-8813-293745a4d45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:13.460712 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0ae32-7c6a-4d20-8813-293745a4d45b None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:13.461091 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0ae32-7c6a-4d20-8813-293745a4d45b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:13.461367 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0ae32-7c6a-4d20-8813-293745a4d45b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:13.481918 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0ae32-7c6a-4d20-8813-293745a4d45b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:13.487262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-98e0ae32-7c6a-4d20-8813-293745a4d45b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:34:13.487262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:13.487262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:13.487262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:13.487262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:13.487262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:13.487262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:13.487262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:13.487262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:13.487262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:13.487262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:13.487262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:13.487262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:13.487262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:13.487262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:13.487262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:13.488160 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:13.488160 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:13.488160 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:13.488160 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:13.488160 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:13.488160 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:13.488160 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:13.488160 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:13.488160 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:13.488160 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:13.488160 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:13.488160 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:13.488160 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:13.488160 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:13.488160 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:13.488160 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:13.488914 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:13.488914 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:13.488914 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:13.488914 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:13.488914 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:13.488914 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:13.488914 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:13.488914 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:13.488914 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:13.488914 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:13.488914 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:34:13.488914 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:13.488914 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 90/171] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:13.489626 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0ae32-7c6a-4d20-8813-293745a4d45b None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:13.524117 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:13.538737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:13.556723 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 82/172] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:13.559459 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8686355-5b3c-4b2c-b4d4-f41805735478 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:13.660006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0ae32-7c6a-4d20-8813-293745a4d45b None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:13.708780 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b827f4-5280-4486-b90f-a3154344591a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:13.709426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b827f4-5280-4486-b90f-a3154344591a None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:13.713012 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b827f4-5280-4486-b90f-a3154344591a None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:13.713307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b827f4-5280-4486-b90f-a3154344591a None admin] PATH_INFO: `/v3/projects/6cbea0e244dd4dcdbed94848ae3aff3c` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:13.714539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b827f4-5280-4486-b90f-a3154344591a None admin] RBAC: Authorizing `identity:get_project(project_id=6cbea0e244dd4dcdbed94848ae3aff3c)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:13.716100 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b827f4-5280-4486-b90f-a3154344591a None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:13.717763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 91/173] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:13 2022] GET /identity/v3/projects/6cbea0e244dd4dcdbed94848ae3aff3c => generated 312 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:13.718580 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b827f4-5280-4486-b90f-a3154344591a None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:13.753354 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8686355-5b3c-4b2c-b4d4-f41805735478 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:13.824729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:13.836757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b827f4-5280-4486-b90f-a3154344591a None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:13.847529 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467b56a-dd09-4d92-bb99-7d4239c3f61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:13.847529 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467b56a-dd09-4d92-bb99-7d4239c3f61c None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:13.847529 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467b56a-dd09-4d92-bb99-7d4239c3f61c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:13.847529 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467b56a-dd09-4d92-bb99-7d4239c3f61c None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:13.847904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467b56a-dd09-4d92-bb99-7d4239c3f61c None admin] RBAC: Adding query filter params (name=reader) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:13.847904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467b56a-dd09-4d92-bb99-7d4239c3f61c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:13.847904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467b56a-dd09-4d92-bb99-7d4239c3f61c None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:13.870153 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 83/174] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 1 13:34:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:13.872547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467b56a-dd09-4d92-bb99-7d4239c3f61c None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:13.899246 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a87c0-ddf3-4c56-9d05-aae0459e5c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:13.900227 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a87c0-ddf3-4c56-9d05-aae0459e5c40 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:13.900685 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a87c0-ddf3-4c56-9d05-aae0459e5c40 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:13.901170 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a87c0-ddf3-4c56-9d05-aae0459e5c40 None admin] PATH_INFO: `/v3/projects/4ab598b3074241ac9c1da0a539adebc9` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:13.903095 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a87c0-ddf3-4c56-9d05-aae0459e5c40 None admin] RBAC: Authorizing `identity:get_project(project_id=4ab598b3074241ac9c1da0a539adebc9)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:13.904778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a87c0-ddf3-4c56-9d05-aae0459e5c40 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:13.906902 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 92/175] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:13 2022] GET /identity/v3/projects/4ab598b3074241ac9c1da0a539adebc9 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:13.907903 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a87c0-ddf3-4c56-9d05-aae0459e5c40 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:13.931471 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:13.988073 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467b56a-dd09-4d92-bb99-7d4239c3f61c None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:14.026277 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739ec14-c7ad-4867-aab7-5895ad95c4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:14.026888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739ec14-c7ad-4867-aab7-5895ad95c4f2 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:14.027164 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739ec14-c7ad-4867-aab7-5895ad95c4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:14.031383 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739ec14-c7ad-4867-aab7-5895ad95c4f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:14.031383 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739ec14-c7ad-4867-aab7-5895ad95c4f2 None admin] RBAC: Adding query filter params (role.id=3654765b6c2644779fda2924f119aef7, scope.project.id=6cbea0e244dd4dcdbed94848ae3aff3c, user.id=0d6402310bab4e4d9246f710d3c2eba1) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:14.031383 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739ec14-c7ad-4867-aab7-5895ad95c4f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:14.031383 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739ec14-c7ad-4867-aab7-5895ad95c4f2 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:14.042353 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 84/176] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:34:13 2022] GET /identity/v3/role_assignments?user.id=0d6402310bab4e4d9246f710d3c2eba1&scope.project.id=6cbea0e244dd4dcdbed94848ae3aff3c&role.id=3654765b6c2644779fda2924f119aef7 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:14.044088 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739ec14-c7ad-4867-aab7-5895ad95c4f2 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:14.122958 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a87c0-ddf3-4c56-9d05-aae0459e5c40 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:14.160887 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f517e-41a2-462c-a3a0-34c9fde0029c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:14.161858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f517e-41a2-462c-a3a0-34c9fde0029c None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:14.162318 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f517e-41a2-462c-a3a0-34c9fde0029c None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:14.162783 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f517e-41a2-462c-a3a0-34c9fde0029c None admin] PATH_INFO: `/v3/users/e0579d90faf74645a2fe0f5b8fcd6761` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:14.164202 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f517e-41a2-462c-a3a0-34c9fde0029c None admin] RBAC: Authorizing `identity:get_user(user_id=e0579d90faf74645a2fe0f5b8fcd6761)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:14.165874 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f517e-41a2-462c-a3a0-34c9fde0029c None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:14.168692 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 93/177] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:13 2022] GET /identity/v3/users/e0579d90faf74645a2fe0f5b8fcd6761 => generated 289 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:14.174444 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f517e-41a2-462c-a3a0-34c9fde0029c None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:14.199496 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:14.212297 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739ec14-c7ad-4867-aab7-5895ad95c4f2 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:14.238716 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:14.288115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f517e-41a2-462c-a3a0-34c9fde0029c None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:14.292048 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c740f-4bcc-4b5c-aa3f-d22c7aed607b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:14.292692 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c740f-4bcc-4b5c-aa3f-d22c7aed607b None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:14.293018 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c740f-4bcc-4b5c-aa3f-d22c7aed607b None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:14.293302 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c740f-4bcc-4b5c-aa3f-d22c7aed607b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:14.294064 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c740f-4bcc-4b5c-aa3f-d22c7aed607b None admin] RBAC: Adding query filter params (role.id=98ffd3c114804da292d7cb33721e9085, scope.project.id=4ab598b3074241ac9c1da0a539adebc9, user.id=f72e2116699d4d6889af55d666d2817d) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:14.294374 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c740f-4bcc-4b5c-aa3f-d22c7aed607b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:14.295911 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c740f-4bcc-4b5c-aa3f-d22c7aed607b None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:14.313813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 85/178] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:34:14 2022] GET /identity/v3/role_assignments?user.id=f72e2116699d4d6889af55d666d2817d&scope.project.id=4ab598b3074241ac9c1da0a539adebc9&role.id=98ffd3c114804da292d7cb33721e9085 => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:14.331985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907267a7-3a38-4b94-b74f-1232b70dc25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:14.333037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907267a7-3a38-4b94-b74f-1232b70dc25f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:14.333539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907267a7-3a38-4b94-b74f-1232b70dc25f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:14.334027 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907267a7-3a38-4b94-b74f-1232b70dc25f None admin] PATH_INFO: `/v3/projects/4ab598b3074241ac9c1da0a539adebc9` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:14.335504 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907267a7-3a38-4b94-b74f-1232b70dc25f None admin] RBAC: Authorizing `identity:get_project(project_id=4ab598b3074241ac9c1da0a539adebc9)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:14.337309 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907267a7-3a38-4b94-b74f-1232b70dc25f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:14.339374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 94/179] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:14 2022] GET /identity/v3/projects/4ab598b3074241ac9c1da0a539adebc9 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:34:14.346079 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c740f-4bcc-4b5c-aa3f-d22c7aed607b None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:14.483649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c740f-4bcc-4b5c-aa3f-d22c7aed607b None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:14.522267 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43228217-276c-4663-ad40-da07f4b695ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:14.523317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43228217-276c-4663-ad40-da07f4b695ed None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:14.523855 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43228217-276c-4663-ad40-da07f4b695ed None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:14.524331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43228217-276c-4663-ad40-da07f4b695ed None admin] PATH_INFO: `/v3/projects/4ab598b3074241ac9c1da0a539adebc9/users/e0579d90faf74645a2fe0f5b8fcd6761/roles/38b6cb84b0e04d4db8dc3ae0793aee31` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:14.526573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43228217-276c-4663-ad40-da07f4b695ed None admin] RBAC: Authorizing `identity:create_grant(project_id=4ab598b3074241ac9c1da0a539adebc9, user_id=e0579d90faf74645a2fe0f5b8fcd6761, role_id=38b6cb84b0e04d4db8dc3ae0793aee31)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:14.528876 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43228217-276c-4663-ad40-da07f4b695ed None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:14.613180 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 86/180] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 1 13:34:14 2022] PUT /identity/v3/projects/4ab598b3074241ac9c1da0a539adebc9/users/e0579d90faf74645a2fe0f5b8fcd6761/roles/38b6cb84b0e04d4db8dc3ae0793aee31 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:34:14.626635 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac33021-aafc-4abe-993f-fd55b74e9864 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:14.627251 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac33021-aafc-4abe-993f-fd55b74e9864 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:14.627811 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac33021-aafc-4abe-993f-fd55b74e9864 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:14.629821 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 95/181] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:14.635253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adc31e-2067-40ee-85fc-d1d04197a9d3 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:14.635896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adc31e-2067-40ee-85fc-d1d04197a9d3 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:14.636369 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adc31e-2067-40ee-85fc-d1d04197a9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:14.661451 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-a4adc31e-2067-40ee-85fc-d1d04197a9d3 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:14.663062 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a4adc31e-2067-40ee-85fc-d1d04197a9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:14.705602 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:14.759897 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 87/182] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:14.873289 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4c9bd-3eaf-4f9c-9066-9c05017dcd8a None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:14.873800 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4c9bd-3eaf-4f9c-9066-9c05017dcd8a None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:14.873978 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4c9bd-3eaf-4f9c-9066-9c05017dcd8a None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:14.875526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 96/183] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:14.881119 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f548791-bc8d-4154-b3d0-ed03a1584c6c None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:14.881612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f548791-bc8d-4154-b3d0-ed03a1584c6c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:14.882027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f548791-bc8d-4154-b3d0-ed03a1584c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:14.895400 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ccff4-9196-4913-ba47-56dbbe7e53d8 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:14.895400 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ccff4-9196-4913-ba47-56dbbe7e53d8 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:14.895400 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ccff4-9196-4913-ba47-56dbbe7e53d8 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:14.896375 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 97/184] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:34:14.901865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76595a-b52d-4076-b1db-129ea581f10b None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:14.902583 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76595a-b52d-4076-b1db-129ea581f10b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:14.903051 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76595a-b52d-4076-b1db-129ea581f10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:14.904265 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-7f548791-bc8d-4154-b3d0-ed03a1584c6c None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:14.905462 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-7f548791-bc8d-4154-b3d0-ed03a1584c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:14.923768 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-3d76595a-b52d-4076-b1db-129ea581f10b None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:14.925317 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-3d76595a-b52d-4076-b1db-129ea581f10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:14.998667 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 88/185] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:34:15.019546 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 98/186] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:34:15.044759 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f548791-bc8d-4154-b3d0-ed03a1584c6c None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:15.147441 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:15.154103 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f548791-bc8d-4154-b3d0-ed03a1584c6c None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:15.190636 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac73908-93cd-4d6d-94fb-955aefbf26e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:15.191871 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac73908-93cd-4d6d-94fb-955aefbf26e6 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:15.192358 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac73908-93cd-4d6d-94fb-955aefbf26e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:15.192834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac73908-93cd-4d6d-94fb-955aefbf26e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:15.203897 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac73908-93cd-4d6d-94fb-955aefbf26e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:15.209106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-8ac73908-93cd-4d6d-94fb-955aefbf26e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:34:15.209106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:15.209106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:15.209106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:15.209106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:15.209106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:15.209106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:15.209106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:15.209106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:15.209106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:15.209106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:15.209106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:15.209106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:15.209106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:15.209106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:15.209106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:15.209956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:15.209956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:15.209956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:15.209956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:15.209956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:15.209956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:15.209956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:15.209956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:15.209956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:15.209956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:15.209956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:15.209956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:15.209956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:15.209956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:15.209956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:15.209956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:15.210711 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:15.210711 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:15.210711 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:15.210711 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:15.210711 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:15.210711 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:15.210711 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:15.210711 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:15.210711 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:15.210711 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:15.210711 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:34:15.210711 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:15.213326 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 89/187] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:34:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:15.221070 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76595a-b52d-4076-b1db-129ea581f10b None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:15.238592 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:15.269201 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac73908-93cd-4d6d-94fb-955aefbf26e6 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:15.335508 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76595a-b52d-4076-b1db-129ea581f10b None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:15.374997 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870e48f-0a50-42cf-b990-5cce6f9a1745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:15.375750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870e48f-0a50-42cf-b990-5cce6f9a1745 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:15.376033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870e48f-0a50-42cf-b990-5cce6f9a1745 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:15.376312 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870e48f-0a50-42cf-b990-5cce6f9a1745 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:15.376983 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870e48f-0a50-42cf-b990-5cce6f9a1745 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:15.377289 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870e48f-0a50-42cf-b990-5cce6f9a1745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:15.378350 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac73908-93cd-4d6d-94fb-955aefbf26e6 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:15.378681 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870e48f-0a50-42cf-b990-5cce6f9a1745 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:15.387934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 99/188] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:15.392601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870e48f-0a50-42cf-b990-5cce6f9a1745 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:15.420424 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd4819-df02-42ce-919a-950dd4ff66d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:15.421060 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd4819-df02-42ce-919a-950dd4ff66d0 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:15.421342 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd4819-df02-42ce-919a-950dd4ff66d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:15.421612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd4819-df02-42ce-919a-950dd4ff66d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:15.422715 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd4819-df02-42ce-919a-950dd4ff66d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:15.424198 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd4819-df02-42ce-919a-950dd4ff66d0 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:15.427389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 90/189] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:34:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:34:15.427389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd4819-df02-42ce-919a-950dd4ff66d0 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:15.453143 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:15.488705 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:15.510397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870e48f-0a50-42cf-b990-5cce6f9a1745 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:15.534399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd4819-df02-42ce-919a-950dd4ff66d0 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:15.550523 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccebd2-c058-481e-9dc6-a759ad7a1fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:15.551177 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccebd2-c058-481e-9dc6-a759ad7a1fd2 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:15.551498 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccebd2-c058-481e-9dc6-a759ad7a1fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:15.551775 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccebd2-c058-481e-9dc6-a759ad7a1fd2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:15.563304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccebd2-c058-481e-9dc6-a759ad7a1fd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:15.568182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-22ccebd2-c058-481e-9dc6-a759ad7a1fd2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:34:15.568182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:15.568182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:15.568182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:15.568182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:15.568182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:15.568182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:15.568182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:15.568182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:15.568182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:15.568182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:15.568182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:15.568182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:15.568182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:15.568182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:15.568182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:15.569036 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:15.569036 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:15.569036 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:15.569036 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:15.569036 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:15.569036 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:15.569036 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:15.569036 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:15.569036 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:15.569036 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:15.569036 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:15.569036 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:15.569036 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:15.569036 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:15.569036 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:15.569036 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:15.569787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:15.569787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:15.569787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:15.569787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:15.569787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:15.569787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:15.569787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:15.569787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:15.569787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:15.569787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:15.569787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:34:15.569787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:15.569787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 100/190] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 1 13:34:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:15.570414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccebd2-c058-481e-9dc6-a759ad7a1fd2 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:15.578022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f155a-a169-42f3-96fe-739a5cc016af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:15.578667 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f155a-a169-42f3-96fe-739a5cc016af None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:15.578947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f155a-a169-42f3-96fe-739a5cc016af None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:15.579217 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f155a-a169-42f3-96fe-739a5cc016af None admin] PATH_INFO: `/v3/users/08fc544caf4844f8bbdbfe8629257406` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:15.595514 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f155a-a169-42f3-96fe-739a5cc016af None admin] RBAC: Authorizing `identity:get_user(user_id=08fc544caf4844f8bbdbfe8629257406)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:15.597032 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f155a-a169-42f3-96fe-739a5cc016af None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:15.603254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 91/191] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:15 2022] GET /identity/v3/users/08fc544caf4844f8bbdbfe8629257406 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:15.603254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f155a-a169-42f3-96fe-739a5cc016af None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:15.680656 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccebd2-c058-481e-9dc6-a759ad7a1fd2 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:15.687813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:15.711806 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f155a-a169-42f3-96fe-739a5cc016af None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:15.717562 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a621d-4acb-4429-889e-3ef3c329ea3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:15.718202 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a621d-4acb-4429-889e-3ef3c329ea3d None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:15.718479 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a621d-4acb-4429-889e-3ef3c329ea3d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:15.718746 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a621d-4acb-4429-889e-3ef3c329ea3d None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:15.719424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a621d-4acb-4429-889e-3ef3c329ea3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:15.720877 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a621d-4acb-4429-889e-3ef3c329ea3d None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:15.733525 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:15.748206 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ede6d-54b4-4925-b742-37ef8e9f19f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:15.748823 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ede6d-54b4-4925-b742-37ef8e9f19f2 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:15.749105 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ede6d-54b4-4925-b742-37ef8e9f19f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:15.749380 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ede6d-54b4-4925-b742-37ef8e9f19f2 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:15.750094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ede6d-54b4-4925-b742-37ef8e9f19f2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:15.750395 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ede6d-54b4-4925-b742-37ef8e9f19f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:15.751823 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ede6d-54b4-4925-b742-37ef8e9f19f2 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:15.760637 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 92/192] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:34:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:15.762419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ede6d-54b4-4925-b742-37ef8e9f19f2 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:15.832913 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 101/193] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 1 13:34:15 2022] POST /identity/v3/users => generated 297 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:34:15.834136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a621d-4acb-4429-889e-3ef3c329ea3d None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:15.896545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ede6d-54b4-4925-b742-37ef8e9f19f2 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:15.944917 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e2008-f97c-441e-b12b-bbc92c7a5b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:15.946095 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e2008-f97c-441e-b12b-bbc92c7a5b0f None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:15.946610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e2008-f97c-441e-b12b-bbc92c7a5b0f None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:15.947091 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e2008-f97c-441e-b12b-bbc92c7a5b0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:15.966200 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:15.994761 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a621d-4acb-4429-889e-3ef3c329ea3d None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:16.031767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769e4e5-1262-44d2-a77d-bded0b4e97ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:16.033039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769e4e5-1262-44d2-a77d-bded0b4e97ae None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:16.033039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769e4e5-1262-44d2-a77d-bded0b4e97ae None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:16.033039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769e4e5-1262-44d2-a77d-bded0b4e97ae None admin] PATH_INFO: `/v3/users/08fc544caf4844f8bbdbfe8629257406` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:16.034127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4769e4e5-1262-44d2-a77d-bded0b4e97ae None admin] RBAC: Authorizing `identity:get_user(user_id=08fc544caf4844f8bbdbfe8629257406)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:16.035877 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4769e4e5-1262-44d2-a77d-bded0b4e97ae None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:16.037495 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 102/194] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:15 2022] GET /identity/v3/users/08fc544caf4844f8bbdbfe8629257406 => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:16.039779 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e2008-f97c-441e-b12b-bbc92c7a5b0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:16.041251 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e2008-f97c-441e-b12b-bbc92c7a5b0f None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:16.044468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769e4e5-1262-44d2-a77d-bded0b4e97ae None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:16.130413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:16.186641 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769e4e5-1262-44d2-a77d-bded0b4e97ae None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:16.187315 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 93/195] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:16.194776 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e2008-f97c-441e-b12b-bbc92c7a5b0f None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:16.237912 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191ac26-8b04-409a-ad8d-e05f841cefa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:16.238680 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191ac26-8b04-409a-ad8d-e05f841cefa1 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:16.238971 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191ac26-8b04-409a-ad8d-e05f841cefa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:16.239250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191ac26-8b04-409a-ad8d-e05f841cefa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:16.258670 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:16.324426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191ac26-8b04-409a-ad8d-e05f841cefa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:16.327085 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191ac26-8b04-409a-ad8d-e05f841cefa1 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:16.330147 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e2008-f97c-441e-b12b-bbc92c7a5b0f None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:16.369958 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039cb10-4a9a-439d-afc4-57fb05c1df3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:16.370712 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039cb10-4a9a-439d-afc4-57fb05c1df3d None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:16.370943 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039cb10-4a9a-439d-afc4-57fb05c1df3d None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:16.371252 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039cb10-4a9a-439d-afc4-57fb05c1df3d None admin] PATH_INFO: `/v3/projects/3e8cca114ed04209a31e58f224967b4a` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:16.373408 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039cb10-4a9a-439d-afc4-57fb05c1df3d None admin] RBAC: Authorizing `identity:get_project(project_id=3e8cca114ed04209a31e58f224967b4a)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:16.374889 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039cb10-4a9a-439d-afc4-57fb05c1df3d None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:16.376951 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 94/196] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:16 2022] GET /identity/v3/projects/3e8cca114ed04209a31e58f224967b4a => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:16.383771 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039cb10-4a9a-439d-afc4-57fb05c1df3d None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:16.410049 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:16.464178 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 103/197] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:16.468069 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191ac26-8b04-409a-ad8d-e05f841cefa1 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:16.589902 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191ac26-8b04-409a-ad8d-e05f841cefa1 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:16.628075 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039cb10-4a9a-439d-afc4-57fb05c1df3d None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:16.629957 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262f1e4-34dc-4978-b3e7-f961d88a55a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:16.630923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262f1e4-34dc-4978-b3e7-f961d88a55a3 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:16.631448 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262f1e4-34dc-4978-b3e7-f961d88a55a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:16.631898 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262f1e4-34dc-4978-b3e7-f961d88a55a3 None admin] PATH_INFO: `/v3/projects/3e8cca114ed04209a31e58f224967b4a` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:16.633300 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262f1e4-34dc-4978-b3e7-f961d88a55a3 None admin] RBAC: Authorizing `identity:get_project(project_id=3e8cca114ed04209a31e58f224967b4a)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:16.634966 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262f1e4-34dc-4978-b3e7-f961d88a55a3 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:16.642453 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 104/198] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:16 2022] GET /identity/v3/projects/3e8cca114ed04209a31e58f224967b4a => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:16.644119 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262f1e4-34dc-4978-b3e7-f961d88a55a3 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:16.651285 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:16.680260 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:16.702337 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a06542-f3e1-4701-956c-0f39ab808fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:16.703031 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a06542-f3e1-4701-956c-0f39ab808fd0 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:16.703320 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a06542-f3e1-4701-956c-0f39ab808fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:16.703621 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a06542-f3e1-4701-956c-0f39ab808fd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:16.704376 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a06542-f3e1-4701-956c-0f39ab808fd0 None admin] RBAC: Adding query filter params (role.id=98ffd3c114804da292d7cb33721e9085, scope.project.id=3e8cca114ed04209a31e58f224967b4a, user.id=08fc544caf4844f8bbdbfe8629257406) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:16.704686 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a06542-f3e1-4701-956c-0f39ab808fd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:16.706181 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a06542-f3e1-4701-956c-0f39ab808fd0 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:16.725056 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 95/199] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:34:16 2022] GET /identity/v3/role_assignments?user.id=08fc544caf4844f8bbdbfe8629257406&scope.project.id=3e8cca114ed04209a31e58f224967b4a&role.id=98ffd3c114804da292d7cb33721e9085 => generated 259 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:34:16.725056 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7ab24-606b-450b-a9c4-94731fdee91d None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:16.725056 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7ab24-606b-450b-a9c4-94731fdee91d None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:16.725056 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7ab24-606b-450b-a9c4-94731fdee91d None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:16.725056 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 96/200] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:16.735285 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdca96f-acf4-4030-ac40-8723b301a6a3 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:16.735934 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdca96f-acf4-4030-ac40-8723b301a6a3 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:16.736501 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdca96f-acf4-4030-ac40-8723b301a6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:16.760720 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-dbdca96f-acf4-4030-ac40-8723b301a6a3 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:16.762656 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-dbdca96f-acf4-4030-ac40-8723b301a6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:16.845449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262f1e4-34dc-4978-b3e7-f961d88a55a3 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:16.871106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 97/201] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:16.941318 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae00fcc-df8a-4285-a14b-5b4cf1211b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:16.942016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae00fcc-df8a-4285-a14b-5b4cf1211b94 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:16.942295 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae00fcc-df8a-4285-a14b-5b4cf1211b94 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:16.942565 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae00fcc-df8a-4285-a14b-5b4cf1211b94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:16.943320 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae00fcc-df8a-4285-a14b-5b4cf1211b94 None admin] RBAC: Adding query filter params (role.id=f0d2493c03664449802df928b8e8fa53, scope.project.id=3e8cca114ed04209a31e58f224967b4a, user.id=08fc544caf4844f8bbdbfe8629257406) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:16.943653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae00fcc-df8a-4285-a14b-5b4cf1211b94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:16.945155 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae00fcc-df8a-4285-a14b-5b4cf1211b94 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:16.956378 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 105/202] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:34:16 2022] GET /identity/v3/role_assignments?user.id=08fc544caf4844f8bbdbfe8629257406&scope.project.id=3e8cca114ed04209a31e58f224967b4a&role.id=f0d2493c03664449802df928b8e8fa53 => generated 259 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:34:17.174099 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdca96f-acf4-4030-ac40-8723b301a6a3 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:17.327435 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdca96f-acf4-4030-ac40-8723b301a6a3 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:17.338101 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:17.373325 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082cd5a-333b-4f78-9d9d-9d438501b5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:17.373975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082cd5a-333b-4f78-9d9d-9d438501b5ba None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:17.374255 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082cd5a-333b-4f78-9d9d-9d438501b5ba None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:17.374527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082cd5a-333b-4f78-9d9d-9d438501b5ba None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:17.394884 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082cd5a-333b-4f78-9d9d-9d438501b5ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:17.399846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-f082cd5a-333b-4f78-9d9d-9d438501b5ba None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:34:17.399846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:17.399846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:17.399846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:17.399846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:17.399846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:17.399846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:17.399846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:17.399846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:17.399846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:17.399846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:17.399846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:17.399846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:17.399846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:17.399846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:17.399846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:17.400896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:17.400896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:17.400896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:17.400896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:17.400896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:17.400896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:17.400896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:17.400896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:17.400896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:17.400896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:17.400896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:17.400896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:17.400896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:17.400896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:17.400896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:17.400896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:17.401645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:17.401645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:17.401645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:17.401645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:17.401645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:17.401645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:17.401645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:17.401645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:17.401645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:17.401645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:17.401645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:34:17.401645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:17.401645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 98/203] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:17.408708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae00fcc-df8a-4285-a14b-5b4cf1211b94 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:17.558184 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:17.565965 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae00fcc-df8a-4285-a14b-5b4cf1211b94 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:17.621605 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107e9e8-bb51-4f07-a1eb-1ee49f5d0589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:17.622587 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107e9e8-bb51-4f07-a1eb-1ee49f5d0589 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:17.623126 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107e9e8-bb51-4f07-a1eb-1ee49f5d0589 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:17.623626 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107e9e8-bb51-4f07-a1eb-1ee49f5d0589 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:17.624538 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107e9e8-bb51-4f07-a1eb-1ee49f5d0589 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:17.625043 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107e9e8-bb51-4f07-a1eb-1ee49f5d0589 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:17.626640 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107e9e8-bb51-4f07-a1eb-1ee49f5d0589 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:17.636261 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 106/204] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 1 13:34:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:17.644485 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082cd5a-333b-4f78-9d9d-9d438501b5ba None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:17.774831 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082cd5a-333b-4f78-9d9d-9d438501b5ba None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:17.822599 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31ec84-b608-444e-8156-7f4940a917e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:17.823591 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31ec84-b608-444e-8156-7f4940a917e4 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:17.824121 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31ec84-b608-444e-8156-7f4940a917e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:17.824592 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31ec84-b608-444e-8156-7f4940a917e4 None admin] PATH_INFO: `/v3/users/e0579d90faf74645a2fe0f5b8fcd6761` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:17.825915 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31ec84-b608-444e-8156-7f4940a917e4 None admin] RBAC: Authorizing `identity:get_user(user_id=e0579d90faf74645a2fe0f5b8fcd6761)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:17.827586 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31ec84-b608-444e-8156-7f4940a917e4 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:17.829376 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 99/205] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:17 2022] GET /identity/v3/users/e0579d90faf74645a2fe0f5b8fcd6761 => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:17.835400 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107e9e8-bb51-4f07-a1eb-1ee49f5d0589 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:17.969285 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107e9e8-bb51-4f07-a1eb-1ee49f5d0589 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:18.005451 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a9784-dac0-45c5-a355-8b84619e3f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:18.006061 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a9784-dac0-45c5-a355-8b84619e3f7e None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:18.006341 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a9784-dac0-45c5-a355-8b84619e3f7e None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:18.006613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a9784-dac0-45c5-a355-8b84619e3f7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:18.035934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:18.078324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a9784-dac0-45c5-a355-8b84619e3f7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:18.079767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a9784-dac0-45c5-a355-8b84619e3f7e None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:18.171432 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7027f24-2dc3-4e0f-ab5b-a6c75440d4e0 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:18.171781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7027f24-2dc3-4e0f-ab5b-a6c75440d4e0 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:18.172004 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7027f24-2dc3-4e0f-ab5b-a6c75440d4e0 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:18.173622 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 100/206] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:34:18.178489 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec282b88-39b3-49e3-bb4c-071375d35733 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:18.178781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec282b88-39b3-49e3-bb4c-071375d35733 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:18.179056 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec282b88-39b3-49e3-bb4c-071375d35733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:18.203381 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-ec282b88-39b3-49e3-bb4c-071375d35733 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:18.204581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ec282b88-39b3-49e3-bb4c-071375d35733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:18.224363 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 107/207] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:18.229992 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a9784-dac0-45c5-a355-8b84619e3f7e None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:18.250595 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:18.293834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 101/208] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:18.340992 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:18.400563 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a9784-dac0-45c5-a355-8b84619e3f7e None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:18.453504 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd251f-4285-4957-935b-cc905991b490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:18.454126 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd251f-4285-4957-935b-cc905991b490 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:18.454409 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd251f-4285-4957-935b-cc905991b490 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:18.454688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd251f-4285-4957-935b-cc905991b490 None admin] PATH_INFO: `/v3/projects/4ab598b3074241ac9c1da0a539adebc9` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:18.455936 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd251f-4285-4957-935b-cc905991b490 None admin] RBAC: Authorizing `identity:get_project(project_id=4ab598b3074241ac9c1da0a539adebc9)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:18.457411 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd251f-4285-4957-935b-cc905991b490 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:18.459221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 108/209] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:18 2022] GET /identity/v3/projects/4ab598b3074241ac9c1da0a539adebc9 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:34:18.464981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec282b88-39b3-49e3-bb4c-071375d35733 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:18.600176 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec282b88-39b3-49e3-bb4c-071375d35733 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:18.618270 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43d0f2-b26e-401c-80bf-87f8e2bf62d0 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:18.618553 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43d0f2-b26e-401c-80bf-87f8e2bf62d0 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:18.618834 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43d0f2-b26e-401c-80bf-87f8e2bf62d0 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:18.620470 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 109/210] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:18.626330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5a9f9-3949-4cc4-a09b-94046bf7a43d None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:18.626622 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5a9f9-3949-4cc4-a09b-94046bf7a43d None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:18.626901 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5a9f9-3949-4cc4-a09b-94046bf7a43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:18.638585 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989793de-9acd-4434-844b-2ffb554ca164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:18.639540 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989793de-9acd-4434-844b-2ffb554ca164 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:18.640020 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989793de-9acd-4434-844b-2ffb554ca164 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:18.640490 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989793de-9acd-4434-844b-2ffb554ca164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:18.641418 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989793de-9acd-4434-844b-2ffb554ca164 None admin] RBAC: Adding query filter params (role.id=38b6cb84b0e04d4db8dc3ae0793aee31, scope.project.id=4ab598b3074241ac9c1da0a539adebc9, user.id=e0579d90faf74645a2fe0f5b8fcd6761) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:18.641904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989793de-9acd-4434-844b-2ffb554ca164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:18.643549 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989793de-9acd-4434-844b-2ffb554ca164 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:18.647546 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-fcc5a9f9-3949-4cc4-a09b-94046bf7a43d None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:18.648818 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-fcc5a9f9-3949-4cc4-a09b-94046bf7a43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:18.650350 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 102/211] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:34:18 2022] GET /identity/v3/role_assignments?user.id=e0579d90faf74645a2fe0f5b8fcd6761&scope.project.id=4ab598b3074241ac9c1da0a539adebc9&role.id=38b6cb84b0e04d4db8dc3ae0793aee31 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:18.651289 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989793de-9acd-4434-844b-2ffb554ca164 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:18.681814 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:18.762247 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989793de-9acd-4434-844b-2ffb554ca164 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:18.802461 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5af9f-2734-4b98-9213-b2e90c280c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:18.803911 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5af9f-2734-4b98-9213-b2e90c280c80 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:18.804370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5af9f-2734-4b98-9213-b2e90c280c80 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:18.805165 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5af9f-2734-4b98-9213-b2e90c280c80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:18.818518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5af9f-2734-4b98-9213-b2e90c280c80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:18.823924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-adb5af9f-2734-4b98-9213-b2e90c280c80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:18.823924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:18.823924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:18.823924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:18.823924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:18.823924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:18.823924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:18.823924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:18.823924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:18.823924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:18.823924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:18.823924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:18.823924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:18.823924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:18.823924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:18.823924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:18.824812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:18.824812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:18.824812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:18.824812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:18.824812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:18.824812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:18.824812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:18.824812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:18.824812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:18.824812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:18.824812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:18.824812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:18.824812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:18.824812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:18.824812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:18.824812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:18.825558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:18.825558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:18.825558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:18.825558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:18.825558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:18.825558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:18.825558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:18.825558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:18.825558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:18.825558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:18.825558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:18.825558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:18.828354 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 103/212] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:18.836932 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5af9f-2734-4b98-9213-b2e90c280c80 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:18.848051 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 110/213] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:34:18.948277 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:18.957104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5af9f-2734-4b98-9213-b2e90c280c80 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:18.999546 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ac905-9559-496d-afcb-6b9111ef822b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:19.000495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ac905-9559-496d-afcb-6b9111ef822b None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:19.000952 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ac905-9559-496d-afcb-6b9111ef822b None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:19.001395 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ac905-9559-496d-afcb-6b9111ef822b None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:19.002241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ac905-9559-496d-afcb-6b9111ef822b None admin] RBAC: Adding query filter params (name=member) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:19.002729 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ac905-9559-496d-afcb-6b9111ef822b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:19.004316 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ac905-9559-496d-afcb-6b9111ef822b None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:19.020182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5a9f9-3949-4cc4-a09b-94046bf7a43d None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:19.021191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 104/214] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 1 13:34:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:19.086552 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:19.132441 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5a9f9-3949-4cc4-a09b-94046bf7a43d None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:19.158262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ac905-9559-496d-afcb-6b9111ef822b None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:19.181746 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297e66f-2cf6-405e-a672-886fb4d41261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:19.182740 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297e66f-2cf6-405e-a672-886fb4d41261 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:19.183452 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297e66f-2cf6-405e-a672-886fb4d41261 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:19.183903 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297e66f-2cf6-405e-a672-886fb4d41261 None admin] PATH_INFO: `/v3/users/ce0b457ca9254746bee8de8612e9574c` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:19.206325 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297e66f-2cf6-405e-a672-886fb4d41261 None admin] RBAC: Authorizing `identity:get_user(user_id=ce0b457ca9254746bee8de8612e9574c)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:19.206325 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297e66f-2cf6-405e-a672-886fb4d41261 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:19.208386 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 111/215] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:19 2022] GET /identity/v3/users/ce0b457ca9254746bee8de8612e9574c => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:19.216465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297e66f-2cf6-405e-a672-886fb4d41261 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:19.283373 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ac905-9559-496d-afcb-6b9111ef822b None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:19.318650 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060b977-3b47-4ad2-a762-bbbaf3410bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:19.319320 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060b977-3b47-4ad2-a762-bbbaf3410bfd None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:19.319630 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060b977-3b47-4ad2-a762-bbbaf3410bfd None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:19.319900 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060b977-3b47-4ad2-a762-bbbaf3410bfd None admin] PATH_INFO: `/v3/domains/default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:19.321003 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060b977-3b47-4ad2-a762-bbbaf3410bfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:19.322449 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060b977-3b47-4ad2-a762-bbbaf3410bfd None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:19.324931 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297e66f-2cf6-405e-a672-886fb4d41261 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:19.328744 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 105/216] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:34:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:19.329729 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060b977-3b47-4ad2-a762-bbbaf3410bfd None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:19.349961 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:19.361639 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:19.366124 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed5c93-5a92-4988-b2e9-df00a2532baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:19.366902 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed5c93-5a92-4988-b2e9-df00a2532baa None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:19.367323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed5c93-5a92-4988-b2e9-df00a2532baa None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:19.367911 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed5c93-5a92-4988-b2e9-df00a2532baa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:19.446137 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060b977-3b47-4ad2-a762-bbbaf3410bfd None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:19.452777 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed5c93-5a92-4988-b2e9-df00a2532baa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:19.454338 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed5c93-5a92-4988-b2e9-df00a2532baa None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:19.481576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c2493-99f3-4805-86ee-28cf5c885d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:19.482112 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c2493-99f3-4805-86ee-28cf5c885d86 None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:19.482388 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c2493-99f3-4805-86ee-28cf5c885d86 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:19.482908 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c2493-99f3-4805-86ee-28cf5c885d86 None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:19.483588 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c2493-99f3-4805-86ee-28cf5c885d86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:19.485022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c2493-99f3-4805-86ee-28cf5c885d86 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:19.552590 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 112/217] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:19.553838 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b0935-f2bb-4b03-bc7e-6f912026d6ca None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:19.554122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b0935-f2bb-4b03-bc7e-6f912026d6ca None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:19.554394 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b0935-f2bb-4b03-bc7e-6f912026d6ca None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:19.555671 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 113/218] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:19.556677 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0f1c9-3413-439c-a10c-4f688f1442ba None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:19.556959 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0f1c9-3413-439c-a10c-4f688f1442ba None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:19.561949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0f1c9-3413-439c-a10c-4f688f1442ba None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:19.561949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 114/219] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:19.561949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0f1c9-3413-439c-a10c-4f688f1442ba None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:19.575281 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:19.583752 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 106/220] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 1 13:34:19 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:34:19.585214 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d7a89-89bf-4a9d-a2b4-42ac3cc3ab3a None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:19.585505 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d7a89-89bf-4a9d-a2b4-42ac3cc3ab3a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:19.586024 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d7a89-89bf-4a9d-a2b4-42ac3cc3ab3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:19.607759 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-8d4d7a89-89bf-4a9d-a2b4-42ac3cc3ab3a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:19.609206 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-8d4d7a89-89bf-4a9d-a2b4-42ac3cc3ab3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:19.681791 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0f1c9-3413-439c-a10c-4f688f1442ba None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:19.691035 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 107/221] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:19.704968 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ef7bb-766b-402f-90c7-ee6fd4934788 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:19.705299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ef7bb-766b-402f-90c7-ee6fd4934788 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:19.705618 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ef7bb-766b-402f-90c7-ee6fd4934788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:19.721039 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:19.733617 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-8b6ef7bb-766b-402f-90c7-ee6fd4934788 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:19.733791 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a61d82-c5e4-4656-b37a-d5b8d7d2d6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:19.733919 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-8b6ef7bb-766b-402f-90c7-ee6fd4934788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:19.735320 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a61d82-c5e4-4656-b37a-d5b8d7d2d6b6 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:19.735773 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a61d82-c5e4-4656-b37a-d5b8d7d2d6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:19.736512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a61d82-c5e4-4656-b37a-d5b8d7d2d6b6 None admin] PATH_INFO: `/v3/projects/3e8cca114ed04209a31e58f224967b4a` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:19.738793 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a61d82-c5e4-4656-b37a-d5b8d7d2d6b6 None admin] RBAC: Authorizing `identity:get_project(project_id=3e8cca114ed04209a31e58f224967b4a)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:19.740522 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a61d82-c5e4-4656-b37a-d5b8d7d2d6b6 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:19.742748 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 115/222] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:19 2022] GET /identity/v3/projects/3e8cca114ed04209a31e58f224967b4a => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:19.748505 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a61d82-c5e4-4656-b37a-d5b8d7d2d6b6 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:19.822409 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 108/223] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:19.866994 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:19.890028 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a61d82-c5e4-4656-b37a-d5b8d7d2d6b6 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:19.928931 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628515c4-7bf2-42fc-b463-e8ae9fdcf355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:19.929542 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628515c4-7bf2-42fc-b463-e8ae9fdcf355 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:19.929816 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628515c4-7bf2-42fc-b463-e8ae9fdcf355 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:19.930084 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628515c4-7bf2-42fc-b463-e8ae9fdcf355 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:19.930814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628515c4-7bf2-42fc-b463-e8ae9fdcf355 None admin] RBAC: Adding query filter params (role.id=3654765b6c2644779fda2924f119aef7, scope.project.id=3e8cca114ed04209a31e58f224967b4a, user.id=ce0b457ca9254746bee8de8612e9574c) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:19.931114 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628515c4-7bf2-42fc-b463-e8ae9fdcf355 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:19.932655 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628515c4-7bf2-42fc-b463-e8ae9fdcf355 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:19.939451 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 116/224] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:34:19 2022] GET /identity/v3/role_assignments?user.id=ce0b457ca9254746bee8de8612e9574c&scope.project.id=3e8cca114ed04209a31e58f224967b4a&role.id=3654765b6c2644779fda2924f119aef7 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:34:19.981012 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ef7bb-766b-402f-90c7-ee6fd4934788 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:20.111616 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ef7bb-766b-402f-90c7-ee6fd4934788 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:20.114553 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628515c4-7bf2-42fc-b463-e8ae9fdcf355 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:20.149515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee45a73-bb05-4810-8fbc-bf180f08cab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:20.150243 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee45a73-bb05-4810-8fbc-bf180f08cab1 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:20.150489 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee45a73-bb05-4810-8fbc-bf180f08cab1 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:20.150844 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee45a73-bb05-4810-8fbc-bf180f08cab1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:20.153235 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:20.163243 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee45a73-bb05-4810-8fbc-bf180f08cab1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:20.168447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-cee45a73-bb05-4810-8fbc-bf180f08cab1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:34:20.168447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:20.168447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:20.168447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:20.168447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:20.168447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:20.168447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:20.168447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:20.168447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:20.168447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:20.168447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:20.168447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:20.168447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:20.168447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:20.168447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:20.168447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:20.169519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:20.169519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:20.169519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:20.169519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:20.169519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:20.169519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:20.169519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:20.169519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:20.169519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:20.169519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:20.169519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:20.169519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:20.169519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:20.169519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:20.169519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:20.169519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:20.170347 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:20.170347 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:20.170347 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:20.170347 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:20.170347 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:20.170347 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:20.170347 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:20.170347 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:20.170347 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:20.170347 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:20.170347 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:34:20.170347 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:20.170347 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 109/225] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:34:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:20.175998 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee45a73-bb05-4810-8fbc-bf180f08cab1 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:20.292870 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628515c4-7bf2-42fc-b463-e8ae9fdcf355 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:20.336521 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cae72b-e854-4061-baee-b7152e3e2082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:20.338712 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cae72b-e854-4061-baee-b7152e3e2082 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:20.339200 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cae72b-e854-4061-baee-b7152e3e2082 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:20.340237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cae72b-e854-4061-baee-b7152e3e2082 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:20.344838 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee45a73-bb05-4810-8fbc-bf180f08cab1 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:20.365252 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cae72b-e854-4061-baee-b7152e3e2082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:20.372694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-a6cae72b-e854-4061-baee-b7152e3e2082 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:34:20.372694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:20.372694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:20.372694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:20.372694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:20.372694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:20.372694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:20.372694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:20.372694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:20.372694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:20.372694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:20.372694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:20.372694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:20.372694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:20.372694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:20.372694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:20.373601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:20.373601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:20.373601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:20.373601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:20.373601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:20.373601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:20.373601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:20.373601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:20.373601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:20.373601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:20.373601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:20.373601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:20.373601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:20.373601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:20.373601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:20.373601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:20.374367 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:20.374367 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:20.374367 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:20.374367 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:20.374367 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:20.374367 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:20.374367 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:20.374367 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:20.374367 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:20.374367 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:20.374367 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:34:20.374367 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:20.377359 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 117/226] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 1 13:34:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:34:20.383691 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cae72b-e854-4061-baee-b7152e3e2082 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:20.393806 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:20.439861 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a7a96-7a41-4948-ad81-8e827fe5cbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:20.440483 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a7a96-7a41-4948-ad81-8e827fe5cbfe None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:20.440761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a7a96-7a41-4948-ad81-8e827fe5cbfe None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:20.441032 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a7a96-7a41-4948-ad81-8e827fe5cbfe None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:20.441919 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a7a96-7a41-4948-ad81-8e827fe5cbfe None admin] RBAC: Adding query filter params (name=admin) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:20.442224 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a7a96-7a41-4948-ad81-8e827fe5cbfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:20.443641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a7a96-7a41-4948-ad81-8e827fe5cbfe None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:20.473325 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 110/227] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:20.478792 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a7a96-7a41-4948-ad81-8e827fe5cbfe None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:20.501672 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cae72b-e854-4061-baee-b7152e3e2082 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:20.546707 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:20.547817 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87182029-c152-4a58-bb02-1975196326f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:20.548434 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87182029-c152-4a58-bb02-1975196326f3 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:20.548710 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87182029-c152-4a58-bb02-1975196326f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:20.548980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87182029-c152-4a58-bb02-1975196326f3 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:20.549644 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87182029-c152-4a58-bb02-1975196326f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:20.549944 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87182029-c152-4a58-bb02-1975196326f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:20.551340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87182029-c152-4a58-bb02-1975196326f3 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:20.577897 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 118/228] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:34:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:20.586073 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87182029-c152-4a58-bb02-1975196326f3 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:20.649649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a7a96-7a41-4948-ad81-8e827fe5cbfe None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:20.727194 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:20.730957 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea2ba9-31bc-457a-b7aa-c9211bdd31ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:20.731628 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea2ba9-31bc-457a-b7aa-c9211bdd31ac None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:20.731903 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea2ba9-31bc-457a-b7aa-c9211bdd31ac None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:20.732172 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea2ba9-31bc-457a-b7aa-c9211bdd31ac None admin] PATH_INFO: `/v3/users/08fc544caf4844f8bbdbfe8629257406` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:20.738561 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea2ba9-31bc-457a-b7aa-c9211bdd31ac None admin] RBAC: Authorizing `identity:get_user(user_id=08fc544caf4844f8bbdbfe8629257406)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:20.742698 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea2ba9-31bc-457a-b7aa-c9211bdd31ac None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:20.744510 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 111/229] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:20 2022] GET /identity/v3/users/08fc544caf4844f8bbdbfe8629257406 => generated 283 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:34:20.750718 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea2ba9-31bc-457a-b7aa-c9211bdd31ac None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:20.800659 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87182029-c152-4a58-bb02-1975196326f3 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:20.857168 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63297df6-96f5-4991-907a-2b959e8ead61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:20.858311 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63297df6-96f5-4991-907a-2b959e8ead61 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:20.858762 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63297df6-96f5-4991-907a-2b959e8ead61 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:20.859235 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63297df6-96f5-4991-907a-2b959e8ead61 None admin] PATH_INFO: `/v3/users/08fc544caf4844f8bbdbfe8629257406` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:20.861920 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63297df6-96f5-4991-907a-2b959e8ead61 None admin] RBAC: Authorizing `identity:get_user(user_id=08fc544caf4844f8bbdbfe8629257406)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:20.863612 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63297df6-96f5-4991-907a-2b959e8ead61 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:20.871436 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 119/230] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:20 2022] GET /identity/v3/users/08fc544caf4844f8bbdbfe8629257406 => generated 283 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:20.877151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63297df6-96f5-4991-907a-2b959e8ead61 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:21.014149 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea2ba9-31bc-457a-b7aa-c9211bdd31ac None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:21.026014 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63297df6-96f5-4991-907a-2b959e8ead61 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:21.075879 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856aab5-83d2-43b6-897f-6c9a6504bc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:21.076521 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856aab5-83d2-43b6-897f-6c9a6504bc1c None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:21.076801 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856aab5-83d2-43b6-897f-6c9a6504bc1c None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:21.077065 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856aab5-83d2-43b6-897f-6c9a6504bc1c None admin] PATH_INFO: `/v3/projects/3e8cca114ed04209a31e58f224967b4a` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:21.079605 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856aab5-83d2-43b6-897f-6c9a6504bc1c None admin] RBAC: Authorizing `identity:get_project(project_id=3e8cca114ed04209a31e58f224967b4a)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:21.081103 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856aab5-83d2-43b6-897f-6c9a6504bc1c None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:21.082836 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 120/231] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:20 2022] GET /identity/v3/projects/3e8cca114ed04209a31e58f224967b4a => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:21.091639 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856aab5-83d2-43b6-897f-6c9a6504bc1c None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:21.094873 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:21.098886 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:21.112835 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbc544-8bc5-480b-b863-af75617e046a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:21.113499 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbc544-8bc5-480b-b863-af75617e046a None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:21.113781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbc544-8bc5-480b-b863-af75617e046a None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:21.114059 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbc544-8bc5-480b-b863-af75617e046a None admin] PATH_INFO: `/v3/projects/3e8cca114ed04209a31e58f224967b4a` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:21.117447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbc544-8bc5-480b-b863-af75617e046a None admin] RBAC: Authorizing `identity:get_project(project_id=3e8cca114ed04209a31e58f224967b4a)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:21.118981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbc544-8bc5-480b-b863-af75617e046a None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:21.121399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 112/232] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:20 2022] GET /identity/v3/projects/3e8cca114ed04209a31e58f224967b4a => generated 302 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:34:21.132423 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbc544-8bc5-480b-b863-af75617e046a None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:21.222232 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856aab5-83d2-43b6-897f-6c9a6504bc1c None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:21.259147 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3e49a-a978-4932-81a5-3b92349494da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:21.259948 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3e49a-a978-4932-81a5-3b92349494da None admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:21.260229 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3e49a-a978-4932-81a5-3b92349494da None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:21.260502 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3e49a-a978-4932-81a5-3b92349494da None admin] PATH_INFO: `/v3/projects/3e8cca114ed04209a31e58f224967b4a/users/08fc544caf4844f8bbdbfe8629257406/roles/f0d2493c03664449802df928b8e8fa53` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:21.262748 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3e49a-a978-4932-81a5-3b92349494da None admin] RBAC: Authorizing `identity:create_grant(project_id=3e8cca114ed04209a31e58f224967b4a, user_id=08fc544caf4844f8bbdbfe8629257406, role_id=f0d2493c03664449802df928b8e8fa53)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:21.264477 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3e49a-a978-4932-81a5-3b92349494da None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:21.316268 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbc544-8bc5-480b-b863-af75617e046a None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:21.349567 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 121/233] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 1 13:34:21 2022] PUT /identity/v3/projects/3e8cca114ed04209a31e58f224967b4a/users/08fc544caf4844f8bbdbfe8629257406/roles/f0d2493c03664449802df928b8e8fa53 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:34:21.365842 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d767d6-d82d-4ddf-85ef-c0a93dc3edcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:21.366513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d767d6-d82d-4ddf-85ef-c0a93dc3edcd None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:21.366881 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d767d6-d82d-4ddf-85ef-c0a93dc3edcd None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:21.367157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d767d6-d82d-4ddf-85ef-c0a93dc3edcd None admin] PATH_INFO: `/v3/projects/3e8cca114ed04209a31e58f224967b4a/users/08fc544caf4844f8bbdbfe8629257406/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:21.369262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d767d6-d82d-4ddf-85ef-c0a93dc3edcd None admin] RBAC: Authorizing `identity:create_grant(project_id=3e8cca114ed04209a31e58f224967b4a, user_id=08fc544caf4844f8bbdbfe8629257406, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:21.371443 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d767d6-d82d-4ddf-85ef-c0a93dc3edcd None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:21.456097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 113/234] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 1 13:34:21 2022] PUT /identity/v3/projects/3e8cca114ed04209a31e58f224967b4a/users/08fc544caf4844f8bbdbfe8629257406/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:34:22.120332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a868387-9dc1-4967-b0ba-2034da18d00b None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:22.120841 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a868387-9dc1-4967-b0ba-2034da18d00b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:22.120841 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a868387-9dc1-4967-b0ba-2034da18d00b None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:22.122639 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 122/235] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:22.135168 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24d9c3-cbdb-48e6-b56e-5f49cee88f52 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:22.135688 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24d9c3-cbdb-48e6-b56e-5f49cee88f52 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:22.135759 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24d9c3-cbdb-48e6-b56e-5f49cee88f52 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:22.137943 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 114/236] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:22.140429 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda9860-eb9c-4b06-822f-1b5d2cdbb065 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:22.140707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda9860-eb9c-4b06-822f-1b5d2cdbb065 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:22.140977 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda9860-eb9c-4b06-822f-1b5d2cdbb065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:22.159960 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b8960-fcf1-49af-a23a-c4b0f8a68896 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:22.160255 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b8960-fcf1-49af-a23a-c4b0f8a68896 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:22.160496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b8960-fcf1-49af-a23a-c4b0f8a68896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:22.176853 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-ebda9860-eb9c-4b06-822f-1b5d2cdbb065 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:22.178200 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-ebda9860-eb9c-4b06-822f-1b5d2cdbb065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:22.192262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-387b8960-fcf1-49af-a23a-c4b0f8a68896 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:22.193795 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-387b8960-fcf1-49af-a23a-c4b0f8a68896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:22.247888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:22.251207 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:22.261890 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 123/237] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:22.261890 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc94ade-40b2-4395-be57-2ef056039ca2 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:22.262236 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc94ade-40b2-4395-be57-2ef056039ca2 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:22.262433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc94ade-40b2-4395-be57-2ef056039ca2 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:22.267527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 124/238] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:22.278581 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a87a7f-e2d3-4132-912a-748e4bb417b9 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:22.278855 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a87a7f-e2d3-4132-912a-748e4bb417b9 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:22.279132 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a87a7f-e2d3-4132-912a-748e4bb417b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:22.299906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 115/239] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:34:22.313525 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-a7a87a7f-e2d3-4132-912a-748e4bb417b9 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:22.314727 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a7a87a7f-e2d3-4132-912a-748e4bb417b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:22.413897 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 125/240] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:22.530998 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b8960-fcf1-49af-a23a-c4b0f8a68896 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:22.654368 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b8960-fcf1-49af-a23a-c4b0f8a68896 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:22.706964 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb547b1-7984-4b2c-8973-e801cac6a10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:22.707557 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb547b1-7984-4b2c-8973-e801cac6a10a None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:22.707839 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb547b1-7984-4b2c-8973-e801cac6a10a None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:22.708109 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb547b1-7984-4b2c-8973-e801cac6a10a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:22.722036 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb547b1-7984-4b2c-8973-e801cac6a10a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:22.726811 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-efb547b1-7984-4b2c-8973-e801cac6a10a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:34:22.726811 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:22.726811 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:22.726811 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:22.726811 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:22.726811 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:22.726811 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:22.726811 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:22.726811 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:22.726811 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:22.726811 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:22.726811 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:22.726811 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:22.726811 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:22.726811 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:22.726811 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:22.727681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:22.727681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:22.727681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:22.727681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:22.727681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:22.727681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:22.727681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:22.727681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:22.727681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:22.727681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:22.727681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:22.727681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:22.727681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:22.727681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:22.727681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:22.727681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:22.728833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:22.728833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:22.728833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:22.728833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:22.728833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:22.728833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:22.728833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:22.728833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:22.728833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:22.728833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:22.728833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:34:22.728833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:22.728833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 116/241] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:22.736422 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a87a7f-e2d3-4132-912a-748e4bb417b9 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:22.756220 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb547b1-7984-4b2c-8973-e801cac6a10a None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:22.827748 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:22.892408 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a87a7f-e2d3-4132-912a-748e4bb417b9 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:22.919431 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:22.920838 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb547b1-7984-4b2c-8973-e801cac6a10a None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:22.937510 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e707da4-3100-4087-8b65-c4fdf3be06dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:22.938660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e707da4-3100-4087-8b65-c4fdf3be06dd None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:22.939139 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e707da4-3100-4087-8b65-c4fdf3be06dd None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:22.939948 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e707da4-3100-4087-8b65-c4fdf3be06dd None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:22.941053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e707da4-3100-4087-8b65-c4fdf3be06dd None admin] RBAC: Adding query filter params (name=reader) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:22.941529 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e707da4-3100-4087-8b65-c4fdf3be06dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:22.943587 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e707da4-3100-4087-8b65-c4fdf3be06dd None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:22.960065 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 126/242] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 1 13:34:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:22.960515 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e707da4-3100-4087-8b65-c4fdf3be06dd None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:22.967186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde85c9a-1374-4d09-835d-d4dfddb51596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:22.968053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde85c9a-1374-4d09-835d-d4dfddb51596 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:22.968508 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde85c9a-1374-4d09-835d-d4dfddb51596 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:22.968974 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde85c9a-1374-4d09-835d-d4dfddb51596 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:22.980065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde85c9a-1374-4d09-835d-d4dfddb51596 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:22.986431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-dde85c9a-1374-4d09-835d-d4dfddb51596 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:22.986431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:22.986431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:22.986431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:22.986431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:22.986431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:22.986431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:22.986431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:22.986431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:22.986431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:22.986431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:22.986431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:22.986431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:22.986431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:22.986431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:22.986431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:22.987274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:22.987274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:22.987274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:22.987274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:22.987274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:22.987274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:22.987274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:22.987274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:22.987274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:22.987274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:22.987274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:22.987274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:22.987274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:22.987274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:22.987274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:22.987274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:22.988111 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:22.988111 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:22.988111 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:22.988111 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:22.988111 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:22.988111 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:22.988111 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:22.988111 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:22.988111 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:22.988111 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:22.988111 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:22.988111 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:22.990373 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 117/243] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:22.991353 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde85c9a-1374-4d09-835d-d4dfddb51596 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:23.086436 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e707da4-3100-4087-8b65-c4fdf3be06dd None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:23.099585 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde85c9a-1374-4d09-835d-d4dfddb51596 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:23.101516 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:23.124610 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c71c2-4e63-4a4a-b592-e074a64c2d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:23.125166 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c71c2-4e63-4a4a-b592-e074a64c2d73 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:23.125166 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c71c2-4e63-4a4a-b592-e074a64c2d73 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:23.125435 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c71c2-4e63-4a4a-b592-e074a64c2d73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:23.126607 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c71c2-4e63-4a4a-b592-e074a64c2d73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:23.128151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c71c2-4e63-4a4a-b592-e074a64c2d73 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:23.134502 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 127/244] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:34:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:23.134502 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c71c2-4e63-4a4a-b592-e074a64c2d73 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:23.146494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7a5ab-2562-4dcb-b140-610201be81e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:23.147900 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7a5ab-2562-4dcb-b140-610201be81e1 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:23.148377 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7a5ab-2562-4dcb-b140-610201be81e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:23.148925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7a5ab-2562-4dcb-b140-610201be81e1 None admin] PATH_INFO: `/v3/users/596421c1ac2e4deda6d43e30972e00d7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:23.165215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7a5ab-2562-4dcb-b140-610201be81e1 None admin] RBAC: Authorizing `identity:get_user(user_id=596421c1ac2e4deda6d43e30972e00d7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:23.167017 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7a5ab-2562-4dcb-b140-610201be81e1 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:23.169548 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 118/245] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:22 2022] GET /identity/v3/users/596421c1ac2e4deda6d43e30972e00d7 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:23.170500 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7a5ab-2562-4dcb-b140-610201be81e1 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:23.199059 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:23.250545 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c71c2-4e63-4a4a-b592-e074a64c2d73 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:23.278508 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7a5ab-2562-4dcb-b140-610201be81e1 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:23.288514 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d684a17-e593-489b-8dff-529d33989184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:23.289130 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d684a17-e593-489b-8dff-529d33989184 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:23.289401 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d684a17-e593-489b-8dff-529d33989184 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:23.290039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d684a17-e593-489b-8dff-529d33989184 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:23.290439 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d684a17-e593-489b-8dff-529d33989184 None admin] RBAC: Adding query filter params (name=member) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:23.290741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d684a17-e593-489b-8dff-529d33989184 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:23.292268 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d684a17-e593-489b-8dff-529d33989184 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:23.306301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 128/246] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 1 13:34:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:23.306301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d684a17-e593-489b-8dff-529d33989184 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:23.322575 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897951ea-a9b6-4933-8262-56538cc92210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:23.323647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897951ea-a9b6-4933-8262-56538cc92210 None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:23.324676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897951ea-a9b6-4933-8262-56538cc92210 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:23.325166 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897951ea-a9b6-4933-8262-56538cc92210 None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:23.326122 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897951ea-a9b6-4933-8262-56538cc92210 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:23.327969 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897951ea-a9b6-4933-8262-56538cc92210 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:23.415492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 119/247] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 1 13:34:23 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:34:23.415492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897951ea-a9b6-4933-8262-56538cc92210 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:23.429699 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d684a17-e593-489b-8dff-529d33989184 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:23.456548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:23.458522 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:23.495928 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304caeb9-20a2-4d2c-9f93-5d881c6ba814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:23.496616 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304caeb9-20a2-4d2c-9f93-5d881c6ba814 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:23.496893 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304caeb9-20a2-4d2c-9f93-5d881c6ba814 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:23.497164 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304caeb9-20a2-4d2c-9f93-5d881c6ba814 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:23.622331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897951ea-a9b6-4933-8262-56538cc92210 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:23.630589 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304caeb9-20a2-4d2c-9f93-5d881c6ba814 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:23.632142 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304caeb9-20a2-4d2c-9f93-5d881c6ba814 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:23.660316 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365eec8d-e2d3-40b8-a4eb-cabecc7f5fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:23.660954 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365eec8d-e2d3-40b8-a4eb-cabecc7f5fea None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:23.661234 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365eec8d-e2d3-40b8-a4eb-cabecc7f5fea None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:23.661506 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365eec8d-e2d3-40b8-a4eb-cabecc7f5fea None admin] PATH_INFO: `/v3/users/ce0b457ca9254746bee8de8612e9574c` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:23.662692 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365eec8d-e2d3-40b8-a4eb-cabecc7f5fea None admin] RBAC: Authorizing `identity:get_user(user_id=ce0b457ca9254746bee8de8612e9574c)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:23.664131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365eec8d-e2d3-40b8-a4eb-cabecc7f5fea None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:23.666021 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 120/248] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:23 2022] GET /identity/v3/users/ce0b457ca9254746bee8de8612e9574c => generated 297 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:23.667173 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba521d-94b8-4af6-b944-0912ad8d0aee None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:23.667559 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba521d-94b8-4af6-b944-0912ad8d0aee None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:23.667840 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba521d-94b8-4af6-b944-0912ad8d0aee None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:23.671493 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 121/249] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:23.672717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1eac3f-b901-4cbf-afcc-82ad47bbea93 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:23.673043 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1eac3f-b901-4cbf-afcc-82ad47bbea93 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:23.673281 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1eac3f-b901-4cbf-afcc-82ad47bbea93 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:23.674920 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 122/250] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:23.676024 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f5747-07a0-4435-b472-188c9161ff38 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:23.676302 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f5747-07a0-4435-b472-188c9161ff38 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:23.676578 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f5747-07a0-4435-b472-188c9161ff38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:23.700272 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-eb8f5747-07a0-4435-b472-188c9161ff38 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:23.701988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-eb8f5747-07a0-4435-b472-188c9161ff38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:23.767796 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 129/251] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:23.768775 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304caeb9-20a2-4d2c-9f93-5d881c6ba814 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:23.793735 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:23.837879 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 123/252] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:23.843393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5a3dc-73bb-445e-918e-26842bb06263 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:23.843393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5a3dc-73bb-445e-918e-26842bb06263 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:23.843393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5a3dc-73bb-445e-918e-26842bb06263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:23.890314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-b2c5a3dc-73bb-445e-918e-26842bb06263 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:23.892425 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b2c5a3dc-73bb-445e-918e-26842bb06263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:23.912262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:23.953477 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304caeb9-20a2-4d2c-9f93-5d881c6ba814 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:24.016493 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b09307-62f8-440b-bd8a-c023d63c6153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:24.017136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b09307-62f8-440b-bd8a-c023d63c6153 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:24.017411 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b09307-62f8-440b-bd8a-c023d63c6153 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:24.017682 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b09307-62f8-440b-bd8a-c023d63c6153 None admin] PATH_INFO: `/v3/projects/3e8cca114ed04209a31e58f224967b4a` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:24.022303 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b09307-62f8-440b-bd8a-c023d63c6153 None admin] RBAC: Authorizing `identity:get_project(project_id=3e8cca114ed04209a31e58f224967b4a)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:24.023785 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b09307-62f8-440b-bd8a-c023d63c6153 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:24.028233 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 130/253] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:23 2022] GET /identity/v3/projects/3e8cca114ed04209a31e58f224967b4a => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:24.029135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b09307-62f8-440b-bd8a-c023d63c6153 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:24.049425 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 124/254] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:24.053591 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5a3dc-73bb-445e-918e-26842bb06263 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:24.181907 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:24.193502 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b09307-62f8-440b-bd8a-c023d63c6153 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:24.239384 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56501e0-1091-4187-aa67-43ac83aa5da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:24.239384 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56501e0-1091-4187-aa67-43ac83aa5da4 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:24.239648 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56501e0-1091-4187-aa67-43ac83aa5da4 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:24.239862 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56501e0-1091-4187-aa67-43ac83aa5da4 None admin] PATH_INFO: `/v3/projects/3e8cca114ed04209a31e58f224967b4a` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:24.247216 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56501e0-1091-4187-aa67-43ac83aa5da4 None admin] RBAC: Authorizing `identity:get_project(project_id=3e8cca114ed04209a31e58f224967b4a)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:24.252867 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56501e0-1091-4187-aa67-43ac83aa5da4 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:24.254861 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 131/255] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:24 2022] GET /identity/v3/projects/3e8cca114ed04209a31e58f224967b4a => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:24.255503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56501e0-1091-4187-aa67-43ac83aa5da4 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:24.317658 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5a3dc-73bb-445e-918e-26842bb06263 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:24.400094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7eaf4-9f33-446e-86bb-fb74cf0e3875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:24.400781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7eaf4-9f33-446e-86bb-fb74cf0e3875 None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:24.401059 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7eaf4-9f33-446e-86bb-fb74cf0e3875 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:24.402913 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7eaf4-9f33-446e-86bb-fb74cf0e3875 None admin] PATH_INFO: `/v3/projects/3e8cca114ed04209a31e58f224967b4a/users/ce0b457ca9254746bee8de8612e9574c/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:24.409033 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7eaf4-9f33-446e-86bb-fb74cf0e3875 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e8cca114ed04209a31e58f224967b4a, user_id=ce0b457ca9254746bee8de8612e9574c, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:24.410498 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7eaf4-9f33-446e-86bb-fb74cf0e3875 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:24.446767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56501e0-1091-4187-aa67-43ac83aa5da4 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:24.482058 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c88856-9709-476b-87d4-0712d510cad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:24.482946 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c88856-9709-476b-87d4-0712d510cad0 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:24.483225 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c88856-9709-476b-87d4-0712d510cad0 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:24.483527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c88856-9709-476b-87d4-0712d510cad0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:24.503384 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 125/256] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 1 13:34:24 2022] PUT /identity/v3/projects/3e8cca114ed04209a31e58f224967b4a/users/ce0b457ca9254746bee8de8612e9574c/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:34:24.503384 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7eaf4-9f33-446e-86bb-fb74cf0e3875 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:24.504989 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c88856-9709-476b-87d4-0712d510cad0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:24.510063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-90c88856-9709-476b-87d4-0712d510cad0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:34:24.510063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:24.510063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:24.510063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:24.510063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:24.510063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:24.510063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:24.510063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:24.510063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:24.510063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:24.510063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:24.510063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:24.510063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:24.510063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:24.510063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:24.510063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:24.511000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:24.511000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:24.511000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:24.511000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:24.511000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:24.511000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:24.511000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:24.511000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:24.511000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:24.511000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:24.511000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:24.511000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:24.511000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:24.511000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:24.511000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:24.511000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:24.511804 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:24.511804 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:24.511804 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:24.511804 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:24.511804 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:24.511804 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:24.511804 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:24.511804 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:24.511804 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:24.511804 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:24.511804 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:34:24.511804 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:24.512423 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:24.513308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 132/257] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 1 13:34:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:24.514122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c88856-9709-476b-87d4-0712d510cad0 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:24.549617 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:24.681262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7eaf4-9f33-446e-86bb-fb74cf0e3875 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:24.731282 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c88856-9709-476b-87d4-0712d510cad0 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:24.753477 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947bb33-ecc3-4774-a1c9-28b3d4e886f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:24.754712 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947bb33-ecc3-4774-a1c9-28b3d4e886f8 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:24.755603 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947bb33-ecc3-4774-a1c9-28b3d4e886f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:24.756094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947bb33-ecc3-4774-a1c9-28b3d4e886f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:24.757026 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947bb33-ecc3-4774-a1c9-28b3d4e886f8 None admin] RBAC: Adding query filter params (role.id=38b6cb84b0e04d4db8dc3ae0793aee31, scope.project.id=3e8cca114ed04209a31e58f224967b4a, user.id=596421c1ac2e4deda6d43e30972e00d7) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:24.757527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947bb33-ecc3-4774-a1c9-28b3d4e886f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:24.760301 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947bb33-ecc3-4774-a1c9-28b3d4e886f8 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:24.774793 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 126/258] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:34:24 2022] GET /identity/v3/role_assignments?user.id=596421c1ac2e4deda6d43e30972e00d7&scope.project.id=3e8cca114ed04209a31e58f224967b4a&role.id=38b6cb84b0e04d4db8dc3ae0793aee31 => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:24.776891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947bb33-ecc3-4774-a1c9-28b3d4e886f8 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:24.785212 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6edbc9-c84a-4602-964c-db4ff896f433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:24.786255 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6edbc9-c84a-4602-964c-db4ff896f433 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:24.787719 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6edbc9-c84a-4602-964c-db4ff896f433 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:24.788235 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6edbc9-c84a-4602-964c-db4ff896f433 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:24.817244 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6edbc9-c84a-4602-964c-db4ff896f433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:24.822543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-4a6edbc9-c84a-4602-964c-db4ff896f433 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:34:24.822543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:24.822543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:24.822543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:24.822543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:24.822543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:24.822543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:24.822543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:24.822543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:24.822543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:24.822543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:24.822543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:24.822543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:24.822543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:24.822543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:24.822543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:24.823469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:24.823469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:24.823469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:24.823469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:24.823469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:24.823469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:24.823469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:24.823469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:24.823469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:24.823469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:24.823469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:24.823469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:24.823469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:24.823469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:24.823469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:24.823469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:24.824775 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:24.824775 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:24.824775 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:24.824775 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:24.824775 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:24.824775 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:24.824775 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:24.824775 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:24.824775 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:24.824775 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:24.824775 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:34:24.824775 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:24.827100 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 133/259] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:34:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:24.832969 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6edbc9-c84a-4602-964c-db4ff896f433 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:24.904204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:24.963435 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947bb33-ecc3-4774-a1c9-28b3d4e886f8 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:24.970078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:25.024613 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95578b-bcfd-4d2c-83b5-03b910fa8162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:25.024944 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95578b-bcfd-4d2c-83b5-03b910fa8162 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:25.025147 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95578b-bcfd-4d2c-83b5-03b910fa8162 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:25.025400 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95578b-bcfd-4d2c-83b5-03b910fa8162 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:25.031512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95578b-bcfd-4d2c-83b5-03b910fa8162 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:25.031512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95578b-bcfd-4d2c-83b5-03b910fa8162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:25.031512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95578b-bcfd-4d2c-83b5-03b910fa8162 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:25.038016 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 127/260] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:34:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:25.040950 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6edbc9-c84a-4602-964c-db4ff896f433 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:25.044806 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95578b-bcfd-4d2c-83b5-03b910fa8162 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:25.171686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a403d-679a-43df-8e58-66f02e4e4f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:25.172311 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a403d-679a-43df-8e58-66f02e4e4f69 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:25.172589 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a403d-679a-43df-8e58-66f02e4e4f69 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:25.172862 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a403d-679a-43df-8e58-66f02e4e4f69 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:25.173536 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a403d-679a-43df-8e58-66f02e4e4f69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:25.173843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a403d-679a-43df-8e58-66f02e4e4f69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:25.184013 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a403d-679a-43df-8e58-66f02e4e4f69 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:25.200229 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 134/261] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:34:25.206067 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a403d-679a-43df-8e58-66f02e4e4f69 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:25.240981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95578b-bcfd-4d2c-83b5-03b910fa8162 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:25.298659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:25.309622 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cbf19-81a2-461d-b2e2-4d3b8b9c0e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:25.311404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cbf19-81a2-461d-b2e2-4d3b8b9c0e1d None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:25.318485 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cbf19-81a2-461d-b2e2-4d3b8b9c0e1d None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:25.318485 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cbf19-81a2-461d-b2e2-4d3b8b9c0e1d None admin] PATH_INFO: `/v3/users/08fc544caf4844f8bbdbfe8629257406` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:25.318485 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16cbf19-81a2-461d-b2e2-4d3b8b9c0e1d None admin] RBAC: Authorizing `identity:get_user(user_id=08fc544caf4844f8bbdbfe8629257406)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:25.318485 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16cbf19-81a2-461d-b2e2-4d3b8b9c0e1d None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:25.329743 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 128/262] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:25 2022] GET /identity/v3/users/08fc544caf4844f8bbdbfe8629257406 => generated 283 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:34:25.340145 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cbf19-81a2-461d-b2e2-4d3b8b9c0e1d None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:25.420140 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a403d-679a-43df-8e58-66f02e4e4f69 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:25.464382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b4a98-b49f-4d37-add0-cc6fd386e532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:25.465388 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b4a98-b49f-4d37-add0-cc6fd386e532 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:25.465886 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b4a98-b49f-4d37-add0-cc6fd386e532 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:25.468198 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b4a98-b49f-4d37-add0-cc6fd386e532 None admin] PATH_INFO: `/v3/users/08fc544caf4844f8bbdbfe8629257406` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:25.469894 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b4a98-b49f-4d37-add0-cc6fd386e532 None admin] RBAC: Authorizing `identity:get_user(user_id=08fc544caf4844f8bbdbfe8629257406)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:25.472765 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b4a98-b49f-4d37-add0-cc6fd386e532 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:25.479047 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 135/263] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:25 2022] GET /identity/v3/users/08fc544caf4844f8bbdbfe8629257406 => generated 283 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:25.501563 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b4a98-b49f-4d37-add0-cc6fd386e532 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:25.504766 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:25.573660 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cbf19-81a2-461d-b2e2-4d3b8b9c0e1d None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:25.631541 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b4a98-b49f-4d37-add0-cc6fd386e532 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:25.672110 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3830b0-4f06-424c-ba72-9f821c8182f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:25.673362 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3830b0-4f06-424c-ba72-9f821c8182f8 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:25.674715 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fd571-90e3-47d3-8e0c-230be832ec63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:25.675211 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3830b0-4f06-424c-ba72-9f821c8182f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:25.676045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fd571-90e3-47d3-8e0c-230be832ec63 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:25.676513 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3830b0-4f06-424c-ba72-9f821c8182f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:25.677558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fd571-90e3-47d3-8e0c-230be832ec63 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:25.678389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fd571-90e3-47d3-8e0c-230be832ec63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:25.758838 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3830b0-4f06-424c-ba72-9f821c8182f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:25.760706 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3830b0-4f06-424c-ba72-9f821c8182f8 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:25.763442 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:25.818274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:25.828803 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fd571-90e3-47d3-8e0c-230be832ec63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:25.829859 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fd571-90e3-47d3-8e0c-230be832ec63 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:25.884308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 136/264] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 13:34:25.892759 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3830b0-4f06-424c-ba72-9f821c8182f8 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:25.972816 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 129/265] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:25.979450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fd571-90e3-47d3-8e0c-230be832ec63 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:26.078255 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3830b0-4f06-424c-ba72-9f821c8182f8 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:26.080207 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:26.104325 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:26.108478 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fd571-90e3-47d3-8e0c-230be832ec63 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:26.119480 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b8728-878a-4f70-8060-57d159417a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:26.120965 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b8728-878a-4f70-8060-57d159417a06 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:26.121502 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b8728-878a-4f70-8060-57d159417a06 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:26.122050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b8728-878a-4f70-8060-57d159417a06 None admin] PATH_INFO: `/v3/projects/3e8cca114ed04209a31e58f224967b4a` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:26.123470 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b8728-878a-4f70-8060-57d159417a06 None admin] RBAC: Authorizing `identity:get_project(project_id=3e8cca114ed04209a31e58f224967b4a)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:26.125095 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b8728-878a-4f70-8060-57d159417a06 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:26.127391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 137/266] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:25 2022] GET /identity/v3/projects/3e8cca114ed04209a31e58f224967b4a => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:26.128780 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9853d-d0d6-483f-b705-4b09bcf8931b None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:26.129275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9853d-d0d6-483f-b705-4b09bcf8931b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:26.129740 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9853d-d0d6-483f-b705-4b09bcf8931b None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:26.131186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 138/267] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:26.136807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70d557-c041-4428-a875-ca4c2596c89a None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:26.137326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70d557-c041-4428-a875-ca4c2596c89a None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:26.137790 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70d557-c041-4428-a875-ca4c2596c89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:26.144339 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b7585-44f6-410b-9adb-f34431800ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:26.144973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b7585-44f6-410b-9adb-f34431800ed2 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:26.145253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b7585-44f6-410b-9adb-f34431800ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:26.145527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b7585-44f6-410b-9adb-f34431800ed2 None admin] PATH_INFO: `/v3/projects/3e8cca114ed04209a31e58f224967b4a` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:26.147140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b7585-44f6-410b-9adb-f34431800ed2 None admin] RBAC: Authorizing `identity:get_project(project_id=3e8cca114ed04209a31e58f224967b4a)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:26.148159 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b7585-44f6-410b-9adb-f34431800ed2 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:26.150086 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 130/268] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:25 2022] GET /identity/v3/projects/3e8cca114ed04209a31e58f224967b4a => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:26.151036 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b7585-44f6-410b-9adb-f34431800ed2 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:26.165634 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-6e70d557-c041-4428-a875-ca4c2596c89a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:26.167262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-6e70d557-c041-4428-a875-ca4c2596c89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:26.244627 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 139/269] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:26.251396 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70d557-c041-4428-a875-ca4c2596c89a None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:26.261556 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b7585-44f6-410b-9adb-f34431800ed2 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:26.295655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a0117-62d2-48e2-8b7c-eb213257beba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:26.296293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a0117-62d2-48e2-8b7c-eb213257beba None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:26.296570 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a0117-62d2-48e2-8b7c-eb213257beba None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:26.296893 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a0117-62d2-48e2-8b7c-eb213257beba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:26.297628 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a0117-62d2-48e2-8b7c-eb213257beba None admin] RBAC: Adding query filter params (role.id=98ffd3c114804da292d7cb33721e9085, scope.project.id=3e8cca114ed04209a31e58f224967b4a, user.id=08fc544caf4844f8bbdbfe8629257406) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:26.298186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a0117-62d2-48e2-8b7c-eb213257beba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:26.299414 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a0117-62d2-48e2-8b7c-eb213257beba None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:26.305683 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 131/270] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:34:26 2022] GET /identity/v3/role_assignments?user.id=08fc544caf4844f8bbdbfe8629257406&scope.project.id=3e8cca114ed04209a31e58f224967b4a&role.id=98ffd3c114804da292d7cb33721e9085 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:26.306691 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3099069-fc93-4fff-977c-1747bf0e536a None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:26.306971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3099069-fc93-4fff-977c-1747bf0e536a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:26.307376 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3099069-fc93-4fff-977c-1747bf0e536a None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:26.308882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 132/271] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:26.316852 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe8f5b-949b-4fde-a9b1-80c5cf1f2c16 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:26.317129 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe8f5b-949b-4fde-a9b1-80c5cf1f2c16 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:26.317398 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe8f5b-949b-4fde-a9b1-80c5cf1f2c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:26.351111 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-bcfe8f5b-949b-4fde-a9b1-80c5cf1f2c16 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:26.353608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-bcfe8f5b-949b-4fde-a9b1-80c5cf1f2c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:26.405651 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:26.430100 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:26.437592 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70d557-c041-4428-a875-ca4c2596c89a None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:26.490964 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 133/272] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:34:26.505829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cdebf-fc13-4064-93ab-8cf2c0377683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:26.506450 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cdebf-fc13-4064-93ab-8cf2c0377683 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:26.506724 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cdebf-fc13-4064-93ab-8cf2c0377683 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:26.506990 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cdebf-fc13-4064-93ab-8cf2c0377683 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:26.507754 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0cdebf-fc13-4064-93ab-8cf2c0377683 None admin] RBAC: Adding query filter params (role.id=f0d2493c03664449802df928b8e8fa53, scope.project.id=3e8cca114ed04209a31e58f224967b4a, user.id=08fc544caf4844f8bbdbfe8629257406) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:26.508055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0cdebf-fc13-4064-93ab-8cf2c0377683 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:26.509526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0cdebf-fc13-4064-93ab-8cf2c0377683 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:26.520522 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 140/273] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:34:26 2022] GET /identity/v3/role_assignments?user.id=08fc544caf4844f8bbdbfe8629257406&scope.project.id=3e8cca114ed04209a31e58f224967b4a&role.id=f0d2493c03664449802df928b8e8fa53 => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:26.788772 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe8f5b-949b-4fde-a9b1-80c5cf1f2c16 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:26.851222 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cdebf-fc13-4064-93ab-8cf2c0377683 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:26.902745 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe8f5b-949b-4fde-a9b1-80c5cf1f2c16 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:26.939064 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ddf285-532b-40a1-9741-101ebfbf4e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:26.940241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddf285-532b-40a1-9741-101ebfbf4e2d None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:26.940241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddf285-532b-40a1-9741-101ebfbf4e2d None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:26.940241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddf285-532b-40a1-9741-101ebfbf4e2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:26.950799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ddf285-532b-40a1-9741-101ebfbf4e2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:26.955959 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-35ddf285-532b-40a1-9741-101ebfbf4e2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:26.955959 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:26.955959 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:26.955959 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:26.955959 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:26.955959 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:26.955959 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:26.955959 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:26.955959 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:26.955959 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:26.955959 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:26.955959 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:26.955959 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:26.955959 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:26.955959 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:26.955959 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:26.957450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:26.957450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:26.957450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:26.957450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:26.957450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:26.957450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:26.957450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:26.957450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:26.957450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:26.957450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:26.957450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:26.957450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:26.957450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:26.957450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:26.957450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:26.957450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:26.958882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:26.958882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:26.958882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:26.958882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:26.958882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:26.958882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:26.958882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:26.958882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:26.958882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:26.958882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:26.958882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:26.958882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:26.961732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 134/274] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:26.962811 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ddf285-532b-40a1-9741-101ebfbf4e2d None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:26.990632 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cdebf-fc13-4064-93ab-8cf2c0377683 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:26.997696 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:27.030492 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d46a6-b4f1-4bce-ae72-64d29a7ff9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:27.031523 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d46a6-b4f1-4bce-ae72-64d29a7ff9fc None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:27.032013 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d46a6-b4f1-4bce-ae72-64d29a7ff9fc None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:27.032471 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d46a6-b4f1-4bce-ae72-64d29a7ff9fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:27.034705 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d46a6-b4f1-4bce-ae72-64d29a7ff9fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:27.036486 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d46a6-b4f1-4bce-ae72-64d29a7ff9fc None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:27.038650 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 141/275] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:34:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:27.046934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc2bb6-e2f9-458d-a7f0-aee56c25e275 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:27.046934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc2bb6-e2f9-458d-a7f0-aee56c25e275 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:27.046934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc2bb6-e2f9-458d-a7f0-aee56c25e275 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:27.047818 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 142/276] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:27.048815 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc2bb6-e2f9-458d-a7f0-aee56c25e275 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:27.077335 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ddf285-532b-40a1-9741-101ebfbf4e2d None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:27.083168 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:27.122567 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930ccd1-ae93-4d91-a444-f850055ea112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:27.123196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930ccd1-ae93-4d91-a444-f850055ea112 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:27.123673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930ccd1-ae93-4d91-a444-f850055ea112 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:27.123944 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930ccd1-ae93-4d91-a444-f850055ea112 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:27.125088 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930ccd1-ae93-4d91-a444-f850055ea112 None admin] RBAC: Adding query filter params (name=member) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:27.125391 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930ccd1-ae93-4d91-a444-f850055ea112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:27.127296 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930ccd1-ae93-4d91-a444-f850055ea112 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:27.141331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 135/277] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 1 13:34:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:34:27.141331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8a06d-c1ba-4e22-8b52-a8f512348a6f None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:27.141331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8a06d-c1ba-4e22-8b52-a8f512348a6f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:27.141331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8a06d-c1ba-4e22-8b52-a8f512348a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:27.160041 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc2bb6-e2f9-458d-a7f0-aee56c25e275 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:27.172565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-86a8a06d-c1ba-4e22-8b52-a8f512348a6f None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:27.173759 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-86a8a06d-c1ba-4e22-8b52-a8f512348a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:27.198881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d787d48-cbb7-43b0-9128-f9bdb654ab7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:27.199528 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d787d48-cbb7-43b0-9128-f9bdb654ab7b None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:27.199806 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d787d48-cbb7-43b0-9128-f9bdb654ab7b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:27.200076 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d787d48-cbb7-43b0-9128-f9bdb654ab7b None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:27.200711 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d787d48-cbb7-43b0-9128-f9bdb654ab7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:27.202149 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d787d48-cbb7-43b0-9128-f9bdb654ab7b None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:27.243211 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 136/278] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:27.244092 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8a06d-c1ba-4e22-8b52-a8f512348a6f None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:27.259732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:27.295855 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 143/279] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 1 13:34:27 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:34:27.362167 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8a06d-c1ba-4e22-8b52-a8f512348a6f None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:27.402345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213a349-1b88-4fbd-8ad2-cc4707e7197e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:27.403391 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213a349-1b88-4fbd-8ad2-cc4707e7197e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:27.403843 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213a349-1b88-4fbd-8ad2-cc4707e7197e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:27.404310 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213a349-1b88-4fbd-8ad2-cc4707e7197e None admin] PATH_INFO: `/v3/users/8754e5e8adf0416497329f35ed7f1f75` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:27.420947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213a349-1b88-4fbd-8ad2-cc4707e7197e None admin] RBAC: Authorizing `identity:get_user(user_id=8754e5e8adf0416497329f35ed7f1f75)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:27.422723 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213a349-1b88-4fbd-8ad2-cc4707e7197e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:27.429812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 137/280] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:27 2022] GET /identity/v3/users/8754e5e8adf0416497329f35ed7f1f75 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:27.431468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d787d48-cbb7-43b0-9128-f9bdb654ab7b None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:27.522017 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:27.525880 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213a349-1b88-4fbd-8ad2-cc4707e7197e None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:27.536710 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d787d48-cbb7-43b0-9128-f9bdb654ab7b None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:27.596569 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff01b0d-eb09-4f21-8a69-a410b1d60dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:27.597480 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff01b0d-eb09-4f21-8a69-a410b1d60dab None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:27.597932 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff01b0d-eb09-4f21-8a69-a410b1d60dab None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:27.598201 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff01b0d-eb09-4f21-8a69-a410b1d60dab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:27.598934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff01b0d-eb09-4f21-8a69-a410b1d60dab None admin] RBAC: Adding query filter params (role.id=3654765b6c2644779fda2924f119aef7, user.id=8754e5e8adf0416497329f35ed7f1f75, scope.system=all) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:27.599241 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff01b0d-eb09-4f21-8a69-a410b1d60dab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:27.600723 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff01b0d-eb09-4f21-8a69-a410b1d60dab None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:27.606940 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 144/281] 10.222.0.50 () {56 vars in 1308 bytes} [Thu Sep 1 13:34:27 2022] GET /identity/v3/role_assignments?user.id=8754e5e8adf0416497329f35ed7f1f75&scope.system=all&role.id=3654765b6c2644779fda2924f119aef7 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:27.628571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:27.660733 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff84c50-fe45-43d0-9a09-3b37a290c72b None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:27.661047 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff84c50-fe45-43d0-9a09-3b37a290c72b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:27.661289 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff84c50-fe45-43d0-9a09-3b37a290c72b None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:27.662970 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 145/282] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:27.668817 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177203e3-0930-473d-a938-e543ecf9f35c None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:27.669124 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177203e3-0930-473d-a938-e543ecf9f35c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:27.669357 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177203e3-0930-473d-a938-e543ecf9f35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:27.670024 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213a349-1b88-4fbd-8ad2-cc4707e7197e None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:27.690470 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-177203e3-0930-473d-a938-e543ecf9f35c None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:27.691751 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-177203e3-0930-473d-a938-e543ecf9f35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:27.720607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b997d8-20c6-4354-8794-bed26ae48509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:27.721271 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b997d8-20c6-4354-8794-bed26ae48509 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:27.721552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b997d8-20c6-4354-8794-bed26ae48509 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:27.721828 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b997d8-20c6-4354-8794-bed26ae48509 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:27.738742 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b997d8-20c6-4354-8794-bed26ae48509 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:27.744955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-96b997d8-20c6-4354-8794-bed26ae48509 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:27.744955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:27.744955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:27.744955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:27.744955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:27.744955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:27.744955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:27.744955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:27.744955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:27.744955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:27.744955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:27.744955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:27.744955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:27.744955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:27.744955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:27.744955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:27.746419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:27.746419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:27.746419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:27.746419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:27.746419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:27.746419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:27.746419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:27.746419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:27.746419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:27.746419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:27.746419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:27.746419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:27.746419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:27.746419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:27.746419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:27.746419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:27.747221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:27.747221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:27.747221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:27.747221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:27.747221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:27.747221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:27.747221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:27.747221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:27.747221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:27.747221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:27.747221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:27.747221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:27.747221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 138/283] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:34:27.755506 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b997d8-20c6-4354-8794-bed26ae48509 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:27.788560 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 146/284] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:34:27.902331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b997d8-20c6-4354-8794-bed26ae48509 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:27.944516 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:27.954474 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecae1d-c32e-4290-b767-a19f779a8dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:27.955091 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecae1d-c32e-4290-b767-a19f779a8dba None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:27.955382 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecae1d-c32e-4290-b767-a19f779a8dba None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:27.955741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecae1d-c32e-4290-b767-a19f779a8dba None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:27.962360 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eecae1d-c32e-4290-b767-a19f779a8dba None admin] RBAC: Adding query filter params (name=member) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:27.962360 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eecae1d-c32e-4290-b767-a19f779a8dba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:27.962360 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eecae1d-c32e-4290-b767-a19f779a8dba None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:27.970543 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 139/285] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 1 13:34:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:27.976104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177203e3-0930-473d-a938-e543ecf9f35c None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:28.084368 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:28.097141 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177203e3-0930-473d-a938-e543ecf9f35c None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:28.131518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecae1d-c32e-4290-b767-a19f779a8dba None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:28.132936 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682b29d-7f1d-482d-9af7-ea8e99293d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:28.133579 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682b29d-7f1d-482d-9af7-ea8e99293d3b None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:28.133858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682b29d-7f1d-482d-9af7-ea8e99293d3b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:28.134189 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682b29d-7f1d-482d-9af7-ea8e99293d3b None admin] PATH_INFO: `/v3/users/ce0b457ca9254746bee8de8612e9574c` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:28.138911 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682b29d-7f1d-482d-9af7-ea8e99293d3b None admin] RBAC: Authorizing `identity:get_user(user_id=ce0b457ca9254746bee8de8612e9574c)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:28.138911 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682b29d-7f1d-482d-9af7-ea8e99293d3b None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:28.139345 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 147/286] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:27 2022] GET /identity/v3/users/ce0b457ca9254746bee8de8612e9574c => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:28.144599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682b29d-7f1d-482d-9af7-ea8e99293d3b None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:28.256039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682b29d-7f1d-482d-9af7-ea8e99293d3b None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:28.295309 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9003f4c-4318-4ef8-b9f1-aed584c38750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:28.295951 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9003f4c-4318-4ef8-b9f1-aed584c38750 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:28.296461 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9003f4c-4318-4ef8-b9f1-aed584c38750 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:28.296461 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9003f4c-4318-4ef8-b9f1-aed584c38750 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:28.317724 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:28.347368 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecae1d-c32e-4290-b767-a19f779a8dba None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:28.373887 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9003f4c-4318-4ef8-b9f1-aed584c38750 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:28.375497 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9003f4c-4318-4ef8-b9f1-aed584c38750 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:28.416102 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521ac50-c6db-4eb3-a673-97f8858a130a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:28.416757 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521ac50-c6db-4eb3-a673-97f8858a130a None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:28.417019 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521ac50-c6db-4eb3-a673-97f8858a130a None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:28.417845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521ac50-c6db-4eb3-a673-97f8858a130a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:28.432165 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521ac50-c6db-4eb3-a673-97f8858a130a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:28.437027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-7521ac50-c6db-4eb3-a673-97f8858a130a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:34:28.437027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:28.437027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:28.437027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:28.437027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:28.437027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:28.437027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:28.437027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:28.437027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:28.437027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:28.437027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:28.437027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:28.437027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:28.437027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:28.437027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:28.437027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:28.437864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:28.437864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:28.437864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:28.437864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:28.437864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:28.437864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:28.437864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:28.437864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:28.437864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:28.437864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:28.437864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:28.437864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:28.437864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:28.437864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:28.437864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:28.437864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:28.438599 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:28.438599 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:28.438599 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:28.438599 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:28.438599 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:28.438599 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:28.438599 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:28.438599 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:28.438599 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:28.438599 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:28.438599 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:34:28.438599 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:28.438599 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 140/287] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:34:28.448309 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521ac50-c6db-4eb3-a673-97f8858a130a None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:28.484847 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 148/288] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:28.496416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9003f4c-4318-4ef8-b9f1-aed584c38750 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:28.535458 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:28.595764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:28.630452 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521ac50-c6db-4eb3-a673-97f8858a130a None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:28.681693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9003f4c-4318-4ef8-b9f1-aed584c38750 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:28.695026 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bb32b-3fc1-4d11-adac-b5c7925796e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:28.695970 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bb32b-3fc1-4d11-adac-b5c7925796e4 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:28.696444 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bb32b-3fc1-4d11-adac-b5c7925796e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:28.696935 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bb32b-3fc1-4d11-adac-b5c7925796e4 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:28.697795 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8bb32b-3fc1-4d11-adac-b5c7925796e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:28.698287 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8bb32b-3fc1-4d11-adac-b5c7925796e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:28.701761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8bb32b-3fc1-4d11-adac-b5c7925796e4 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:28.718243 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 141/289] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 1 13:34:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:28.726147 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bb32b-3fc1-4d11-adac-b5c7925796e4 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:28.747065 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56588421-7e03-4c82-a062-f45f1a48c85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:28.748067 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56588421-7e03-4c82-a062-f45f1a48c85d None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:28.748540 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56588421-7e03-4c82-a062-f45f1a48c85d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:28.749111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56588421-7e03-4c82-a062-f45f1a48c85d None admin] PATH_INFO: `/v3/projects/3e8cca114ed04209a31e58f224967b4a` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:28.750523 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56588421-7e03-4c82-a062-f45f1a48c85d None admin] RBAC: Authorizing `identity:get_project(project_id=3e8cca114ed04209a31e58f224967b4a)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:28.752285 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56588421-7e03-4c82-a062-f45f1a48c85d None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:28.754649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 149/290] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:28 2022] GET /identity/v3/projects/3e8cca114ed04209a31e58f224967b4a => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:28.760076 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56588421-7e03-4c82-a062-f45f1a48c85d None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:28.883332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56588421-7e03-4c82-a062-f45f1a48c85d None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:28.907811 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:28.923067 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e601823-ab1f-49a3-9fe5-c1b318b8595c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:28.924011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e601823-ab1f-49a3-9fe5-c1b318b8595c None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:28.924448 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e601823-ab1f-49a3-9fe5-c1b318b8595c None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:28.924874 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e601823-ab1f-49a3-9fe5-c1b318b8595c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:28.929197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e601823-ab1f-49a3-9fe5-c1b318b8595c None admin] RBAC: Adding query filter params (role.id=3654765b6c2644779fda2924f119aef7, scope.project.id=3e8cca114ed04209a31e58f224967b4a, user.id=ce0b457ca9254746bee8de8612e9574c) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:28.929197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e601823-ab1f-49a3-9fe5-c1b318b8595c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:28.929197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e601823-ab1f-49a3-9fe5-c1b318b8595c None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:28.935804 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 150/291] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:34:28 2022] GET /identity/v3/role_assignments?user.id=ce0b457ca9254746bee8de8612e9574c&scope.project.id=3e8cca114ed04209a31e58f224967b4a&role.id=3654765b6c2644779fda2924f119aef7 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:28.994612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bb32b-3fc1-4d11-adac-b5c7925796e4 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:29.010388 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:29.032281 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800ddaa-118f-44d8-85f6-270a26d1f856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:29.032936 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800ddaa-118f-44d8-85f6-270a26d1f856 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:29.033225 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800ddaa-118f-44d8-85f6-270a26d1f856 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:29.033504 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800ddaa-118f-44d8-85f6-270a26d1f856 None admin] PATH_INFO: `/v3/users/596421c1ac2e4deda6d43e30972e00d7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:29.034776 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800ddaa-118f-44d8-85f6-270a26d1f856 None admin] RBAC: Authorizing `identity:get_user(user_id=596421c1ac2e4deda6d43e30972e00d7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:29.036319 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800ddaa-118f-44d8-85f6-270a26d1f856 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:29.038390 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 142/292] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:28 2022] GET /identity/v3/users/596421c1ac2e4deda6d43e30972e00d7 => generated 297 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:29.044174 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e601823-ab1f-49a3-9fe5-c1b318b8595c None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:29.188915 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e601823-ab1f-49a3-9fe5-c1b318b8595c None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:29.225724 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e44d7f-9771-40d2-bd53-3ee5e936b4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:29.226611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e44d7f-9771-40d2-bd53-3ee5e936b4f2 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:29.227027 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e44d7f-9771-40d2-bd53-3ee5e936b4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:29.227468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e44d7f-9771-40d2-bd53-3ee5e936b4f2 None admin] PATH_INFO: `/v3/projects/3e8cca114ed04209a31e58f224967b4a` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:29.228732 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e44d7f-9771-40d2-bd53-3ee5e936b4f2 None admin] RBAC: Authorizing `identity:get_project(project_id=3e8cca114ed04209a31e58f224967b4a)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:29.230882 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e44d7f-9771-40d2-bd53-3ee5e936b4f2 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:29.233274 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 151/293] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:29 2022] GET /identity/v3/projects/3e8cca114ed04209a31e58f224967b4a => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:29.239107 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800ddaa-118f-44d8-85f6-270a26d1f856 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:29.355604 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800ddaa-118f-44d8-85f6-270a26d1f856 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:29.397070 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f93bf-a273-4698-973b-48770b6a22bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:29.397799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f93bf-a273-4698-973b-48770b6a22bd None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:29.398082 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f93bf-a273-4698-973b-48770b6a22bd None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:29.398359 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f93bf-a273-4698-973b-48770b6a22bd None admin] PATH_INFO: `/v3/projects/3e8cca114ed04209a31e58f224967b4a/users/596421c1ac2e4deda6d43e30972e00d7/roles/38b6cb84b0e04d4db8dc3ae0793aee31` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:29.400402 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f93bf-a273-4698-973b-48770b6a22bd None admin] RBAC: Authorizing `identity:create_grant(project_id=3e8cca114ed04209a31e58f224967b4a, user_id=596421c1ac2e4deda6d43e30972e00d7, role_id=38b6cb84b0e04d4db8dc3ae0793aee31)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:29.401924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f93bf-a273-4698-973b-48770b6a22bd None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:29.480874 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 143/294] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 1 13:34:29 2022] PUT /identity/v3/projects/3e8cca114ed04209a31e58f224967b4a/users/596421c1ac2e4deda6d43e30972e00d7/roles/38b6cb84b0e04d4db8dc3ae0793aee31 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:34:29.721454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69454e6a-a1c8-44e9-a930-c4da5ba9acdc None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:29.721983 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69454e6a-a1c8-44e9-a930-c4da5ba9acdc None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:29.721983 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69454e6a-a1c8-44e9-a930-c4da5ba9acdc None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:29.723829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 152/295] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:29.729783 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf06a55-0f94-4e59-9837-9bf9ec2d92c2 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:29.730074 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf06a55-0f94-4e59-9837-9bf9ec2d92c2 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:29.730354 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf06a55-0f94-4e59-9837-9bf9ec2d92c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:29.747553 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0677394-d891-4b84-abf1-60bb97394ead None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:29.747795 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0677394-d891-4b84-abf1-60bb97394ead None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:29.748078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0677394-d891-4b84-abf1-60bb97394ead None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:29.749431 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 153/296] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:29.752647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-dcf06a55-0f94-4e59-9837-9bf9ec2d92c2 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:29.754399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-dcf06a55-0f94-4e59-9837-9bf9ec2d92c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:29.754934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d024d3-0605-4d4c-85f6-8291c70953e9 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:29.755224 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d024d3-0605-4d4c-85f6-8291c70953e9 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:29.755533 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d024d3-0605-4d4c-85f6-8291c70953e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:29.777693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-98d024d3-0605-4d4c-85f6-8291c70953e9 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:29.779190 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-98d024d3-0605-4d4c-85f6-8291c70953e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:29.798720 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:29.833048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:29.835089 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 144/297] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:29.861394 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 154/298] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:34:30.052733 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3aa42-5bd6-4b31-bc1b-a1c738d4533c None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:30.053151 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3aa42-5bd6-4b31-bc1b-a1c738d4533c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:30.053341 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3aa42-5bd6-4b31-bc1b-a1c738d4533c None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:30.054953 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 145/299] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:30.060790 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022de26-933b-4aec-bd6a-e7f536dacea2 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:30.061078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022de26-933b-4aec-bd6a-e7f536dacea2 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:30.061353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022de26-933b-4aec-bd6a-e7f536dacea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:30.079705 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-7022de26-933b-4aec-bd6a-e7f536dacea2 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:30.080894 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-7022de26-933b-4aec-bd6a-e7f536dacea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:30.131979 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3aa42-5bd6-4b31-bc1b-a1c738d4533c None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:30.154671 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 155/300] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:30.155830 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022de26-933b-4aec-bd6a-e7f536dacea2 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:30.260642 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022de26-933b-4aec-bd6a-e7f536dacea2 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:30.266204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3aa42-5bd6-4b31-bc1b-a1c738d4533c None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:30.273083 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:30.299210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b048696-69a4-44c7-bfc8-0dd3b255878d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:30.300269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b048696-69a4-44c7-bfc8-0dd3b255878d None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:30.300815 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b048696-69a4-44c7-bfc8-0dd3b255878d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:30.301286 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b048696-69a4-44c7-bfc8-0dd3b255878d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:30.310854 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf481620-174c-4ca4-8ac5-674f0dd59c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:30.311458 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf481620-174c-4ca4-8ac5-674f0dd59c6e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:30.312051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf481620-174c-4ca4-8ac5-674f0dd59c6e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:30.312326 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf481620-174c-4ca4-8ac5-674f0dd59c6e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:30.316335 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b048696-69a4-44c7-bfc8-0dd3b255878d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:30.321829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-7b048696-69a4-44c7-bfc8-0dd3b255878d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:30.321829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:30.321829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:30.321829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:30.321829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:30.321829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:30.321829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:30.321829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:30.321829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:30.321829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:30.321829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:30.321829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:30.321829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:30.321829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:30.321829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:30.321829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:30.322720 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:30.322720 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:30.322720 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:30.322720 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:30.322720 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:30.322720 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:30.322720 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:30.322720 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:30.322720 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:30.322720 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:30.322720 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:30.322720 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:30.322720 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:30.322720 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:30.322720 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:30.322720 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:30.323547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:30.323547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:30.323547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:30.323547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:30.323547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:30.323547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:30.323547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:30.323547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:30.323547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:30.323547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:30.323547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:30.323547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:30.324128 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf481620-174c-4ca4-8ac5-674f0dd59c6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:30.325539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 156/301] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:30.331418 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-bf481620-174c-4ca4-8ac5-674f0dd59c6e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:34:30.331418 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:30.331418 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:30.331418 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:30.331418 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:30.331418 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:30.331418 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:30.331418 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:30.331418 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:30.331418 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:30.331418 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:30.331418 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:30.331418 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:30.331418 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:30.331418 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:30.331418 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:30.332293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:30.332293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:30.332293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:30.332293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:30.332293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:30.332293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:30.332293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:30.332293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:30.332293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:30.332293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:30.332293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:30.332293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:30.332293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:30.332293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:30.332293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:30.332293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:30.333053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:30.333053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:30.333053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:30.333053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:30.333053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:30.333053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:30.333053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:30.333053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:30.333053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:30.333053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:30.333053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:34:30.333053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:30.333053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 146/302] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:30.333680 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b048696-69a4-44c7-bfc8-0dd3b255878d None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:30.339991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf481620-174c-4ca4-8ac5-674f0dd59c6e None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:30.382297 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:30.451962 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b048696-69a4-44c7-bfc8-0dd3b255878d None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:30.473568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf481620-174c-4ca4-8ac5-674f0dd59c6e None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:30.489563 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b22f8-843b-40e3-8d32-5a82a47677c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:30.490263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b22f8-843b-40e3-8d32-5a82a47677c4 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:30.490575 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b22f8-843b-40e3-8d32-5a82a47677c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:30.490844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b22f8-843b-40e3-8d32-5a82a47677c4 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:30.491509 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b22f8-843b-40e3-8d32-5a82a47677c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:30.491814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b22f8-843b-40e3-8d32-5a82a47677c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:30.493336 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b22f8-843b-40e3-8d32-5a82a47677c4 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:30.502095 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 157/303] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 1 13:34:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:30.502748 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b22f8-843b-40e3-8d32-5a82a47677c4 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:30.515736 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bb93b-263d-4eff-bc30-94ef31e9f282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:30.516346 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bb93b-263d-4eff-bc30-94ef31e9f282 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:30.516625 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bb93b-263d-4eff-bc30-94ef31e9f282 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:30.516904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bb93b-263d-4eff-bc30-94ef31e9f282 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:30.517578 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94bb93b-263d-4eff-bc30-94ef31e9f282 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:30.517882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94bb93b-263d-4eff-bc30-94ef31e9f282 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:30.519344 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94bb93b-263d-4eff-bc30-94ef31e9f282 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:30.528357 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 147/304] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 1 13:34:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:34:30.532575 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bb93b-263d-4eff-bc30-94ef31e9f282 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:30.537568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:30.607651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b22f8-843b-40e3-8d32-5a82a47677c4 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:30.633219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:30.640291 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bb93b-263d-4eff-bc30-94ef31e9f282 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:30.640875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c6cf9-5880-4b53-b4c0-bf560d085ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:30.641512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c6cf9-5880-4b53-b4c0-bf560d085ab4 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:30.641795 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c6cf9-5880-4b53-b4c0-bf560d085ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:30.642066 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c6cf9-5880-4b53-b4c0-bf560d085ab4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:30.643172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c6cf9-5880-4b53-b4c0-bf560d085ab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:30.644671 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c6cf9-5880-4b53-b4c0-bf560d085ab4 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:30.646446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 158/305] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:34:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:30.648187 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c6cf9-5880-4b53-b4c0-bf560d085ab4 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:30.676969 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce22cb-b6df-4397-b77d-75c5fbdc9c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:30.677595 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce22cb-b6df-4397-b77d-75c5fbdc9c98 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:30.677870 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce22cb-b6df-4397-b77d-75c5fbdc9c98 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:30.678141 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce22cb-b6df-4397-b77d-75c5fbdc9c98 None admin] PATH_INFO: `/v3/users/8754e5e8adf0416497329f35ed7f1f75` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:30.679431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce22cb-b6df-4397-b77d-75c5fbdc9c98 None admin] RBAC: Authorizing `identity:get_user(user_id=8754e5e8adf0416497329f35ed7f1f75)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:30.680865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce22cb-b6df-4397-b77d-75c5fbdc9c98 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:30.682537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 148/306] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:30 2022] GET /identity/v3/users/8754e5e8adf0416497329f35ed7f1f75 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:30.683302 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce22cb-b6df-4397-b77d-75c5fbdc9c98 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:30.763997 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:30.767530 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c6cf9-5880-4b53-b4c0-bf560d085ab4 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:30.787602 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce22cb-b6df-4397-b77d-75c5fbdc9c98 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:30.803447 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf68796-da15-400b-856f-7040ed207786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:30.804117 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf68796-da15-400b-856f-7040ed207786 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:30.804401 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf68796-da15-400b-856f-7040ed207786 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:30.804682 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf68796-da15-400b-856f-7040ed207786 None admin] PATH_INFO: `/v3/users/8883a8f6056c4157ab9aba797e96de74` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:30.818658 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf68796-da15-400b-856f-7040ed207786 None admin] RBAC: Authorizing `identity:get_user(user_id=8883a8f6056c4157ab9aba797e96de74)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:30.820519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf68796-da15-400b-856f-7040ed207786 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:30.821362 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c17bb-aafc-4e7f-8fb3-45f321793fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:30.821980 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c17bb-aafc-4e7f-8fb3-45f321793fbf None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:30.822468 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c17bb-aafc-4e7f-8fb3-45f321793fbf None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:30.822587 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 159/307] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:30 2022] GET /identity/v3/users/8883a8f6056c4157ab9aba797e96de74 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:30.822671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c17bb-aafc-4e7f-8fb3-45f321793fbf None admin] PATH_INFO: `/v3/groups` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:30.823151 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c17bb-aafc-4e7f-8fb3-45f321793fbf None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:30.825190 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c17bb-aafc-4e7f-8fb3-45f321793fbf None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:30.828262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf68796-da15-400b-856f-7040ed207786 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:30.920916 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 149/308] 10.222.0.50 () {60 vars in 1134 bytes} [Thu Sep 1 13:34:30 2022] POST /identity/v3/groups => generated 229 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:34:30.922051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c17bb-aafc-4e7f-8fb3-45f321793fbf None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:30.941371 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf68796-da15-400b-856f-7040ed207786 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:30.952505 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:30.995664 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdad554-9c76-4614-9cef-1369bf2db70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:30.996966 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdad554-9c76-4614-9cef-1369bf2db70f None admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:30.997827 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdad554-9c76-4614-9cef-1369bf2db70f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:30.998333 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdad554-9c76-4614-9cef-1369bf2db70f None admin] PATH_INFO: `/v3/system/users/8754e5e8adf0416497329f35ed7f1f75/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:31.000494 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdad554-9c76-4614-9cef-1369bf2db70f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8754e5e8adf0416497329f35ed7f1f75, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:31.003038 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdad554-9c76-4614-9cef-1369bf2db70f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:31.049265 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c17bb-aafc-4e7f-8fb3-45f321793fbf None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:31.089984 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae4b79-5a2c-43c3-accc-07b2d7f58308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:31.090586 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae4b79-5a2c-43c3-accc-07b2d7f58308 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:31.090860 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae4b79-5a2c-43c3-accc-07b2d7f58308 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:31.091122 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae4b79-5a2c-43c3-accc-07b2d7f58308 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:31.092001 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae4b79-5a2c-43c3-accc-07b2d7f58308 None admin] RBAC: Adding query filter params (role.id=38b6cb84b0e04d4db8dc3ae0793aee31, user.id=8883a8f6056c4157ab9aba797e96de74, scope.system=all) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:31.092234 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae4b79-5a2c-43c3-accc-07b2d7f58308 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:31.093670 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae4b79-5a2c-43c3-accc-07b2d7f58308 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:31.094806 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 160/309] 10.222.0.50 () {58 vars in 1334 bytes} [Thu Sep 1 13:34:30 2022] PUT /identity/v3/system/users/8754e5e8adf0416497329f35ed7f1f75/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:34:31.099413 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 150/310] 10.222.0.50 () {56 vars in 1308 bytes} [Thu Sep 1 13:34:30 2022] GET /identity/v3/role_assignments?user.id=8883a8f6056c4157ab9aba797e96de74&scope.system=all&role.id=38b6cb84b0e04d4db8dc3ae0793aee31 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:31.460070 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ebcbd-aaf6-4f0a-a63f-fadb8600fe47 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:31.460455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ebcbd-aaf6-4f0a-a63f-fadb8600fe47 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:31.460654 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ebcbd-aaf6-4f0a-a63f-fadb8600fe47 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:31.462258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 161/311] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:31.467466 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b9ee6-9d38-45a1-8677-cdb530cca7aa None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:31.467752 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b9ee6-9d38-45a1-8677-cdb530cca7aa None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:31.468028 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b9ee6-9d38-45a1-8677-cdb530cca7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:31.486860 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-e40b9ee6-9d38-45a1-8677-cdb530cca7aa None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:31.488063 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-e40b9ee6-9d38-45a1-8677-cdb530cca7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:31.561458 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 151/312] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:31.831069 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ebcbd-aaf6-4f0a-a63f-fadb8600fe47 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:31.867371 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:31.947838 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ebcbd-aaf6-4f0a-a63f-fadb8600fe47 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:31.986147 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a137622-622c-41d6-bc9c-aa29fe658be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:31.986809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a137622-622c-41d6-bc9c-aa29fe658be0 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:31.987092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a137622-622c-41d6-bc9c-aa29fe658be0 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:31.987392 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a137622-622c-41d6-bc9c-aa29fe658be0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:31.999814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a137622-622c-41d6-bc9c-aa29fe658be0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:32.004868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-8a137622-622c-41d6-bc9c-aa29fe658be0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:34:32.004868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:32.004868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:32.004868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:32.004868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:32.004868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:32.004868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:32.004868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:32.004868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:32.004868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:32.004868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:32.004868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:32.004868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:32.004868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:32.004868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:32.004868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:32.005744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:32.005744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:32.005744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:32.005744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:32.005744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:32.005744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:32.005744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:32.005744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:32.005744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:32.005744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:32.005744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:32.005744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:32.005744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:32.005744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:32.005744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:32.005744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:32.006519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:32.006519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:32.006519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:32.006519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:32.006519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:32.006519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:32.006519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:32.006519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:32.006519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:32.006519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:32.006519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:34:32.006519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:32.006519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 162/313] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:32.012529 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b9ee6-9d38-45a1-8677-cdb530cca7aa None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:32.031854 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:32.126807 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b9ee6-9d38-45a1-8677-cdb530cca7aa None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:32.171600 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd30c3a-ab74-4f7b-9f38-643a5f2b5954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:32.172228 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd30c3a-ab74-4f7b-9f38-643a5f2b5954 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:32.172547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd30c3a-ab74-4f7b-9f38-643a5f2b5954 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:32.172817 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd30c3a-ab74-4f7b-9f38-643a5f2b5954 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:32.173505 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd30c3a-ab74-4f7b-9f38-643a5f2b5954 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:32.173805 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd30c3a-ab74-4f7b-9f38-643a5f2b5954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:32.175208 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd30c3a-ab74-4f7b-9f38-643a5f2b5954 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:32.187405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 152/314] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 1 13:34:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:32.198866 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a137622-622c-41d6-bc9c-aa29fe658be0 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:32.298585 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:32.330276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a137622-622c-41d6-bc9c-aa29fe658be0 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:32.390749 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200aa999-0be3-4a36-9a22-2a29e4d624ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:32.391744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200aa999-0be3-4a36-9a22-2a29e4d624ad None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:32.392233 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200aa999-0be3-4a36-9a22-2a29e4d624ad None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:32.392725 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200aa999-0be3-4a36-9a22-2a29e4d624ad None admin] PATH_INFO: `/v3/users/596421c1ac2e4deda6d43e30972e00d7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:32.394616 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200aa999-0be3-4a36-9a22-2a29e4d624ad None admin] RBAC: Authorizing `identity:get_user(user_id=596421c1ac2e4deda6d43e30972e00d7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:32.397316 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200aa999-0be3-4a36-9a22-2a29e4d624ad None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:32.400609 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 163/315] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:32 2022] GET /identity/v3/users/596421c1ac2e4deda6d43e30972e00d7 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:32.405820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd30c3a-ab74-4f7b-9f38-643a5f2b5954 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:32.491787 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:32.514101 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd30c3a-ab74-4f7b-9f38-643a5f2b5954 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:32.549863 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b021cf6-4eca-4aaa-9364-492bfc04f815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:32.550467 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b021cf6-4eca-4aaa-9364-492bfc04f815 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:32.550741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b021cf6-4eca-4aaa-9364-492bfc04f815 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:32.551011 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b021cf6-4eca-4aaa-9364-492bfc04f815 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:32.620873 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b021cf6-4eca-4aaa-9364-492bfc04f815 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:32.622330 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b021cf6-4eca-4aaa-9364-492bfc04f815 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:32.704626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:32.727939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 153/316] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 13:34:32.734238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200aa999-0be3-4a36-9a22-2a29e4d624ad None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:32.846456 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200aa999-0be3-4a36-9a22-2a29e4d624ad None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:32.882874 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21399d8-b22c-47f4-833a-94c34b018e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:32.883547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21399d8-b22c-47f4-833a-94c34b018e19 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:32.883828 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21399d8-b22c-47f4-833a-94c34b018e19 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:32.884101 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21399d8-b22c-47f4-833a-94c34b018e19 None admin] PATH_INFO: `/v3/projects/3e8cca114ed04209a31e58f224967b4a` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:32.885273 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21399d8-b22c-47f4-833a-94c34b018e19 None admin] RBAC: Authorizing `identity:get_project(project_id=3e8cca114ed04209a31e58f224967b4a)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:32.887332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21399d8-b22c-47f4-833a-94c34b018e19 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:32.889400 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 164/317] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:32 2022] GET /identity/v3/projects/3e8cca114ed04209a31e58f224967b4a => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:32.895283 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b021cf6-4eca-4aaa-9364-492bfc04f815 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:33.003877 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b021cf6-4eca-4aaa-9364-492bfc04f815 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:33.013625 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549aa64c-e756-4568-818b-a520316c2344 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:33.013934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549aa64c-e756-4568-818b-a520316c2344 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:33.014182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549aa64c-e756-4568-818b-a520316c2344 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:33.015704 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 165/318] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:34:33.020710 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5883b7-0ae3-416c-be9e-68d7119235be None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:33.020993 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5883b7-0ae3-416c-be9e-68d7119235be None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:33.021265 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5883b7-0ae3-416c-be9e-68d7119235be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:33.040715 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b61eb-03de-4f0b-8e35-00fa48bafb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:33.040919 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-bd5883b7-0ae3-416c-be9e-68d7119235be None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:33.041325 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b61eb-03de-4f0b-8e35-00fa48bafb6e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:33.041662 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b61eb-03de-4f0b-8e35-00fa48bafb6e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:33.041973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b61eb-03de-4f0b-8e35-00fa48bafb6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:33.042157 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-bd5883b7-0ae3-416c-be9e-68d7119235be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:33.042707 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b61eb-03de-4f0b-8e35-00fa48bafb6e None admin] RBAC: Adding query filter params (role.id=38b6cb84b0e04d4db8dc3ae0793aee31, scope.project.id=3e8cca114ed04209a31e58f224967b4a, user.id=596421c1ac2e4deda6d43e30972e00d7) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:33.043014 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b61eb-03de-4f0b-8e35-00fa48bafb6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:33.044576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b61eb-03de-4f0b-8e35-00fa48bafb6e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:33.051218 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 154/319] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:34:32 2022] GET /identity/v3/role_assignments?user.id=596421c1ac2e4deda6d43e30972e00d7&scope.project.id=3e8cca114ed04209a31e58f224967b4a&role.id=38b6cb84b0e04d4db8dc3ae0793aee31 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:33.059830 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:33.109698 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816cb5f-ac91-4656-a865-0f7b2c3a0875 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:33.110038 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816cb5f-ac91-4656-a865-0f7b2c3a0875 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:33.110244 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816cb5f-ac91-4656-a865-0f7b2c3a0875 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:33.112008 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 155/320] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:33.122983 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39debc-e9c5-4527-ad24-044cdf17d3df None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:33.123291 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39debc-e9c5-4527-ad24-044cdf17d3df None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:33.123577 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39debc-e9c5-4527-ad24-044cdf17d3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:33.126682 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 166/321] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:34:33.144317 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa141f0-9b2f-4688-93a0-58063f80f035 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:33.144638 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa141f0-9b2f-4688-93a0-58063f80f035 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:33.144928 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa141f0-9b2f-4688-93a0-58063f80f035 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:33.145091 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-7a39debc-e9c5-4527-ad24-044cdf17d3df None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:33.146291 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-7a39debc-e9c5-4527-ad24-044cdf17d3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:33.146644 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 167/322] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:34:33.153836 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ba7c2-7816-4f18-aa7c-a5417eb6a4b4 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:33.154146 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ba7c2-7816-4f18-aa7c-a5417eb6a4b4 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:33.154395 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ba7c2-7816-4f18-aa7c-a5417eb6a4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:33.173971 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-1e8ba7c2-7816-4f18-aa7c-a5417eb6a4b4 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:33.175200 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-1e8ba7c2-7816-4f18-aa7c-a5417eb6a4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:33.193365 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:33.238923 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 156/323] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:34:33.257709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 168/324] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:34:33.393356 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39debc-e9c5-4527-ad24-044cdf17d3df None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:33.496334 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39debc-e9c5-4527-ad24-044cdf17d3df None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:33.504537 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ba7c2-7816-4f18-aa7c-a5417eb6a4b4 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:33.532633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f11603-0468-4cf2-81fe-2b550387afb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:33.533283 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f11603-0468-4cf2-81fe-2b550387afb9 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:33.533562 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f11603-0468-4cf2-81fe-2b550387afb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:33.533835 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f11603-0468-4cf2-81fe-2b550387afb9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:33.534935 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f11603-0468-4cf2-81fe-2b550387afb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:33.536442 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f11603-0468-4cf2-81fe-2b550387afb9 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:33.538007 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 157/325] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:34:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:33.538852 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f11603-0468-4cf2-81fe-2b550387afb9 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:33.581215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:33.585568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:33.606952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ba7c2-7816-4f18-aa7c-a5417eb6a4b4 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:33.640571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f11603-0468-4cf2-81fe-2b550387afb9 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:33.641971 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bef3f5-fb87-470a-a247-d9d006e2579a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:33.642599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bef3f5-fb87-470a-a247-d9d006e2579a None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:33.642881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bef3f5-fb87-470a-a247-d9d006e2579a None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:33.643153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bef3f5-fb87-470a-a247-d9d006e2579a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:33.653920 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bef3f5-fb87-470a-a247-d9d006e2579a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:33.658741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-d8bef3f5-fb87-470a-a247-d9d006e2579a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:34:33.658741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:33.658741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:33.658741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:33.658741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:33.658741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:33.658741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:33.658741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:33.658741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:33.658741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:33.658741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:33.658741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:33.658741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:33.658741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:33.658741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:33.658741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:33.659708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:33.659708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:33.659708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:33.659708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:33.659708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:33.659708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:33.659708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:33.659708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:33.659708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:33.659708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:33.659708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:33.659708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:33.659708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:33.659708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:33.659708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:33.659708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:33.660473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:33.660473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:33.660473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:33.660473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:33.660473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:33.660473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:33.660473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:33.660473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:33.660473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:33.660473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:33.660473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:34:33.660473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:33.660473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 169/326] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:34:33.661104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bef3f5-fb87-470a-a247-d9d006e2579a None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:33.677488 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a0b1b-e247-448f-af3a-a8a630ec9280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:33.678334 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a0b1b-e247-448f-af3a-a8a630ec9280 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:33.678621 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a0b1b-e247-448f-af3a-a8a630ec9280 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:33.678896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a0b1b-e247-448f-af3a-a8a630ec9280 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:33.689643 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a0b1b-e247-448f-af3a-a8a630ec9280 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:33.694825 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-6e4a0b1b-e247-448f-af3a-a8a630ec9280 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:33.694825 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:33.694825 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:33.694825 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:33.694825 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:33.694825 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:33.694825 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:33.694825 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:33.694825 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:33.694825 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:33.694825 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:33.694825 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:33.694825 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:33.694825 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:33.694825 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:33.694825 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:33.695898 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:33.695898 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:33.695898 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:33.695898 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:33.695898 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:33.695898 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:33.695898 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:33.695898 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:33.695898 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:33.695898 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:33.695898 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:33.695898 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:33.695898 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:33.695898 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:33.695898 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:33.695898 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:33.696703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:33.696703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:33.696703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:33.696703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:33.696703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:33.696703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:33.696703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:33.696703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:33.696703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:33.696703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:33.696703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:33.696703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:33.696703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 158/327] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:33.696703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a0b1b-e247-448f-af3a-a8a630ec9280 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:33.762886 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bef3f5-fb87-470a-a247-d9d006e2579a None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:33.793012 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:33.795732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a0b1b-e247-448f-af3a-a8a630ec9280 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:33.797088 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee667e-4434-4d93-a329-a6cb076afd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:33.797589 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee667e-4434-4d93-a329-a6cb076afd9b None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:33.797877 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee667e-4434-4d93-a329-a6cb076afd9b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:33.798140 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee667e-4434-4d93-a329-a6cb076afd9b None admin] PATH_INFO: `/v3/groups` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:33.798763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee667e-4434-4d93-a329-a6cb076afd9b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:33.800236 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee667e-4434-4d93-a329-a6cb076afd9b None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:33.829631 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01bfcf-907a-4c08-8eb1-8ccf058366fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:33.830232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01bfcf-907a-4c08-8eb1-8ccf058366fe None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:33.830509 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01bfcf-907a-4c08-8eb1-8ccf058366fe None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:33.830780 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01bfcf-907a-4c08-8eb1-8ccf058366fe None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:33.831465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01bfcf-907a-4c08-8eb1-8ccf058366fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:33.831774 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01bfcf-907a-4c08-8eb1-8ccf058366fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:33.833140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01bfcf-907a-4c08-8eb1-8ccf058366fe None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:33.841742 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 159/328] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 1 13:34:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:33.842586 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01bfcf-907a-4c08-8eb1-8ccf058366fe None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:33.917546 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:33.922652 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 170/329] 10.222.0.50 () {60 vars in 1134 bytes} [Thu Sep 1 13:34:33 2022] POST /identity/v3/groups => generated 226 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:34:33.923502 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee667e-4434-4d93-a329-a6cb076afd9b None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:33.946740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01bfcf-907a-4c08-8eb1-8ccf058366fe None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:33.984787 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf592d9-c51f-40d6-9127-060fe826eb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:33.985404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf592d9-c51f-40d6-9127-060fe826eb01 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:33.985683 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf592d9-c51f-40d6-9127-060fe826eb01 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:33.985952 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf592d9-c51f-40d6-9127-060fe826eb01 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:33.986629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf592d9-c51f-40d6-9127-060fe826eb01 None admin] RBAC: Adding query filter params (name=member) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:33.986932 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf592d9-c51f-40d6-9127-060fe826eb01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:33.988475 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf592d9-c51f-40d6-9127-060fe826eb01 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:33.998351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 160/330] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 1 13:34:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:34.004798 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf592d9-c51f-40d6-9127-060fe826eb01 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:34.033635 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:34.043285 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee667e-4434-4d93-a329-a6cb076afd9b None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:34.083058 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76ae21-64c3-453e-9e42-a074c9de3717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:34.084056 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76ae21-64c3-453e-9e42-a074c9de3717 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:34.084338 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76ae21-64c3-453e-9e42-a074c9de3717 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:34.084607 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76ae21-64c3-453e-9e42-a074c9de3717 None admin] PATH_INFO: `/v3/users/8883a8f6056c4157ab9aba797e96de74` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:34.085992 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b76ae21-64c3-453e-9e42-a074c9de3717 None admin] RBAC: Authorizing `identity:get_user(user_id=8883a8f6056c4157ab9aba797e96de74)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:34.087483 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b76ae21-64c3-453e-9e42-a074c9de3717 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:34.089374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 171/331] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:33 2022] GET /identity/v3/users/8883a8f6056c4157ab9aba797e96de74 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:34.094948 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76ae21-64c3-453e-9e42-a074c9de3717 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:34.121166 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf592d9-c51f-40d6-9127-060fe826eb01 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:34.161548 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4d82b-a152-48b2-be73-1b0ddbaa63b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:34.162176 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4d82b-a152-48b2-be73-1b0ddbaa63b6 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:34.162449 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4d82b-a152-48b2-be73-1b0ddbaa63b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:34.162715 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4d82b-a152-48b2-be73-1b0ddbaa63b6 None admin] PATH_INFO: `/v3/users/8754e5e8adf0416497329f35ed7f1f75` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:34.164237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4d82b-a152-48b2-be73-1b0ddbaa63b6 None admin] RBAC: Authorizing `identity:get_user(user_id=8754e5e8adf0416497329f35ed7f1f75)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:34.165724 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4d82b-a152-48b2-be73-1b0ddbaa63b6 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:34.168913 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 161/332] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:34 2022] GET /identity/v3/users/8754e5e8adf0416497329f35ed7f1f75 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:34:34.171888 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:34.175067 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4d82b-a152-48b2-be73-1b0ddbaa63b6 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:34.216259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76ae21-64c3-453e-9e42-a074c9de3717 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:34.263703 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16e5d5-b9b1-47ac-b7be-1d5574a7e0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:34.264689 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16e5d5-b9b1-47ac-b7be-1d5574a7e0e6 None admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:34.265099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16e5d5-b9b1-47ac-b7be-1d5574a7e0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:34.265510 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16e5d5-b9b1-47ac-b7be-1d5574a7e0e6 None admin] PATH_INFO: `/v3/system/users/8883a8f6056c4157ab9aba797e96de74/roles/38b6cb84b0e04d4db8dc3ae0793aee31` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:34.267740 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16e5d5-b9b1-47ac-b7be-1d5574a7e0e6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8883a8f6056c4157ab9aba797e96de74, role_id=38b6cb84b0e04d4db8dc3ae0793aee31)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:34.269300 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16e5d5-b9b1-47ac-b7be-1d5574a7e0e6 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:34.286309 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:34.299096 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4d82b-a152-48b2-be73-1b0ddbaa63b6 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:34.333767 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a275f-a760-4d91-aab4-93495e9a43a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:34.334608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 172/333] 10.222.0.50 () {58 vars in 1334 bytes} [Thu Sep 1 13:34:34 2022] PUT /identity/v3/system/users/8883a8f6056c4157ab9aba797e96de74/roles/38b6cb84b0e04d4db8dc3ae0793aee31 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:34:34.334777 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a275f-a760-4d91-aab4-93495e9a43a3 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:34.335074 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a275f-a760-4d91-aab4-93495e9a43a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:34.335351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a275f-a760-4d91-aab4-93495e9a43a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:34.336130 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a275f-a760-4d91-aab4-93495e9a43a3 None admin] RBAC: Adding query filter params (role.id=3654765b6c2644779fda2924f119aef7, user.id=8754e5e8adf0416497329f35ed7f1f75, scope.system=all) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:34.336441 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a275f-a760-4d91-aab4-93495e9a43a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:34.337889 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a275f-a760-4d91-aab4-93495e9a43a3 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:34.353480 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 162/334] 10.222.0.50 () {56 vars in 1308 bytes} [Thu Sep 1 13:34:34 2022] GET /identity/v3/role_assignments?user.id=8754e5e8adf0416497329f35ed7f1f75&scope.system=all&role.id=3654765b6c2644779fda2924f119aef7 => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:34:36.062411 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5477ce-dc23-42a6-8a31-90c055f04c65 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:36.062909 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5477ce-dc23-42a6-8a31-90c055f04c65 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:36.062980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5477ce-dc23-42a6-8a31-90c055f04c65 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:36.064578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 173/335] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:36.070131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3abfc-6603-41cb-b300-0d2859e465ca None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:36.070558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3abfc-6603-41cb-b300-0d2859e465ca None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:36.070734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3abfc-6603-41cb-b300-0d2859e465ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:36.093373 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-cfe3abfc-6603-41cb-b300-0d2859e465ca None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:36.094638 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-cfe3abfc-6603-41cb-b300-0d2859e465ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:36.179742 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 163/336] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:36.277459 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c7671-666e-49d0-820a-a55e8827270d None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:36.277772 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c7671-666e-49d0-820a-a55e8827270d None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:36.278024 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c7671-666e-49d0-820a-a55e8827270d None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:36.279394 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 174/337] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:36.284950 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af3ae2-d7a3-4f14-b949-818352caf75d None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:36.285301 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af3ae2-d7a3-4f14-b949-818352caf75d None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:36.285521 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af3ae2-d7a3-4f14-b949-818352caf75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:36.306181 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-32af3ae2-d7a3-4f14-b949-818352caf75d None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:36.307426 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-32af3ae2-d7a3-4f14-b949-818352caf75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:36.392484 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 164/338] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:36.447431 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701e7bd-1c5c-440f-bde1-96e7039738f4 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:36.447749 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701e7bd-1c5c-440f-bde1-96e7039738f4 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:36.448613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701e7bd-1c5c-440f-bde1-96e7039738f4 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:36.450234 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 175/339] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:36.455394 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b68ce-b6ca-4644-9218-b0cec73cb05c None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:36.455715 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b68ce-b6ca-4644-9218-b0cec73cb05c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:36.455995 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b68ce-b6ca-4644-9218-b0cec73cb05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:36.480353 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-663b68ce-b6ca-4644-9218-b0cec73cb05c None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:36.481552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-663b68ce-b6ca-4644-9218-b0cec73cb05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:36.484986 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:36.566269 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 165/340] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:36.704547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701e7bd-1c5c-440f-bde1-96e7039738f4 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:36.845925 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701e7bd-1c5c-440f-bde1-96e7039738f4 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:36.881317 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:36.892388 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e1731-79f6-41bf-9cae-389040bbd88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:36.893034 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e1731-79f6-41bf-9cae-389040bbd88d None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:36.893315 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e1731-79f6-41bf-9cae-389040bbd88d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:36.893586 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e1731-79f6-41bf-9cae-389040bbd88d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:36.909149 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e1731-79f6-41bf-9cae-389040bbd88d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:36.914037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-c69e1731-79f6-41bf-9cae-389040bbd88d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:36.914037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:36.914037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:36.914037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:36.914037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:36.914037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:36.914037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:36.914037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:36.914037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:36.914037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:36.914037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:36.914037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:36.914037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:36.914037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:36.914037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:36.914037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:36.916083 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:36.916083 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:36.916083 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:36.916083 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:36.916083 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:36.916083 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:36.916083 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:36.916083 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:36.916083 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:36.916083 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:36.916083 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:36.916083 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:36.916083 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:36.916083 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:36.916083 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:36.916083 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:36.918115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:36.918115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:36.918115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:36.918115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:36.918115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:36.918115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:36.918115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:36.918115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:36.918115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:36.918115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:36.918115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:36.918115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:36.918115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 176/341] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:36.922186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e1731-79f6-41bf-9cae-389040bbd88d None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:36.922401 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b68ce-b6ca-4644-9218-b0cec73cb05c None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:37.051900 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e1731-79f6-41bf-9cae-389040bbd88d None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:37.089991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b68ce-b6ca-4644-9218-b0cec73cb05c None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:37.104625 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7bb4d-7eec-448f-a000-b29882799bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:37.105512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7bb4d-7eec-448f-a000-b29882799bf2 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:37.105777 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7bb4d-7eec-448f-a000-b29882799bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:37.106047 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7bb4d-7eec-448f-a000-b29882799bf2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:37.121489 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7bb4d-7eec-448f-a000-b29882799bf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:37.127273 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-02e7bb4d-7eec-448f-a000-b29882799bf2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:34:37.127273 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:37.127273 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:37.127273 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:37.127273 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:37.127273 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:37.127273 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:37.127273 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:37.127273 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:37.127273 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:37.127273 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:37.127273 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:37.127273 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:37.127273 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:37.127273 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:37.127273 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:37.128328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:37.128328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:37.128328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:37.128328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:37.128328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:37.128328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:37.128328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:37.128328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:37.128328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:37.128328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:37.128328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:37.128328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:37.128328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:37.128328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:37.128328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:37.128328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:37.129122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:37.129122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:37.129122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:37.129122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:37.129122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:37.129122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:37.129122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:37.129122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:37.129122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:37.129122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:37.129122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:34:37.129122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:37.129122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 177/342] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 1 13:34:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:37.129796 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047f54e-dda9-4532-8230-17b91bb2d937 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:37.130362 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047f54e-dda9-4532-8230-17b91bb2d937 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:37.130362 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047f54e-dda9-4532-8230-17b91bb2d937 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:37.139491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 178/343] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:37 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:37.143945 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047f54e-dda9-4532-8230-17b91bb2d937 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:37.144130 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa62b1-aa0d-4701-873d-7cb528a4ee78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:37.144130 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa62b1-aa0d-4701-873d-7cb528a4ee78 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:37.144130 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa62b1-aa0d-4701-873d-7cb528a4ee78 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:37.144130 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa62b1-aa0d-4701-873d-7cb528a4ee78 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:37.144701 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa62b1-aa0d-4701-873d-7cb528a4ee78 None admin] RBAC: Adding query filter params (name=member) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:37.144974 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa62b1-aa0d-4701-873d-7cb528a4ee78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:37.146641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa62b1-aa0d-4701-873d-7cb528a4ee78 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:37.165661 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 166/344] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 1 13:34:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:37.166787 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa62b1-aa0d-4701-873d-7cb528a4ee78 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:37.170515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:37.266591 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:37.299852 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa62b1-aa0d-4701-873d-7cb528a4ee78 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:37.338374 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cfb09-aee2-4193-b42c-dcf8a93c65a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:37.339033 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cfb09-aee2-4193-b42c-dcf8a93c65a9 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:37.339148 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047f54e-dda9-4532-8230-17b91bb2d937 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:37.339385 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cfb09-aee2-4193-b42c-dcf8a93c65a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:37.339750 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cfb09-aee2-4193-b42c-dcf8a93c65a9 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:37.340513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cfb09-aee2-4193-b42c-dcf8a93c65a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:37.340883 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cfb09-aee2-4193-b42c-dcf8a93c65a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:37.342368 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cfb09-aee2-4193-b42c-dcf8a93c65a9 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:37.353450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 167/345] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:34:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:37.361290 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57a77a-211f-4648-a6ac-4d778c1a1701 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:37.361663 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57a77a-211f-4648-a6ac-4d778c1a1701 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:37.362014 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57a77a-211f-4648-a6ac-4d778c1a1701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:37.383406 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd59a67-49fc-432f-b8c1-4eac9398bbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:37.384375 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-3f57a77a-211f-4648-a6ac-4d778c1a1701 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:37.384607 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd59a67-49fc-432f-b8c1-4eac9398bbab None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:37.385057 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd59a67-49fc-432f-b8c1-4eac9398bbab None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:37.386108 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd59a67-49fc-432f-b8c1-4eac9398bbab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:37.386437 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-3f57a77a-211f-4648-a6ac-4d778c1a1701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:37.401684 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd59a67-49fc-432f-b8c1-4eac9398bbab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:37.408303 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-3fd59a67-49fc-432f-b8c1-4eac9398bbab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:34:37.408303 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:37.408303 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:37.408303 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:37.408303 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:37.408303 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:37.408303 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:37.408303 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:37.408303 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:37.408303 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:37.408303 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:37.408303 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:37.408303 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:37.408303 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:37.408303 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:37.408303 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:37.409339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:37.409339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:37.409339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:37.409339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:37.409339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:37.409339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:37.409339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:37.409339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:37.409339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:37.409339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:37.409339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:37.409339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:37.409339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:37.409339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:37.409339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:37.409339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:37.410121 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:37.410121 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:37.410121 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:37.410121 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:37.410121 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:37.410121 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:37.410121 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:37.410121 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:37.410121 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:37.410121 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:37.410121 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:34:37.410121 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:37.412863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 179/346] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:37.413932 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd59a67-49fc-432f-b8c1-4eac9398bbab None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:37.479027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:37.512893 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 168/347] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:37.513741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57a77a-211f-4648-a6ac-4d778c1a1701 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:37.548502 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd59a67-49fc-432f-b8c1-4eac9398bbab None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:37.562478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:37.595579 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f3843-d468-41a7-b5fe-ce20ee7fa95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:37.595922 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f3843-d468-41a7-b5fe-ce20ee7fa95c None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:37.596174 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f3843-d468-41a7-b5fe-ce20ee7fa95c None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:37.596442 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f3843-d468-41a7-b5fe-ce20ee7fa95c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:37.659646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57a77a-211f-4648-a6ac-4d778c1a1701 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:37.692673 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f3843-d468-41a7-b5fe-ce20ee7fa95c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:37.694749 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f3843-d468-41a7-b5fe-ce20ee7fa95c None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:37.700504 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8ac97-9415-495d-a0ea-9ceef06e4cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:37.701219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8ac97-9415-495d-a0ea-9ceef06e4cab None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:37.701610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8ac97-9415-495d-a0ea-9ceef06e4cab None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:37.701948 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8ac97-9415-495d-a0ea-9ceef06e4cab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:37.788679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:37.798496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8ac97-9415-495d-a0ea-9ceef06e4cab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:37.800102 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8ac97-9415-495d-a0ea-9ceef06e4cab None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:37.846112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 180/348] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:37.847393 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f3843-d468-41a7-b5fe-ce20ee7fa95c None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:37.861898 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:37.932391 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 169/349] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:37.939010 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8ac97-9415-495d-a0ea-9ceef06e4cab None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:37.988768 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f3843-d468-41a7-b5fe-ce20ee7fa95c None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:38.042409 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ace4ed-9bad-4bd1-abd1-e36345c770e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:38.043635 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ace4ed-9bad-4bd1-abd1-e36345c770e4 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:38.044015 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ace4ed-9bad-4bd1-abd1-e36345c770e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:38.044803 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ace4ed-9bad-4bd1-abd1-e36345c770e4 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:38.045593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ace4ed-9bad-4bd1-abd1-e36345c770e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:38.045999 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ace4ed-9bad-4bd1-abd1-e36345c770e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:38.048340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ace4ed-9bad-4bd1-abd1-e36345c770e4 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:38.060608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 181/350] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 1 13:34:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:38.062547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ace4ed-9bad-4bd1-abd1-e36345c770e4 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:38.070128 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:38.089568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8ac97-9415-495d-a0ea-9ceef06e4cab None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:38.138089 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff3355-2364-47d7-9333-13cea843f050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:38.138729 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff3355-2364-47d7-9333-13cea843f050 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:38.138981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff3355-2364-47d7-9333-13cea843f050 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:38.139261 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff3355-2364-47d7-9333-13cea843f050 None admin] PATH_INFO: `/v3/projects/4ab598b3074241ac9c1da0a539adebc9` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:38.140582 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff3355-2364-47d7-9333-13cea843f050 None admin] RBAC: Authorizing `identity:get_project(project_id=4ab598b3074241ac9c1da0a539adebc9)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:38.142110 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff3355-2364-47d7-9333-13cea843f050 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:38.144265 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 170/351] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:37 2022] GET /identity/v3/projects/4ab598b3074241ac9c1da0a539adebc9 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:38.145097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff3355-2364-47d7-9333-13cea843f050 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:38.163532 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:38.198601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ace4ed-9bad-4bd1-abd1-e36345c770e4 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:38.245630 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b637b69-1ca0-4160-b64b-6a112080ac0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:38.246277 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b637b69-1ca0-4160-b64b-6a112080ac0a None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:38.246558 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b637b69-1ca0-4160-b64b-6a112080ac0a None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:38.246829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b637b69-1ca0-4160-b64b-6a112080ac0a None admin] PATH_INFO: `/v3/projects/4ab598b3074241ac9c1da0a539adebc9` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:38.252242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b637b69-1ca0-4160-b64b-6a112080ac0a None admin] RBAC: Authorizing `identity:get_project(project_id=4ab598b3074241ac9c1da0a539adebc9)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:38.253917 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b637b69-1ca0-4160-b64b-6a112080ac0a None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:38.256029 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 182/352] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:38 2022] GET /identity/v3/projects/4ab598b3074241ac9c1da0a539adebc9 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:38.256946 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b637b69-1ca0-4160-b64b-6a112080ac0a None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:38.265492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff3355-2364-47d7-9333-13cea843f050 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:38.306169 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee51aa-73c3-4b3a-999c-1e7dbc0296e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:38.306919 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee51aa-73c3-4b3a-999c-1e7dbc0296e8 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:38.307251 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee51aa-73c3-4b3a-999c-1e7dbc0296e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:38.309012 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee51aa-73c3-4b3a-999c-1e7dbc0296e8 None admin] PATH_INFO: `/v3/users/8883a8f6056c4157ab9aba797e96de74` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:38.310405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee51aa-73c3-4b3a-999c-1e7dbc0296e8 None admin] RBAC: Authorizing `identity:get_user(user_id=8883a8f6056c4157ab9aba797e96de74)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:38.311975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee51aa-73c3-4b3a-999c-1e7dbc0296e8 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:38.314012 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 171/353] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:34:38 2022] GET /identity/v3/users/8883a8f6056c4157ab9aba797e96de74 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:38.314941 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee51aa-73c3-4b3a-999c-1e7dbc0296e8 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:38.351809 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:38.379862 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b637b69-1ca0-4160-b64b-6a112080ac0a None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:38.429691 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf2b59-1aed-45e1-acdc-7334d271407b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:38.430751 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf2b59-1aed-45e1-acdc-7334d271407b None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:38.431252 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf2b59-1aed-45e1-acdc-7334d271407b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:38.431866 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf2b59-1aed-45e1-acdc-7334d271407b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:38.433186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee51aa-73c3-4b3a-999c-1e7dbc0296e8 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:38.451251 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf2b59-1aed-45e1-acdc-7334d271407b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:38.457433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-69bf2b59-1aed-45e1-acdc-7334d271407b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:38.457433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:38.457433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:38.457433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:38.457433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:38.457433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:38.457433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:38.457433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:38.457433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:38.457433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:38.457433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:38.457433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:38.457433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:38.457433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:38.457433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:38.457433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:38.458292 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:38.458292 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:38.458292 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:38.458292 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:38.458292 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:38.458292 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:38.458292 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:38.458292 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:38.458292 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:38.458292 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:38.458292 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:38.458292 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:38.458292 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:38.458292 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:38.458292 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:38.458292 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:38.459060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:38.459060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:38.459060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:38.459060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:38.459060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:38.459060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:38.459060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:38.459060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:38.459060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:38.459060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:38.459060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:38.459060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:38.461408 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 183/354] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:38.467527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:38.470546 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf2b59-1aed-45e1-acdc-7334d271407b None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:38.474579 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b96b5f-4e75-483d-b8d1-379bf787f4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:38.482589 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b96b5f-4e75-483d-b8d1-379bf787f4cd None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:38.482589 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b96b5f-4e75-483d-b8d1-379bf787f4cd None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:38.482589 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b96b5f-4e75-483d-b8d1-379bf787f4cd None admin] PATH_INFO: `/v3/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:38.482589 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b96b5f-4e75-483d-b8d1-379bf787f4cd None admin] RBAC: Authorizing `identity:get_group(group_id=a8e9c7bd8db745b7a1ef108f9c3fb7f8)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:38.484057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b96b5f-4e75-483d-b8d1-379bf787f4cd None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:38.485720 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 172/355] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 1 13:34:38 2022] GET /identity/v3/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:38.488071 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b96b5f-4e75-483d-b8d1-379bf787f4cd None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:38.596618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf2b59-1aed-45e1-acdc-7334d271407b None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:38.607948 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:38.617345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b96b5f-4e75-483d-b8d1-379bf787f4cd None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:38.641451 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859802b-e049-45f1-967b-4a9322c37ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:38.642091 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859802b-e049-45f1-967b-4a9322c37ed0 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:38.642370 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859802b-e049-45f1-967b-4a9322c37ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:38.642638 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859802b-e049-45f1-967b-4a9322c37ed0 None admin] PATH_INFO: `/v3/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:38.643819 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859802b-e049-45f1-967b-4a9322c37ed0 None admin] RBAC: Authorizing `identity:get_group(group_id=a8e9c7bd8db745b7a1ef108f9c3fb7f8)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:38.645280 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859802b-e049-45f1-967b-4a9322c37ed0 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:38.647958 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 184/356] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 1 13:34:38 2022] GET /identity/v3/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:38.648852 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859802b-e049-45f1-967b-4a9322c37ed0 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:38.657722 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a295e-0c6f-4d96-b7de-a61d7675533a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:38.658342 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a295e-0c6f-4d96-b7de-a61d7675533a None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:38.659223 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a295e-0c6f-4d96-b7de-a61d7675533a None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:38.659569 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a295e-0c6f-4d96-b7de-a61d7675533a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:38.660334 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a295e-0c6f-4d96-b7de-a61d7675533a None admin] RBAC: Adding query filter params (role.id=38b6cb84b0e04d4db8dc3ae0793aee31, user.id=8883a8f6056c4157ab9aba797e96de74, scope.system=all) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:38.660652 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a295e-0c6f-4d96-b7de-a61d7675533a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:38.662126 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a295e-0c6f-4d96-b7de-a61d7675533a None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:38.674679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 173/357] 10.222.0.50 () {56 vars in 1308 bytes} [Thu Sep 1 13:34:38 2022] GET /identity/v3/role_assignments?user.id=8883a8f6056c4157ab9aba797e96de74&scope.system=all&role.id=38b6cb84b0e04d4db8dc3ae0793aee31 => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:38.676495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c4c9a-2e1c-4b87-a3dc-c477b3e57834 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:38.676786 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c4c9a-2e1c-4b87-a3dc-c477b3e57834 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:38.677064 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c4c9a-2e1c-4b87-a3dc-c477b3e57834 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:38.678452 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 174/358] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:38.683267 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c4c9a-2e1c-4b87-a3dc-c477b3e57834 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:38.746167 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:38.791179 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859802b-e049-45f1-967b-4a9322c37ed0 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:38.817740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c4c9a-2e1c-4b87-a3dc-c477b3e57834 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:38.847637 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f78d5c-cb1b-46d7-8f9e-603f53f51e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:38.848262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f78d5c-cb1b-46d7-8f9e-603f53f51e0f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:38.848542 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f78d5c-cb1b-46d7-8f9e-603f53f51e0f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:38.848814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f78d5c-cb1b-46d7-8f9e-603f53f51e0f None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:38.849862 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f78d5c-cb1b-46d7-8f9e-603f53f51e0f None admin] RBAC: Adding query filter params (name=member) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:38.849862 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f78d5c-cb1b-46d7-8f9e-603f53f51e0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:38.851195 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f78d5c-cb1b-46d7-8f9e-603f53f51e0f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:38.860996 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 185/359] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 1 13:34:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:38.861863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f78d5c-cb1b-46d7-8f9e-603f53f51e0f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:38.876591 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925d295-af4e-4310-b7b9-f097cb1d2426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:38.877195 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925d295-af4e-4310-b7b9-f097cb1d2426 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:38.877474 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925d295-af4e-4310-b7b9-f097cb1d2426 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:38.877742 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925d295-af4e-4310-b7b9-f097cb1d2426 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:38.878474 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925d295-af4e-4310-b7b9-f097cb1d2426 None admin] RBAC: Adding query filter params (group.id=a8e9c7bd8db745b7a1ef108f9c3fb7f8, role.id=3654765b6c2644779fda2924f119aef7, scope.project.id=4ab598b3074241ac9c1da0a539adebc9) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:38.878780 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925d295-af4e-4310-b7b9-f097cb1d2426 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:38.880272 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925d295-af4e-4310-b7b9-f097cb1d2426 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:38.889162 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 175/360] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Sep 1 13:34:38 2022] GET /identity/v3/role_assignments?group.id=a8e9c7bd8db745b7a1ef108f9c3fb7f8&scope.project.id=4ab598b3074241ac9c1da0a539adebc9&role.id=3654765b6c2644779fda2924f119aef7 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:38.890464 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d5865-4d0d-45c8-aaa8-c7c1c7e2ebb2 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:38.890753 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d5865-4d0d-45c8-aaa8-c7c1c7e2ebb2 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:38.891030 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d5865-4d0d-45c8-aaa8-c7c1c7e2ebb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:38.916646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-6a8d5865-4d0d-45c8-aaa8-c7c1c7e2ebb2 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:38.917858 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-6a8d5865-4d0d-45c8-aaa8-c7c1c7e2ebb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:38.941131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:39.000487 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f78d5c-cb1b-46d7-8f9e-603f53f51e0f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:39.029757 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 176/361] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:39.031179 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dd7bc-0f28-4631-94f7-69e43f39bfde None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:39.031519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dd7bc-0f28-4631-94f7-69e43f39bfde None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:39.031800 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dd7bc-0f28-4631-94f7-69e43f39bfde None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:39.033704 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 177/362] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:39.034574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692dd7bc-0f28-4631-94f7-69e43f39bfde None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:39.041091 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:39.051166 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80a0ba-21b9-43a6-ba4e-6c91e9418498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:39.056802 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80a0ba-21b9-43a6-ba4e-6c91e9418498 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:39.056802 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80a0ba-21b9-43a6-ba4e-6c91e9418498 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:39.056802 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80a0ba-21b9-43a6-ba4e-6c91e9418498 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:39.056802 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80a0ba-21b9-43a6-ba4e-6c91e9418498 None admin] RBAC: Adding query filter params (group.id=a8e9c7bd8db745b7a1ef108f9c3fb7f8, role.id=f0d2493c03664449802df928b8e8fa53, scope.project.id=4ab598b3074241ac9c1da0a539adebc9) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:39.056802 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80a0ba-21b9-43a6-ba4e-6c91e9418498 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:39.056802 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80a0ba-21b9-43a6-ba4e-6c91e9418498 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:39.065044 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 186/363] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Sep 1 13:34:38 2022] GET /identity/v3/role_assignments?group.id=a8e9c7bd8db745b7a1ef108f9c3fb7f8&scope.project.id=4ab598b3074241ac9c1da0a539adebc9&role.id=f0d2493c03664449802df928b8e8fa53 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:39.066486 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1193596-e336-48c4-8549-efcff534ddc1 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:39.066838 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1193596-e336-48c4-8549-efcff534ddc1 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:39.067176 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1193596-e336-48c4-8549-efcff534ddc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:39.096580 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-a1193596-e336-48c4-8549-efcff534ddc1 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:39.098030 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a1193596-e336-48c4-8549-efcff534ddc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:39.185833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692dd7bc-0f28-4631-94f7-69e43f39bfde None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:39.204380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 187/364] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:39.251053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db330004-8289-43be-9bc7-3c83cbed678e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:39.251704 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db330004-8289-43be-9bc7-3c83cbed678e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:39.251982 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db330004-8289-43be-9bc7-3c83cbed678e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:39.252248 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db330004-8289-43be-9bc7-3c83cbed678e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:39.276320 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:39.323516 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1193596-e336-48c4-8549-efcff534ddc1 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:39.348666 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db330004-8289-43be-9bc7-3c83cbed678e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:39.350259 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db330004-8289-43be-9bc7-3c83cbed678e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:39.459062 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1193596-e336-48c4-8549-efcff534ddc1 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:39.524782 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:39.529612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 178/365] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:39.535852 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db330004-8289-43be-9bc7-3c83cbed678e None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:39.557670 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2f6d3-95af-4c08-9076-6cadf47c8be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:39.558343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2f6d3-95af-4c08-9076-6cadf47c8be4 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:39.558626 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2f6d3-95af-4c08-9076-6cadf47c8be4 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:39.558900 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2f6d3-95af-4c08-9076-6cadf47c8be4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:39.585314 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2f6d3-95af-4c08-9076-6cadf47c8be4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:39.590821 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-d7d2f6d3-95af-4c08-9076-6cadf47c8be4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:34:39.590821 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:39.590821 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:39.590821 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:39.590821 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:39.590821 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:39.590821 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:39.590821 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:39.590821 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:39.590821 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:39.590821 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:39.590821 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:39.590821 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:39.590821 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:39.590821 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:39.590821 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:39.591837 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:39.591837 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:39.591837 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:39.591837 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:39.591837 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:39.591837 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:39.591837 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:39.591837 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:39.591837 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:39.591837 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:39.591837 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:39.591837 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:39.591837 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:39.591837 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:39.591837 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:39.591837 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:39.592858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:39.592858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:39.592858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:39.592858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:39.592858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:39.592858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:39.592858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:39.592858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:39.592858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:39.592858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:39.592858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:34:39.592858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:39.592858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 188/366] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 1 13:34:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:34:39.593752 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2f6d3-95af-4c08-9076-6cadf47c8be4 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:39.597854 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:39.684481 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db330004-8289-43be-9bc7-3c83cbed678e None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:39.723769 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba67db-566f-45b3-be96-3ca257962e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:39.724323 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba67db-566f-45b3-be96-3ca257962e64 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:39.724607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba67db-566f-45b3-be96-3ca257962e64 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:39.724884 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba67db-566f-45b3-be96-3ca257962e64 None admin] PATH_INFO: `/v3/projects/3e8cca114ed04209a31e58f224967b4a` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:39.726007 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba67db-566f-45b3-be96-3ca257962e64 None admin] RBAC: Authorizing `identity:get_project(project_id=3e8cca114ed04209a31e58f224967b4a)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:39.727500 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba67db-566f-45b3-be96-3ca257962e64 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:39.729494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 179/367] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:39 2022] GET /identity/v3/projects/3e8cca114ed04209a31e58f224967b4a => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:39.730275 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba67db-566f-45b3-be96-3ca257962e64 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:39.735221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2f6d3-95af-4c08-9076-6cadf47c8be4 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:39.773665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0e601-78bd-4f33-9042-1ffe4eb944b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:39.774292 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0e601-78bd-4f33-9042-1ffe4eb944b1 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:39.774569 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0e601-78bd-4f33-9042-1ffe4eb944b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:39.774845 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0e601-78bd-4f33-9042-1ffe4eb944b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:39.786182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0e601-78bd-4f33-9042-1ffe4eb944b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:39.791008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-b2b0e601-78bd-4f33-9042-1ffe4eb944b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:34:39.791008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:39.791008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:39.791008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:39.791008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:39.791008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:39.791008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:39.791008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:39.791008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:39.791008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:39.791008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:39.791008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:39.791008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:39.791008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:39.791008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:39.791008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:39.792426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:39.792426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:39.792426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:39.792426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:39.792426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:39.792426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:39.792426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:39.792426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:39.792426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:39.792426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:39.792426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:39.792426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:39.792426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:39.792426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:39.792426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:39.792426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:39.793187 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:39.793187 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:39.793187 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:39.793187 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:39.793187 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:39.793187 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:39.793187 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:39.793187 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:39.793187 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:39.793187 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:39.793187 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:34:39.793187 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:39.793187 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 189/368] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:34:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:39.793841 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0e601-78bd-4f33-9042-1ffe4eb944b1 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:39.844236 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:39.850649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba67db-566f-45b3-be96-3ca257962e64 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:39.866708 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:39.889081 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fbade-2bea-42b9-9242-f18d08b723c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:39.891789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fbade-2bea-42b9-9242-f18d08b723c0 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:39.891789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fbade-2bea-42b9-9242-f18d08b723c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:39.891789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fbade-2bea-42b9-9242-f18d08b723c0 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:39.891789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224fbade-2bea-42b9-9242-f18d08b723c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:39.891789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224fbade-2bea-42b9-9242-f18d08b723c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:39.892713 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224fbade-2bea-42b9-9242-f18d08b723c0 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:39.902875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 180/369] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:34:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:39.903894 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fbade-2bea-42b9-9242-f18d08b723c0 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:39.911931 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0e601-78bd-4f33-9042-1ffe4eb944b1 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:39.951640 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfce61-d445-4f80-8119-2e665de9f31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:39.952543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfce61-d445-4f80-8119-2e665de9f31d None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:39.952967 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfce61-d445-4f80-8119-2e665de9f31d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:39.953374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfce61-d445-4f80-8119-2e665de9f31d None admin] PATH_INFO: `/v3/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:39.954693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfce61-d445-4f80-8119-2e665de9f31d None admin] RBAC: Authorizing `identity:get_group(group_id=a8e9c7bd8db745b7a1ef108f9c3fb7f8)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:39.956301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfce61-d445-4f80-8119-2e665de9f31d None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:39.958014 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 190/370] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 1 13:34:39 2022] GET /identity/v3/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:39.958913 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfce61-d445-4f80-8119-2e665de9f31d None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:40.016478 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fbade-2bea-42b9-9242-f18d08b723c0 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:40.052698 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff0048-4f17-4cd9-a184-dc3543e14562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:40.053401 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff0048-4f17-4cd9-a184-dc3543e14562 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:40.053778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff0048-4f17-4cd9-a184-dc3543e14562 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:40.054059 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff0048-4f17-4cd9-a184-dc3543e14562 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:40.054730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff0048-4f17-4cd9-a184-dc3543e14562 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:40.055036 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff0048-4f17-4cd9-a184-dc3543e14562 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:40.056740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff0048-4f17-4cd9-a184-dc3543e14562 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:40.066324 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 181/371] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:40.067173 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff0048-4f17-4cd9-a184-dc3543e14562 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:40.069925 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfce61-d445-4f80-8119-2e665de9f31d None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:40.084110 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:40.110585 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed51eb-dbe5-4264-a5c0-72a54c3aa515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:40.111529 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed51eb-dbe5-4264-a5c0-72a54c3aa515 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:40.111954 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed51eb-dbe5-4264-a5c0-72a54c3aa515 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:40.112367 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed51eb-dbe5-4264-a5c0-72a54c3aa515 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:40.113274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:40.177427 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff0048-4f17-4cd9-a184-dc3543e14562 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:40.188893 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed51eb-dbe5-4264-a5c0-72a54c3aa515 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:40.190613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed51eb-dbe5-4264-a5c0-72a54c3aa515 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:40.217140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11283199-f148-4a3b-b7ef-01ba0480335b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:40.217750 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11283199-f148-4a3b-b7ef-01ba0480335b None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:40.218054 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11283199-f148-4a3b-b7ef-01ba0480335b None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:40.218297 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11283199-f148-4a3b-b7ef-01ba0480335b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:40.219044 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11283199-f148-4a3b-b7ef-01ba0480335b None admin] RBAC: Adding query filter params (group.id=a8e9c7bd8db745b7a1ef108f9c3fb7f8, role.id=3654765b6c2644779fda2924f119aef7, scope.project.id=3e8cca114ed04209a31e58f224967b4a) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:40.219332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11283199-f148-4a3b-b7ef-01ba0480335b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:40.220798 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11283199-f148-4a3b-b7ef-01ba0480335b None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:40.226952 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 182/372] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Sep 1 13:34:40 2022] GET /identity/v3/role_assignments?group.id=a8e9c7bd8db745b7a1ef108f9c3fb7f8&scope.project.id=3e8cca114ed04209a31e58f224967b4a&role.id=3654765b6c2644779fda2924f119aef7 => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:40.228302 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11283199-f148-4a3b-b7ef-01ba0480335b None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:40.341454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 191/373] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:40.347604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed51eb-dbe5-4264-a5c0-72a54c3aa515 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:40.355837 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11283199-f148-4a3b-b7ef-01ba0480335b None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:40.361999 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:40.385630 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:40.398900 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeaab85-9eba-43b4-98e8-52201ebbeb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:40.399556 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeaab85-9eba-43b4-98e8-52201ebbeb59 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:40.399928 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeaab85-9eba-43b4-98e8-52201ebbeb59 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:40.400096 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeaab85-9eba-43b4-98e8-52201ebbeb59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:40.485640 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeaab85-9eba-43b4-98e8-52201ebbeb59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:40.487187 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeaab85-9eba-43b4-98e8-52201ebbeb59 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:40.556453 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed51eb-dbe5-4264-a5c0-72a54c3aa515 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:40.593333 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d20bc-cc6f-44a2-b5b7-2feb28577e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:40.594300 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d20bc-cc6f-44a2-b5b7-2feb28577e57 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:40.594774 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d20bc-cc6f-44a2-b5b7-2feb28577e57 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:40.595298 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d20bc-cc6f-44a2-b5b7-2feb28577e57 None admin] PATH_INFO: `/v3/projects/3e8cca114ed04209a31e58f224967b4a` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:40.595685 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 183/374] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:40.596890 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d20bc-cc6f-44a2-b5b7-2feb28577e57 None admin] RBAC: Authorizing `identity:get_project(project_id=3e8cca114ed04209a31e58f224967b4a)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:40.598333 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d20bc-cc6f-44a2-b5b7-2feb28577e57 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:40.600168 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 192/375] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:40 2022] GET /identity/v3/projects/3e8cca114ed04209a31e58f224967b4a => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:40.601397 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeaab85-9eba-43b4-98e8-52201ebbeb59 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:40.604064 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:40.605523 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d20bc-cc6f-44a2-b5b7-2feb28577e57 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:40.712207 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeaab85-9eba-43b4-98e8-52201ebbeb59 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:40.720718 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:40.748449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d20bc-cc6f-44a2-b5b7-2feb28577e57 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:40.749979 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10382969-ca74-445c-b441-2df4017b139f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:40.750722 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10382969-ca74-445c-b441-2df4017b139f None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:40.751107 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10382969-ca74-445c-b441-2df4017b139f None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:40.752073 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10382969-ca74-445c-b441-2df4017b139f None admin] PATH_INFO: `/v3/projects/c52243fb4fdd4f1bb4f3291630bfbabe` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:40.752757 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10382969-ca74-445c-b441-2df4017b139f None admin] RBAC: Authorizing `identity:get_project(project_id=c52243fb4fdd4f1bb4f3291630bfbabe)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:40.754673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10382969-ca74-445c-b441-2df4017b139f None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:40.759382 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 184/376] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:40 2022] GET /identity/v3/projects/c52243fb4fdd4f1bb4f3291630bfbabe => generated 344 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:40.762788 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10382969-ca74-445c-b441-2df4017b139f None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:40.804056 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30a6a2-d51e-463f-836f-0142fe83875c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:40.804973 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30a6a2-d51e-463f-836f-0142fe83875c None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:40.805413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30a6a2-d51e-463f-836f-0142fe83875c None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:40.805836 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30a6a2-d51e-463f-836f-0142fe83875c None admin] PATH_INFO: `/v3/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:40.810709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e30a6a2-d51e-463f-836f-0142fe83875c None admin] RBAC: Authorizing `identity:get_group(group_id=a8e9c7bd8db745b7a1ef108f9c3fb7f8)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:40.812394 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e30a6a2-d51e-463f-836f-0142fe83875c None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:40.814182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 193/377] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 1 13:34:40 2022] GET /identity/v3/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:34:40.820259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30a6a2-d51e-463f-836f-0142fe83875c None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:40.841683 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:40.879940 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10382969-ca74-445c-b441-2df4017b139f None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:40.919696 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3309da-c1e7-43b3-a155-e4137e9dbbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:40.920334 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3309da-c1e7-43b3-a155-e4137e9dbbb9 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:40.920616 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3309da-c1e7-43b3-a155-e4137e9dbbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:40.920888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3309da-c1e7-43b3-a155-e4137e9dbbb9 None admin] PATH_INFO: `/v3/groups/933e51bac6cc4b6eb6612aafe08ef9cf` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:40.926266 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3309da-c1e7-43b3-a155-e4137e9dbbb9 None admin] RBAC: Authorizing `identity:get_group(group_id=933e51bac6cc4b6eb6612aafe08ef9cf)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:40.927749 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3309da-c1e7-43b3-a155-e4137e9dbbb9 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:40.929852 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 185/378] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 1 13:34:40 2022] GET /identity/v3/groups/933e51bac6cc4b6eb6612aafe08ef9cf => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:34:40.937207 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3309da-c1e7-43b3-a155-e4137e9dbbb9 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:40.950438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30a6a2-d51e-463f-836f-0142fe83875c None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:40.988603 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7163e-1ff4-4234-ab5c-a50f971af859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:40.989214 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7163e-1ff4-4234-ab5c-a50f971af859 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:40.989487 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7163e-1ff4-4234-ab5c-a50f971af859 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:40.989756 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7163e-1ff4-4234-ab5c-a50f971af859 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:40.990485 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7163e-1ff4-4234-ab5c-a50f971af859 None admin] RBAC: Adding query filter params (group.id=a8e9c7bd8db745b7a1ef108f9c3fb7f8, role.id=f0d2493c03664449802df928b8e8fa53, scope.project.id=3e8cca114ed04209a31e58f224967b4a) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:40.990786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7163e-1ff4-4234-ab5c-a50f971af859 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:40.992275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7163e-1ff4-4234-ab5c-a50f971af859 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:41.001384 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 194/379] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Sep 1 13:34:40 2022] GET /identity/v3/role_assignments?group.id=a8e9c7bd8db745b7a1ef108f9c3fb7f8&scope.project.id=3e8cca114ed04209a31e58f224967b4a&role.id=f0d2493c03664449802df928b8e8fa53 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:34:41.055649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3309da-c1e7-43b3-a155-e4137e9dbbb9 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:41.094902 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657c734-738f-4afd-be47-eb0c99252d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:41.095465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657c734-738f-4afd-be47-eb0c99252d2f None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:41.095751 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657c734-738f-4afd-be47-eb0c99252d2f None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:41.096023 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657c734-738f-4afd-be47-eb0c99252d2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:41.096775 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657c734-738f-4afd-be47-eb0c99252d2f None admin] RBAC: Adding query filter params (group.id=933e51bac6cc4b6eb6612aafe08ef9cf, role.id=98ffd3c114804da292d7cb33721e9085, scope.project.id=c52243fb4fdd4f1bb4f3291630bfbabe) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:41.097085 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657c734-738f-4afd-be47-eb0c99252d2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:41.098599 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657c734-738f-4afd-be47-eb0c99252d2f None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:41.100689 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:41.106286 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 186/380] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Sep 1 13:34:40 2022] GET /identity/v3/role_assignments?group.id=933e51bac6cc4b6eb6612aafe08ef9cf&scope.project.id=c52243fb4fdd4f1bb4f3291630bfbabe&role.id=98ffd3c114804da292d7cb33721e9085 => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:41.368171 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bfca1-f09a-4f16-b676-90195659a079 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:41.368850 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bfca1-f09a-4f16-b676-90195659a079 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:41.368850 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bfca1-f09a-4f16-b676-90195659a079 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:41.370788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 195/381] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:41.375884 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0527c42-5812-4979-8d9b-767d1c3bf4ab None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:41.376407 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0527c42-5812-4979-8d9b-767d1c3bf4ab None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:41.376407 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0527c42-5812-4979-8d9b-767d1c3bf4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:41.397961 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-b0527c42-5812-4979-8d9b-767d1c3bf4ab None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:41.399156 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b0527c42-5812-4979-8d9b-767d1c3bf4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:41.431018 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ccf33-dea4-4a22-9f42-0b12a61d8e64 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:41.431325 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ccf33-dea4-4a22-9f42-0b12a61d8e64 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:41.431595 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ccf33-dea4-4a22-9f42-0b12a61d8e64 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:41.433638 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 196/382] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:34:41.438990 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba706fb-c4a4-454a-8729-d755b54c2411 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:41.439603 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba706fb-c4a4-454a-8729-d755b54c2411 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:41.440074 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba706fb-c4a4-454a-8729-d755b54c2411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:41.462933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-eba706fb-c4a4-454a-8729-d755b54c2411 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:41.464568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-eba706fb-c4a4-454a-8729-d755b54c2411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:41.474708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:41.519205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 187/383] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:41.558229 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 197/384] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:34:41.836896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0527c42-5812-4979-8d9b-767d1c3bf4ab None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:41.954859 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0527c42-5812-4979-8d9b-767d1c3bf4ab None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:41.990400 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:41.991866 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba706fb-c4a4-454a-8729-d755b54c2411 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:42.001384 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe6cf4-ac63-4eb7-bdef-a70623bb4cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:42.002025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe6cf4-ac63-4eb7-bdef-a70623bb4cdc None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:42.002305 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe6cf4-ac63-4eb7-bdef-a70623bb4cdc None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:42.002722 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe6cf4-ac63-4eb7-bdef-a70623bb4cdc None admin] PATH_INFO: `/v3/roles/member` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:42.021733 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe6cf4-ac63-4eb7-bdef-a70623bb4cdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:42.027351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-05fe6cf4-ac63-4eb7-bdef-a70623bb4cdc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:42.027351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:42.027351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:42.027351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:42.027351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:42.027351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:42.027351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:42.027351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:42.027351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:42.027351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:42.027351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:42.027351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:42.027351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:42.027351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:42.027351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:42.027351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:42.028236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:42.028236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:42.028236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:42.028236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:42.028236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:42.028236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:42.028236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:42.028236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:42.028236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:42.028236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:42.028236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:42.028236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:42.028236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:42.028236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:42.028236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:42.028236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:42.029013 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:42.029013 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:42.029013 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:42.029013 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:42.029013 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:42.029013 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:42.029013 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:42.029013 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:42.029013 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:42.029013 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:42.029013 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:42.029013 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:42.029013 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 188/385] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:42.036466 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe6cf4-ac63-4eb7-bdef-a70623bb4cdc None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:42.187135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba706fb-c4a4-454a-8729-d755b54c2411 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:42.207004 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe6cf4-ac63-4eb7-bdef-a70623bb4cdc None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:42.252779 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f63af-2a58-4fc1-973b-eaf742cd1759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:42.253423 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f63af-2a58-4fc1-973b-eaf742cd1759 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:42.253700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f63af-2a58-4fc1-973b-eaf742cd1759 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:42.254361 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f63af-2a58-4fc1-973b-eaf742cd1759 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:42.267011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f63af-2a58-4fc1-973b-eaf742cd1759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:42.272190 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-b42f63af-2a58-4fc1-973b-eaf742cd1759 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:34:42.272190 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:42.272190 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:42.272190 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:42.272190 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:42.272190 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:42.272190 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:42.272190 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:42.272190 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:42.272190 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:42.272190 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:42.272190 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:42.272190 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:42.272190 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:42.272190 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:42.272190 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:42.273120 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:42.273120 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:42.273120 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:42.273120 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:42.273120 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:42.273120 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:42.273120 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:42.273120 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:42.273120 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:42.273120 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:42.273120 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:42.273120 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:42.273120 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:42.273120 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:42.273120 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:42.273120 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:42.273876 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:42.273876 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:42.273876 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:42.273876 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:42.273876 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:42.273876 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:42.273876 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:42.273876 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:42.273876 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:42.273876 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:42.273876 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:34:42.273876 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:42.273876 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 198/386] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 1 13:34:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:42.283554 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f63af-2a58-4fc1-973b-eaf742cd1759 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:42.284756 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10c5ee-be38-4c23-9ef2-de5414361fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:42.285397 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10c5ee-be38-4c23-9ef2-de5414361fa4 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:42.285659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10c5ee-be38-4c23-9ef2-de5414361fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:42.285924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10c5ee-be38-4c23-9ef2-de5414361fa4 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:42.286611 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10c5ee-be38-4c23-9ef2-de5414361fa4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:42.286913 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10c5ee-be38-4c23-9ef2-de5414361fa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:42.288333 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10c5ee-be38-4c23-9ef2-de5414361fa4 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:42.292303 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:42.298747 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 189/387] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 1 13:34:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:42.304311 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10c5ee-be38-4c23-9ef2-de5414361fa4 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:42.362644 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:42.412060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f63af-2a58-4fc1-973b-eaf742cd1759 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:42.423437 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10c5ee-be38-4c23-9ef2-de5414361fa4 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:42.461081 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5489630-c834-4d4d-b259-a9140dea2b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:42.461638 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5489630-c834-4d4d-b259-a9140dea2b09 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:42.461929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5489630-c834-4d4d-b259-a9140dea2b09 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:42.462170 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5489630-c834-4d4d-b259-a9140dea2b09 None admin] PATH_INFO: `/v3/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:42.463441 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5489630-c834-4d4d-b259-a9140dea2b09 None admin] RBAC: Authorizing `identity:get_group(group_id=a8e9c7bd8db745b7a1ef108f9c3fb7f8)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:42.464925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5489630-c834-4d4d-b259-a9140dea2b09 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:42.466590 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf2289-c8a6-4246-bd54-1681ad0d7be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:42.466781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 190/388] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 1 13:34:42 2022] GET /identity/v3/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:42.467604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf2289-c8a6-4246-bd54-1681ad0d7be5 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:42.468081 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf2289-c8a6-4246-bd54-1681ad0d7be5 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:42.468531 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf2289-c8a6-4246-bd54-1681ad0d7be5 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:42.469378 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf2289-c8a6-4246-bd54-1681ad0d7be5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:42.469849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf2289-c8a6-4246-bd54-1681ad0d7be5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:42.471407 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf2289-c8a6-4246-bd54-1681ad0d7be5 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:42.473228 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5489630-c834-4d4d-b259-a9140dea2b09 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:42.481111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 199/389] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:34:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:42.487305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf2289-c8a6-4246-bd54-1681ad0d7be5 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:42.579723 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:42.581851 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5489630-c834-4d4d-b259-a9140dea2b09 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:42.600451 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:42.617954 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b0bf7-5539-41cc-8509-a77274f5bc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:42.618577 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b0bf7-5539-41cc-8509-a77274f5bc60 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:42.618917 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b0bf7-5539-41cc-8509-a77274f5bc60 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:42.619190 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b0bf7-5539-41cc-8509-a77274f5bc60 None admin] PATH_INFO: `/v3/projects/4ab598b3074241ac9c1da0a539adebc9` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:42.624926 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b0bf7-5539-41cc-8509-a77274f5bc60 None admin] RBAC: Authorizing `identity:get_project(project_id=4ab598b3074241ac9c1da0a539adebc9)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:42.626426 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b0bf7-5539-41cc-8509-a77274f5bc60 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:42.628342 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 191/390] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:42 2022] GET /identity/v3/projects/4ab598b3074241ac9c1da0a539adebc9 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:42.634539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf2289-c8a6-4246-bd54-1681ad0d7be5 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:42.645148 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b0bf7-5539-41cc-8509-a77274f5bc60 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:42.688708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0f524-23fd-4fa6-a59e-a0901eba35a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:42.689355 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0f524-23fd-4fa6-a59e-a0901eba35a4 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:42.689695 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0f524-23fd-4fa6-a59e-a0901eba35a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:42.689972 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0f524-23fd-4fa6-a59e-a0901eba35a4 None admin] PATH_INFO: `/v3/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:42.696130 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0f524-23fd-4fa6-a59e-a0901eba35a4 None admin] RBAC: Authorizing `identity:get_group(group_id=a8e9c7bd8db745b7a1ef108f9c3fb7f8)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:42.698202 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0f524-23fd-4fa6-a59e-a0901eba35a4 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:42.700204 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 200/391] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 1 13:34:42 2022] GET /identity/v3/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:42.705524 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0f524-23fd-4fa6-a59e-a0901eba35a4 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:42.758291 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b0bf7-5539-41cc-8509-a77274f5bc60 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:42.795190 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46788c-7355-4784-83d2-ab1e33bcf17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:42.795884 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46788c-7355-4784-83d2-ab1e33bcf17e None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:42.796163 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46788c-7355-4784-83d2-ab1e33bcf17e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:42.796442 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46788c-7355-4784-83d2-ab1e33bcf17e None admin] PATH_INFO: `/v3/projects/4ab598b3074241ac9c1da0a539adebc9/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:42.800915 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46788c-7355-4784-83d2-ab1e33bcf17e None admin] RBAC: Authorizing `identity:create_grant(project_id=4ab598b3074241ac9c1da0a539adebc9, group_id=a8e9c7bd8db745b7a1ef108f9c3fb7f8, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:42.802334 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46788c-7355-4784-83d2-ab1e33bcf17e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:42.854840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0f524-23fd-4fa6-a59e-a0901eba35a4 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:42.891728 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 192/392] 10.222.0.50 () {58 vars in 1442 bytes} [Thu Sep 1 13:34:42 2022] PUT /identity/v3/projects/4ab598b3074241ac9c1da0a539adebc9/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:34:42.894549 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:42.898147 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e0223-39ca-43c2-844a-7a9deb1a8395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:42.898803 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e0223-39ca-43c2-844a-7a9deb1a8395 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:42.899084 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e0223-39ca-43c2-844a-7a9deb1a8395 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:42.899375 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e0223-39ca-43c2-844a-7a9deb1a8395 None admin] PATH_INFO: `/v3/projects/4ab598b3074241ac9c1da0a539adebc9` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:42.900807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e0223-39ca-43c2-844a-7a9deb1a8395 None admin] RBAC: Authorizing `identity:get_project(project_id=4ab598b3074241ac9c1da0a539adebc9)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:42.902437 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e0223-39ca-43c2-844a-7a9deb1a8395 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:42.904606 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 201/393] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:42 2022] GET /identity/v3/projects/4ab598b3074241ac9c1da0a539adebc9 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:34:42.909914 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46788c-7355-4784-83d2-ab1e33bcf17e None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:42.976193 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:43.024953 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46788c-7355-4784-83d2-ab1e33bcf17e None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:43.060734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369a27f-2335-4203-899d-a8a57c22c3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:43.061415 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369a27f-2335-4203-899d-a8a57c22c3df None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:43.061696 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369a27f-2335-4203-899d-a8a57c22c3df None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:43.061976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369a27f-2335-4203-899d-a8a57c22c3df None admin] PATH_INFO: `/v3/projects/4ab598b3074241ac9c1da0a539adebc9/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8/roles/f0d2493c03664449802df928b8e8fa53` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:43.064181 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369a27f-2335-4203-899d-a8a57c22c3df None admin] RBAC: Authorizing `identity:create_grant(project_id=4ab598b3074241ac9c1da0a539adebc9, group_id=a8e9c7bd8db745b7a1ef108f9c3fb7f8, role_id=f0d2493c03664449802df928b8e8fa53)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:43.065848 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369a27f-2335-4203-899d-a8a57c22c3df None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:43.145391 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 193/394] 10.222.0.50 () {58 vars in 1442 bytes} [Thu Sep 1 13:34:42 2022] PUT /identity/v3/projects/4ab598b3074241ac9c1da0a539adebc9/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8/roles/f0d2493c03664449802df928b8e8fa53 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:34:43.393335 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6404b-8d04-4351-a6a8-2f0480d0e7af None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:43.393699 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6404b-8d04-4351-a6a8-2f0480d0e7af None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:43.393895 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6404b-8d04-4351-a6a8-2f0480d0e7af None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:43.395398 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 202/395] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:43.401370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a8c9c-1b72-43c4-ad14-e591fbebb618 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:43.401908 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a8c9c-1b72-43c4-ad14-e591fbebb618 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:43.402375 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a8c9c-1b72-43c4-ad14-e591fbebb618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:43.422031 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-cb0a8c9c-1b72-43c4-ad14-e591fbebb618 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:43.423589 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-cb0a8c9c-1b72-43c4-ad14-e591fbebb618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:43.510627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 194/396] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:34:43.647649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c3d11-6fe3-4a3a-b792-fd39a2998ba2 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:43.648124 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c3d11-6fe3-4a3a-b792-fd39a2998ba2 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:43.648124 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c3d11-6fe3-4a3a-b792-fd39a2998ba2 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:43.649741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 203/397] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:43.660616 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f9d53-adca-4e9a-b377-6ec7236c7b25 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:43.661243 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f9d53-adca-4e9a-b377-6ec7236c7b25 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:43.661715 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f9d53-adca-4e9a-b377-6ec7236c7b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:43.671110 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62448d04-f8be-4e4b-bb3b-88861d59bb18 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:43.671421 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62448d04-f8be-4e4b-bb3b-88861d59bb18 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:43.671705 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62448d04-f8be-4e4b-bb3b-88861d59bb18 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:43.673304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 204/398] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:43.679460 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6dd56-0b5f-40de-b7e0-343c585a97ef None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:43.679747 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6dd56-0b5f-40de-b7e0-343c585a97ef None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:43.680023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6dd56-0b5f-40de-b7e0-343c585a97ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:43.691686 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-882f9d53-adca-4e9a-b377-6ec7236c7b25 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:43.693197 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-882f9d53-adca-4e9a-b377-6ec7236c7b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:43.709162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-3fc6dd56-0b5f-40de-b7e0-343c585a97ef None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:43.709162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-3fc6dd56-0b5f-40de-b7e0-343c585a97ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:43.737813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:43.788546 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 195/399] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:43.805216 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 205/400] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:43.991045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f9d53-adca-4e9a-b377-6ec7236c7b25 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:44.090799 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6dd56-0b5f-40de-b7e0-343c585a97ef None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:44.110108 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f9d53-adca-4e9a-b377-6ec7236c7b25 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:44.153607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34e663-a9c4-4a54-9637-930945b460ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:44.154524 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34e663-a9c4-4a54-9637-930945b460ab None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:44.154950 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34e663-a9c4-4a54-9637-930945b460ab None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:44.155376 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34e663-a9c4-4a54-9637-930945b460ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:44.168806 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34e663-a9c4-4a54-9637-930945b460ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:44.175432 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-3d34e663-a9c4-4a54-9637-930945b460ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:34:44.175432 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:44.175432 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:44.175432 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:44.175432 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:44.175432 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:44.175432 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:44.175432 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:44.175432 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:44.175432 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:44.175432 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:44.175432 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:44.175432 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:44.175432 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:44.175432 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:44.175432 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:44.176496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:44.176496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:44.176496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:44.176496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:44.176496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:44.176496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:44.176496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:44.176496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:44.176496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:44.176496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:44.176496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:44.176496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:44.176496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:44.176496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:44.176496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:44.176496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:44.177501 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:44.177501 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:44.177501 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:44.177501 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:44.177501 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:44.177501 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:44.177501 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:44.177501 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:44.177501 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:44.177501 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:44.177501 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:34:44.177501 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:44.185417 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 196/401] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 1 13:34:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:44.205252 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34e663-a9c4-4a54-9637-930945b460ab None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:44.220154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6dd56-0b5f-40de-b7e0-343c585a97ef None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:44.248726 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:44.252625 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:44.256695 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045aa30e-2fcb-4a7a-b6ea-0b9c3796e5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:44.264526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045aa30e-2fcb-4a7a-b6ea-0b9c3796e5e8 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:44.264526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045aa30e-2fcb-4a7a-b6ea-0b9c3796e5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:44.264526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045aa30e-2fcb-4a7a-b6ea-0b9c3796e5e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:44.270276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045aa30e-2fcb-4a7a-b6ea-0b9c3796e5e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:44.275301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-045aa30e-2fcb-4a7a-b6ea-0b9c3796e5e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:44.275301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:44.275301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:44.275301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:44.275301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:44.275301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:44.275301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:44.275301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:44.275301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:44.275301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:44.275301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:44.275301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:44.275301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:44.275301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:44.275301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:44.275301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:44.276427 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:44.276427 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:44.276427 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:44.276427 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:44.276427 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:44.276427 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:44.276427 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:44.276427 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:44.276427 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:44.276427 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:44.276427 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:44.276427 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:44.276427 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:44.276427 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:44.276427 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:44.276427 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:44.277200 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:44.277200 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:44.277200 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:44.277200 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:44.277200 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:44.277200 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:44.277200 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:44.277200 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:44.277200 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:44.277200 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:44.277200 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:44.277200 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:44.277200 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 206/402] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:44.278042 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045aa30e-2fcb-4a7a-b6ea-0b9c3796e5e8 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:44.339971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34e663-a9c4-4a54-9637-930945b460ab None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:44.386707 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2f007-147c-40e7-be45-93bb5b245bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:44.388030 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2f007-147c-40e7-be45-93bb5b245bf4 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:44.388554 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2f007-147c-40e7-be45-93bb5b245bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:44.388973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2f007-147c-40e7-be45-93bb5b245bf4 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:44.389781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2f007-147c-40e7-be45-93bb5b245bf4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:44.390252 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2f007-147c-40e7-be45-93bb5b245bf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:44.390365 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045aa30e-2fcb-4a7a-b6ea-0b9c3796e5e8 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:44.392090 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2f007-147c-40e7-be45-93bb5b245bf4 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:44.403353 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 197/403] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:34:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:34:44.404429 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2f007-147c-40e7-be45-93bb5b245bf4 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:44.434191 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4b366-7ab0-4b78-9994-490634355477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:44.434986 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4b366-7ab0-4b78-9994-490634355477 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:44.435312 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4b366-7ab0-4b78-9994-490634355477 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:44.435676 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4b366-7ab0-4b78-9994-490634355477 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:44.451191 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4b366-7ab0-4b78-9994-490634355477 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:44.456526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-68d4b366-7ab0-4b78-9994-490634355477 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:34:44.456526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:44.456526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:44.456526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:44.456526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:44.456526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:44.456526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:44.456526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:44.456526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:44.456526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:44.456526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:44.456526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:44.456526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:44.456526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:44.456526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:44.456526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:44.457596 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:44.457596 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:44.457596 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:44.457596 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:44.457596 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:44.457596 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:44.457596 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:44.457596 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:44.457596 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:44.457596 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:44.457596 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:44.457596 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:44.457596 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:44.457596 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:44.457596 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:44.457596 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:44.458574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:44.458574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:44.458574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:44.458574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:44.458574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:44.458574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:44.458574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:44.458574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:44.458574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:44.458574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:44.458574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:34:44.458574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:44.459560 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 207/404] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:34:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:44.460464 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4b366-7ab0-4b78-9994-490634355477 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:44.523848 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:44.525794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2f007-147c-40e7-be45-93bb5b245bf4 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:44.535743 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:44.566677 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609c856-fe44-4bae-82ea-dbea16612d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:44.567696 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609c856-fe44-4bae-82ea-dbea16612d6a None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:44.568157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609c856-fe44-4bae-82ea-dbea16612d6a None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:44.568604 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609c856-fe44-4bae-82ea-dbea16612d6a None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:44.569049 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4b366-7ab0-4b78-9994-490634355477 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:44.569677 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609c856-fe44-4bae-82ea-dbea16612d6a None admin] RBAC: Adding query filter params (name=member) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:44.570171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609c856-fe44-4bae-82ea-dbea16612d6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:44.572794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609c856-fe44-4bae-82ea-dbea16612d6a None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:44.584174 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 198/405] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 1 13:34:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:44.585630 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609c856-fe44-4bae-82ea-dbea16612d6a None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:44.606038 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf6fd0-9acf-442a-bf45-66f39423f6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:44.606765 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf6fd0-9acf-442a-bf45-66f39423f6ff None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:44.607484 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf6fd0-9acf-442a-bf45-66f39423f6ff None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:44.607839 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf6fd0-9acf-442a-bf45-66f39423f6ff None admin] PATH_INFO: `/v3/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:44.609113 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf6fd0-9acf-442a-bf45-66f39423f6ff None admin] RBAC: Authorizing `identity:get_group(group_id=a8e9c7bd8db745b7a1ef108f9c3fb7f8)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:44.610670 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf6fd0-9acf-442a-bf45-66f39423f6ff None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:44.617127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 208/406] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 1 13:34:44 2022] GET /identity/v3/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:44.618707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf6fd0-9acf-442a-bf45-66f39423f6ff None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:44.713458 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609c856-fe44-4bae-82ea-dbea16612d6a None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:44.723619 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf6fd0-9acf-442a-bf45-66f39423f6ff None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:44.745673 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:44.759274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167d67c-0fea-4729-9857-7c2463451ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:44.760611 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167d67c-0fea-4729-9857-7c2463451ac5 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:44.760962 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167d67c-0fea-4729-9857-7c2463451ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:44.761307 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167d67c-0fea-4729-9857-7c2463451ac5 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:44.762152 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167d67c-0fea-4729-9857-7c2463451ac5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:44.762375 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc36a6-fb9e-445e-8e9d-5bcc74ae5821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:44.762597 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167d67c-0fea-4729-9857-7c2463451ac5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:44.763141 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc36a6-fb9e-445e-8e9d-5bcc74ae5821 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:44.763543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc36a6-fb9e-445e-8e9d-5bcc74ae5821 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:44.763882 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc36a6-fb9e-445e-8e9d-5bcc74ae5821 None admin] PATH_INFO: `/v3/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:44.764254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167d67c-0fea-4729-9857-7c2463451ac5 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:44.765115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc36a6-fb9e-445e-8e9d-5bcc74ae5821 None admin] RBAC: Authorizing `identity:get_group(group_id=a8e9c7bd8db745b7a1ef108f9c3fb7f8)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:44.767023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc36a6-fb9e-445e-8e9d-5bcc74ae5821 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:44.769910 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 209/407] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 1 13:34:44 2022] GET /identity/v3/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:44.770771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc36a6-fb9e-445e-8e9d-5bcc74ae5821 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:44.773761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 199/408] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:44.779643 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167d67c-0fea-4729-9857-7c2463451ac5 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:44.798505 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:44.910147 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc36a6-fb9e-445e-8e9d-5bcc74ae5821 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:44.933054 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167d67c-0fea-4729-9857-7c2463451ac5 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:44.956312 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02998c-aefa-4993-9b82-c5d6826d0322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:44.957049 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02998c-aefa-4993-9b82-c5d6826d0322 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:44.957324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02998c-aefa-4993-9b82-c5d6826d0322 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:44.957581 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02998c-aefa-4993-9b82-c5d6826d0322 None admin] PATH_INFO: `/v3/projects/3e8cca114ed04209a31e58f224967b4a` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:44.959051 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02998c-aefa-4993-9b82-c5d6826d0322 None admin] RBAC: Authorizing `identity:get_project(project_id=3e8cca114ed04209a31e58f224967b4a)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:44.960640 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02998c-aefa-4993-9b82-c5d6826d0322 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:44.962207 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 210/409] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:44 2022] GET /identity/v3/projects/3e8cca114ed04209a31e58f224967b4a => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:44.963060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02998c-aefa-4993-9b82-c5d6826d0322 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:44.975307 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521d68b-6088-4e89-9e9f-36795a495e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:44.976685 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521d68b-6088-4e89-9e9f-36795a495e8c None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:44.977394 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521d68b-6088-4e89-9e9f-36795a495e8c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:44.977848 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521d68b-6088-4e89-9e9f-36795a495e8c None admin] PATH_INFO: `/v3/projects/3e8cca114ed04209a31e58f224967b4a` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:44.979471 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521d68b-6088-4e89-9e9f-36795a495e8c None admin] RBAC: Authorizing `identity:get_project(project_id=3e8cca114ed04209a31e58f224967b4a)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:44.981826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521d68b-6088-4e89-9e9f-36795a495e8c None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:44.984921 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 200/410] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:44 2022] GET /identity/v3/projects/3e8cca114ed04209a31e58f224967b4a => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:44.985835 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521d68b-6088-4e89-9e9f-36795a495e8c None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:45.033172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:45.080124 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02998c-aefa-4993-9b82-c5d6826d0322 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:45.100866 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:45.117830 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74ec31-c780-4ee7-ad8c-71b792206a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:45.118562 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74ec31-c780-4ee7-ad8c-71b792206a58 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:45.118915 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74ec31-c780-4ee7-ad8c-71b792206a58 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:45.119814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74ec31-c780-4ee7-ad8c-71b792206a58 None admin] PATH_INFO: `/v3/groups/933e51bac6cc4b6eb6612aafe08ef9cf` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:45.121182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74ec31-c780-4ee7-ad8c-71b792206a58 None admin] RBAC: Authorizing `identity:get_group(group_id=933e51bac6cc4b6eb6612aafe08ef9cf)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:45.122844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74ec31-c780-4ee7-ad8c-71b792206a58 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:45.126867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521d68b-6088-4e89-9e9f-36795a495e8c None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:45.130080 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 211/411] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 1 13:34:44 2022] GET /identity/v3/groups/933e51bac6cc4b6eb6612aafe08ef9cf => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:45.130200 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74ec31-c780-4ee7-ad8c-71b792206a58 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:45.177690 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c457146-65e8-41c8-aa35-2657973accf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:45.179194 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c457146-65e8-41c8-aa35-2657973accf4 None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:45.179676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c457146-65e8-41c8-aa35-2657973accf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:45.180146 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c457146-65e8-41c8-aa35-2657973accf4 None admin] PATH_INFO: `/v3/projects/3e8cca114ed04209a31e58f224967b4a/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8/roles/f0d2493c03664449802df928b8e8fa53` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:45.183617 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c457146-65e8-41c8-aa35-2657973accf4 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e8cca114ed04209a31e58f224967b4a, group_id=a8e9c7bd8db745b7a1ef108f9c3fb7f8, role_id=f0d2493c03664449802df928b8e8fa53)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:45.185711 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c457146-65e8-41c8-aa35-2657973accf4 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:45.245203 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74ec31-c780-4ee7-ad8c-71b792206a58 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:45.268344 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:45.280734 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734af4a3-8f43-4eac-87c7-406847184337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:45.281393 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734af4a3-8f43-4eac-87c7-406847184337 None admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:45.281671 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734af4a3-8f43-4eac-87c7-406847184337 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:45.281943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734af4a3-8f43-4eac-87c7-406847184337 None admin] PATH_INFO: `/v3/projects/3e8cca114ed04209a31e58f224967b4a/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:45.283906 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734af4a3-8f43-4eac-87c7-406847184337 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e8cca114ed04209a31e58f224967b4a, group_id=a8e9c7bd8db745b7a1ef108f9c3fb7f8, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:45.285293 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734af4a3-8f43-4eac-87c7-406847184337 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:45.303691 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 201/412] 10.222.0.50 () {58 vars in 1442 bytes} [Thu Sep 1 13:34:44 2022] PUT /identity/v3/projects/3e8cca114ed04209a31e58f224967b4a/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8/roles/f0d2493c03664449802df928b8e8fa53 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:34:45.303691 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c457146-65e8-41c8-aa35-2657973accf4 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:45.385471 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 212/413] 10.222.0.50 () {58 vars in 1442 bytes} [Thu Sep 1 13:34:45 2022] PUT /identity/v3/projects/3e8cca114ed04209a31e58f224967b4a/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:34:45.438582 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c457146-65e8-41c8-aa35-2657973accf4 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:45.512562 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d85c5-6cbc-4235-90dd-a5f4bc8df0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:45.513630 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d85c5-6cbc-4235-90dd-a5f4bc8df0e3 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:45.514147 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d85c5-6cbc-4235-90dd-a5f4bc8df0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:45.514620 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d85c5-6cbc-4235-90dd-a5f4bc8df0e3 None admin] PATH_INFO: `/v3/projects/c52243fb4fdd4f1bb4f3291630bfbabe` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:45.516059 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d85c5-6cbc-4235-90dd-a5f4bc8df0e3 None admin] RBAC: Authorizing `identity:get_project(project_id=c52243fb4fdd4f1bb4f3291630bfbabe)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:45.517783 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d85c5-6cbc-4235-90dd-a5f4bc8df0e3 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:45.519756 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 202/414] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:45 2022] GET /identity/v3/projects/c52243fb4fdd4f1bb4f3291630bfbabe => generated 344 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:45.527485 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734af4a3-8f43-4eac-87c7-406847184337 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:45.593574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7cc8d-c3e1-4c40-9754-7411ffe26c5f None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:45.594069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7cc8d-c3e1-4c40-9754-7411ffe26c5f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:45.594342 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7cc8d-c3e1-4c40-9754-7411ffe26c5f None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:45.595981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 203/415] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:45.601363 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fe864-ce38-4c8d-a7fd-0bab8363061c None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:45.601643 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fe864-ce38-4c8d-a7fd-0bab8363061c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:45.601915 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fe864-ce38-4c8d-a7fd-0bab8363061c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:45.622705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-b28fe864-ce38-4c8d-a7fd-0bab8363061c None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:45.623945 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b28fe864-ce38-4c8d-a7fd-0bab8363061c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:45.626005 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:45.663650 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734af4a3-8f43-4eac-87c7-406847184337 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:45.707603 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 204/416] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:34:45.709883 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed7153-8d60-4ca8-a06c-d6e0d05907e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:45.710800 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed7153-8d60-4ca8-a06c-d6e0d05907e0 None admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:45.711266 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed7153-8d60-4ca8-a06c-d6e0d05907e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:45.711729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed7153-8d60-4ca8-a06c-d6e0d05907e0 None admin] PATH_INFO: `/v3/projects/c52243fb4fdd4f1bb4f3291630bfbabe/groups/933e51bac6cc4b6eb6612aafe08ef9cf/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:45.713857 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed7153-8d60-4ca8-a06c-d6e0d05907e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c52243fb4fdd4f1bb4f3291630bfbabe, group_id=933e51bac6cc4b6eb6612aafe08ef9cf, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:45.715535 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed7153-8d60-4ca8-a06c-d6e0d05907e0 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:45.716735 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350533d-7a9e-49b0-b725-e3d928f0a899 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:45.717109 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350533d-7a9e-49b0-b725-e3d928f0a899 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:45.717455 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350533d-7a9e-49b0-b725-e3d928f0a899 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:45.719200 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 205/417] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:45 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:45.724612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eadb88-e3c6-4c8b-a79b-7027e4bb003e None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:45.724978 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eadb88-e3c6-4c8b-a79b-7027e4bb003e None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:45.725326 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eadb88-e3c6-4c8b-a79b-7027e4bb003e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:45.749720 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-77eadb88-e3c6-4c8b-a79b-7027e4bb003e None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:45.751018 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-77eadb88-e3c6-4c8b-a79b-7027e4bb003e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:45.802222 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 213/418] 10.222.0.50 () {58 vars in 1442 bytes} [Thu Sep 1 13:34:45 2022] PUT /identity/v3/projects/c52243fb4fdd4f1bb4f3291630bfbabe/groups/933e51bac6cc4b6eb6612aafe08ef9cf/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:34:45.854561 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 206/419] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:34:46.032516 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed7153-8d60-4ca8-a06c-d6e0d05907e0 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:46.080717 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:46.155063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed7153-8d60-4ca8-a06c-d6e0d05907e0 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:46.201442 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce523af-1c58-4627-ab76-5b9e7a4440e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:46.202072 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce523af-1c58-4627-ab76-5b9e7a4440e0 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:46.202354 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce523af-1c58-4627-ab76-5b9e7a4440e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:46.202630 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce523af-1c58-4627-ab76-5b9e7a4440e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:46.217874 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce523af-1c58-4627-ab76-5b9e7a4440e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:46.220916 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eadb88-e3c6-4c8b-a79b-7027e4bb003e None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:46.239568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-4ce523af-1c58-4627-ab76-5b9e7a4440e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:34:46.239568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:46.239568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:46.239568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:46.239568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:46.239568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:46.239568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:46.239568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:46.239568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:46.239568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:46.239568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:46.239568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:46.239568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:46.239568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:46.239568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:46.239568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:46.240478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:46.240478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:46.240478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:46.240478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:46.240478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:46.240478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:46.240478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:46.240478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:46.240478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:46.240478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:46.240478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:46.240478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:46.240478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:46.240478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:46.240478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:46.240478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:46.241238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:46.241238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:46.241238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:46.241238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:46.241238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:46.241238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:46.241238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:46.241238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:46.241238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:46.241238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:46.241238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:34:46.241238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:46.243549 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 214/420] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 1 13:34:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:46.253186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce523af-1c58-4627-ab76-5b9e7a4440e0 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:46.308411 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:46.368340 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eadb88-e3c6-4c8b-a79b-7027e4bb003e None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:46.408348 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa888e6-e7ee-4be0-b1da-e6be7d1c44c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:46.409209 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa888e6-e7ee-4be0-b1da-e6be7d1c44c9 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:46.409667 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa888e6-e7ee-4be0-b1da-e6be7d1c44c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:46.410084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa888e6-e7ee-4be0-b1da-e6be7d1c44c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:46.421533 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa888e6-e7ee-4be0-b1da-e6be7d1c44c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:46.426676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-afa888e6-e7ee-4be0-b1da-e6be7d1c44c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:46.426676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:46.426676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:46.426676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:46.426676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:46.426676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:46.426676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:46.426676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:46.426676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:46.426676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:46.426676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:46.426676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:46.426676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:46.426676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:46.426676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:46.426676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:46.427791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:46.427791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:46.427791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:46.427791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:46.427791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:46.427791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:46.427791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:46.427791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:46.427791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:46.427791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:46.427791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:46.427791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:46.427791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:46.427791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:46.427791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:46.427791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:46.428755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:46.428755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:46.428755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:46.428755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:46.428755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:46.428755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:46.428755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:46.428755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:46.428755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:46.428755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:46.428755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:46.428755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:46.431012 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 207/421] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:46.436526 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa888e6-e7ee-4be0-b1da-e6be7d1c44c9 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:46.508427 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce523af-1c58-4627-ab76-5b9e7a4440e0 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:46.510598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:46.566093 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa888e6-e7ee-4be0-b1da-e6be7d1c44c9 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:46.571538 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a58c4c-aecb-4280-9490-afb6ab41dec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:46.572153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a58c4c-aecb-4280-9490-afb6ab41dec7 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:46.572955 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a58c4c-aecb-4280-9490-afb6ab41dec7 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:46.573228 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a58c4c-aecb-4280-9490-afb6ab41dec7 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:46.573901 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a58c4c-aecb-4280-9490-afb6ab41dec7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:46.574205 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a58c4c-aecb-4280-9490-afb6ab41dec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:46.575644 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a58c4c-aecb-4280-9490-afb6ab41dec7 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:46.593910 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 215/422] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:34:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:34:46.599523 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a58c4c-aecb-4280-9490-afb6ab41dec7 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:46.622985 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:46.636799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708f4f0-9a13-4e0b-bcd9-788f4b162692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:46.639544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708f4f0-9a13-4e0b-bcd9-788f4b162692 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:46.639544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708f4f0-9a13-4e0b-bcd9-788f4b162692 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:46.639544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708f4f0-9a13-4e0b-bcd9-788f4b162692 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:46.639544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708f4f0-9a13-4e0b-bcd9-788f4b162692 None admin] RBAC: Adding query filter params (name=member) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:46.639544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708f4f0-9a13-4e0b-bcd9-788f4b162692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:46.640241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708f4f0-9a13-4e0b-bcd9-788f4b162692 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:46.652327 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 208/423] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 1 13:34:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:34:46.664526 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708f4f0-9a13-4e0b-bcd9-788f4b162692 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:46.741677 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a58c4c-aecb-4280-9490-afb6ab41dec7 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:46.794572 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea923a-adf5-42b4-8946-1e6d6f7d2bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:46.795185 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea923a-adf5-42b4-8946-1e6d6f7d2bfd None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:46.795551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea923a-adf5-42b4-8946-1e6d6f7d2bfd None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:46.795826 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea923a-adf5-42b4-8946-1e6d6f7d2bfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:46.871232 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:46.908645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708f4f0-9a13-4e0b-bcd9-788f4b162692 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:46.918502 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea923a-adf5-42b4-8946-1e6d6f7d2bfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:46.919954 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea923a-adf5-42b4-8946-1e6d6f7d2bfd None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:46.997078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6efcd4-7ff6-4dd6-88fd-00b361779858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:46.997774 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6efcd4-7ff6-4dd6-88fd-00b361779858 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:46.998057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6efcd4-7ff6-4dd6-88fd-00b361779858 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:46.998328 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6efcd4-7ff6-4dd6-88fd-00b361779858 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:47.038756 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 216/424] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:47.044386 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea923a-adf5-42b4-8946-1e6d6f7d2bfd None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:47.130741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:47.140304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:47.157554 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6efcd4-7ff6-4dd6-88fd-00b361779858 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:47.159022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6efcd4-7ff6-4dd6-88fd-00b361779858 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:47.183236 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea923a-adf5-42b4-8946-1e6d6f7d2bfd None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:47.251839 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35a663-a3c4-4c0c-807f-cded14bec822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:47.252483 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35a663-a3c4-4c0c-807f-cded14bec822 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:47.252767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35a663-a3c4-4c0c-807f-cded14bec822 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:47.253029 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35a663-a3c4-4c0c-807f-cded14bec822 None admin] PATH_INFO: `/v3/projects/4ab598b3074241ac9c1da0a539adebc9` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:47.254175 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35a663-a3c4-4c0c-807f-cded14bec822 None admin] RBAC: Authorizing `identity:get_project(project_id=4ab598b3074241ac9c1da0a539adebc9)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:47.255667 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35a663-a3c4-4c0c-807f-cded14bec822 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:47.257322 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 217/425] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:47 2022] GET /identity/v3/projects/4ab598b3074241ac9c1da0a539adebc9 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:47.263309 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35a663-a3c4-4c0c-807f-cded14bec822 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:47.377874 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 209/426] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:47.383422 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6efcd4-7ff6-4dd6-88fd-00b361779858 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:47.415192 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35a663-a3c4-4c0c-807f-cded14bec822 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:47.458171 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:47.467460 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e9936-7a42-4341-8365-64aee75381cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:47.474582 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e9936-7a42-4341-8365-64aee75381cd None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:47.474582 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e9936-7a42-4341-8365-64aee75381cd None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:47.474582 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e9936-7a42-4341-8365-64aee75381cd None admin] PATH_INFO: `/v3/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:47.474582 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e9936-7a42-4341-8365-64aee75381cd None admin] RBAC: Authorizing `identity:get_group(group_id=a8e9c7bd8db745b7a1ef108f9c3fb7f8)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:47.474582 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e9936-7a42-4341-8365-64aee75381cd None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:47.476696 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 218/427] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 1 13:34:47 2022] GET /identity/v3/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:47.483004 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e9936-7a42-4341-8365-64aee75381cd None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:47.546770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:47.557899 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6efcd4-7ff6-4dd6-88fd-00b361779858 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:47.598002 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8383934-581b-4d87-88f1-729e7ec6bb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:47.598641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8383934-581b-4d87-88f1-729e7ec6bb32 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:47.598923 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8383934-581b-4d87-88f1-729e7ec6bb32 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:47.599189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8383934-581b-4d87-88f1-729e7ec6bb32 None admin] PATH_INFO: `/v3/projects/4ab598b3074241ac9c1da0a539adebc9` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:47.600406 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8383934-581b-4d87-88f1-729e7ec6bb32 None admin] RBAC: Authorizing `identity:get_project(project_id=4ab598b3074241ac9c1da0a539adebc9)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:47.601877 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8383934-581b-4d87-88f1-729e7ec6bb32 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:47.604781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 210/428] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:47 2022] GET /identity/v3/projects/4ab598b3074241ac9c1da0a539adebc9 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:47.610600 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8383934-581b-4d87-88f1-729e7ec6bb32 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:47.674510 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e9936-7a42-4341-8365-64aee75381cd None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:47.716108 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bdefe-0d8d-4b5c-8994-665d1845a98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:47.716648 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bdefe-0d8d-4b5c-8994-665d1845a98e None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:47.716926 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bdefe-0d8d-4b5c-8994-665d1845a98e None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:47.717199 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bdefe-0d8d-4b5c-8994-665d1845a98e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:47.717961 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4bdefe-0d8d-4b5c-8994-665d1845a98e None admin] RBAC: Adding query filter params (group.id=a8e9c7bd8db745b7a1ef108f9c3fb7f8, role.id=f0d2493c03664449802df928b8e8fa53, scope.project.id=4ab598b3074241ac9c1da0a539adebc9) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:47.718274 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4bdefe-0d8d-4b5c-8994-665d1845a98e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:47.719851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4bdefe-0d8d-4b5c-8994-665d1845a98e None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:47.727531 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 219/429] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Sep 1 13:34:47 2022] GET /identity/v3/role_assignments?group.id=a8e9c7bd8db745b7a1ef108f9c3fb7f8&scope.project.id=4ab598b3074241ac9c1da0a539adebc9&role.id=f0d2493c03664449802df928b8e8fa53 => generated 611 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:34:47.730760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4715f-944b-47ed-8047-5098dacc49bb None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:47.731634 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4715f-944b-47ed-8047-5098dacc49bb None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:47.732342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4715f-944b-47ed-8047-5098dacc49bb None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:47.734897 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 220/430] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:47.741040 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb255171-cef9-4af8-b67f-c1604c9ba0b9 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:47.741344 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb255171-cef9-4af8-b67f-c1604c9ba0b9 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:47.741627 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb255171-cef9-4af8-b67f-c1604c9ba0b9 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:47.743303 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 221/431] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:47.745831 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3b3ed-9806-4296-8db4-175b2d542e99 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:47.746100 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3b3ed-9806-4296-8db4-175b2d542e99 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:47.746372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3b3ed-9806-4296-8db4-175b2d542e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:47.762387 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8383934-581b-4d87-88f1-729e7ec6bb32 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:47.768670 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-92c3b3ed-9806-4296-8db4-175b2d542e99 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:47.770133 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-92c3b3ed-9806-4296-8db4-175b2d542e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:47.819793 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f76a1-8c23-4bc4-b18a-c7ba06c5fc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:47.820747 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f76a1-8c23-4bc4-b18a-c7ba06c5fc40 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:47.821165 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f76a1-8c23-4bc4-b18a-c7ba06c5fc40 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:47.821645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f76a1-8c23-4bc4-b18a-c7ba06c5fc40 None admin] PATH_INFO: `/v3/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:47.823128 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f76a1-8c23-4bc4-b18a-c7ba06c5fc40 None admin] RBAC: Authorizing `identity:get_group(group_id=a8e9c7bd8db745b7a1ef108f9c3fb7f8)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:47.825071 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f76a1-8c23-4bc4-b18a-c7ba06c5fc40 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:47.831813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 211/432] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 1 13:34:47 2022] GET /identity/v3/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:47.833613 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9826e5-f0fa-4ddc-9572-8b1178242a32 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:47.834111 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9826e5-f0fa-4ddc-9572-8b1178242a32 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:47.834573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9826e5-f0fa-4ddc-9572-8b1178242a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:47.852828 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:47.856592 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-9e9826e5-f0fa-4ddc-9572-8b1178242a32 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:47.858513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-9e9826e5-f0fa-4ddc-9572-8b1178242a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:47.864372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 222/433] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:47.871667 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3b3ed-9806-4296-8db4-175b2d542e99 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:47.891861 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:47.966380 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 212/434] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:47.996890 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3b3ed-9806-4296-8db4-175b2d542e99 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:48.033340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42065794-4dd4-4c06-bea8-415606daef47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:48.033947 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42065794-4dd4-4c06-bea8-415606daef47 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:48.034220 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42065794-4dd4-4c06-bea8-415606daef47 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:48.034486 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42065794-4dd4-4c06-bea8-415606daef47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:48.035207 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42065794-4dd4-4c06-bea8-415606daef47 None admin] RBAC: Adding query filter params (group.id=a8e9c7bd8db745b7a1ef108f9c3fb7f8, role.id=3654765b6c2644779fda2924f119aef7, scope.project.id=4ab598b3074241ac9c1da0a539adebc9) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:48.035583 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42065794-4dd4-4c06-bea8-415606daef47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:48.037070 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42065794-4dd4-4c06-bea8-415606daef47 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:48.044208 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 223/435] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Sep 1 13:34:47 2022] GET /identity/v3/role_assignments?group.id=a8e9c7bd8db745b7a1ef108f9c3fb7f8&scope.project.id=4ab598b3074241ac9c1da0a539adebc9&role.id=3654765b6c2644779fda2924f119aef7 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:48.158869 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0c077-020b-4b46-9934-edab88c3c416 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:48.159227 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0c077-020b-4b46-9934-edab88c3c416 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:48.159484 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0c077-020b-4b46-9934-edab88c3c416 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:48.160897 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 213/436] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:48.167621 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60b5a5-d6b8-4e51-82fb-83b9848af5be None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:48.167925 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60b5a5-d6b8-4e51-82fb-83b9848af5be None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:48.168166 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60b5a5-d6b8-4e51-82fb-83b9848af5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:48.188553 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-9a60b5a5-d6b8-4e51-82fb-83b9848af5be None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:48.190114 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-9a60b5a5-d6b8-4e51-82fb-83b9848af5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:48.203201 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0c077-020b-4b46-9934-edab88c3c416 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:48.262783 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:48.280143 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 224/437] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:48.281006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60b5a5-d6b8-4e51-82fb-83b9848af5be None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:48.339550 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0c077-020b-4b46-9934-edab88c3c416 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:48.384616 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636f8e7-101d-4979-bdbf-d82353f9c627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:48.385255 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636f8e7-101d-4979-bdbf-d82353f9c627 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:48.385530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636f8e7-101d-4979-bdbf-d82353f9c627 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:48.385793 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636f8e7-101d-4979-bdbf-d82353f9c627 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:48.404946 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636f8e7-101d-4979-bdbf-d82353f9c627 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:48.410671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-e636f8e7-101d-4979-bdbf-d82353f9c627 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:48.410671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:48.410671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:48.410671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:48.410671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:48.410671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:48.410671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:48.410671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:48.410671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:48.410671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:48.410671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:48.410671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:48.410671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:48.410671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:48.410671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:48.410671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:48.411647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:48.411647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:48.411647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:48.411647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:48.411647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:48.411647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:48.411647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:48.411647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:48.411647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:48.411647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:48.411647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:48.411647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:48.411647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:48.411647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:48.411647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:48.411647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:48.412434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:48.412434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:48.412434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:48.412434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:48.412434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:48.412434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:48.412434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:48.412434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:48.412434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:48.412434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:48.412434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:34:48.412434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:48.412434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 214/438] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:34:48.420371 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60b5a5-d6b8-4e51-82fb-83b9848af5be None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:48.422907 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636f8e7-101d-4979-bdbf-d82353f9c627 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:48.448641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:48.477516 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d026e93-b701-4b4d-b391-c177d50c5b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:48.478515 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d026e93-b701-4b4d-b391-c177d50c5b28 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:48.479753 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d026e93-b701-4b4d-b391-c177d50c5b28 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:48.480033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d026e93-b701-4b4d-b391-c177d50c5b28 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:48.499002 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d026e93-b701-4b4d-b391-c177d50c5b28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:48.503991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-5d026e93-b701-4b4d-b391-c177d50c5b28 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:34:48.503991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:48.503991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:48.503991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:48.503991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:48.503991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:48.503991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:48.503991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:48.503991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:48.503991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:48.503991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:48.503991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:48.503991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:48.503991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:48.503991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:48.503991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:48.505048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:48.505048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:48.505048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:48.505048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:48.505048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:48.505048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:48.505048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:48.505048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:48.505048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:48.505048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:48.505048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:48.505048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:48.505048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:48.505048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:48.505048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:48.505048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:48.505844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:48.505844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:48.505844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:48.505844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:48.505844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:48.505844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:48.505844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:48.505844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:48.505844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:48.505844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:48.505844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:34:48.505844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:48.505844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 225/439] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 1 13:34:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:48.512283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d026e93-b701-4b4d-b391-c177d50c5b28 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:48.569508 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636f8e7-101d-4979-bdbf-d82353f9c627 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:48.591667 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:48.614985 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf421f-8d28-4210-94b2-0e9abffc1f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:48.615883 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf421f-8d28-4210-94b2-0e9abffc1f8e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:48.616310 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf421f-8d28-4210-94b2-0e9abffc1f8e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:48.616748 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf421f-8d28-4210-94b2-0e9abffc1f8e None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:48.617607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf421f-8d28-4210-94b2-0e9abffc1f8e None admin] RBAC: Adding query filter params (name=member) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:48.617910 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf421f-8d28-4210-94b2-0e9abffc1f8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:48.619423 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf421f-8d28-4210-94b2-0e9abffc1f8e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:48.631565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 215/440] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 1 13:34:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:48.633054 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf421f-8d28-4210-94b2-0e9abffc1f8e None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:48.656815 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d026e93-b701-4b4d-b391-c177d50c5b28 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:48.701281 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478944a-d64e-4571-8c7d-12933bbd17ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:48.702077 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478944a-d64e-4571-8c7d-12933bbd17ae None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:48.702077 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478944a-d64e-4571-8c7d-12933bbd17ae None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:48.702243 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478944a-d64e-4571-8c7d-12933bbd17ae None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:48.702898 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478944a-d64e-4571-8c7d-12933bbd17ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:48.704510 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478944a-d64e-4571-8c7d-12933bbd17ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:48.704699 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478944a-d64e-4571-8c7d-12933bbd17ae None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:48.719073 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 226/441] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:34:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:48.720228 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478944a-d64e-4571-8c7d-12933bbd17ae None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:48.738808 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:48.760980 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf421f-8d28-4210-94b2-0e9abffc1f8e None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:48.795804 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbdd891-30cd-480a-a8f2-8e5219acc27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:48.796473 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdd891-30cd-480a-a8f2-8e5219acc27d None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:48.796688 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdd891-30cd-480a-a8f2-8e5219acc27d None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:48.796960 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdd891-30cd-480a-a8f2-8e5219acc27d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:48.806938 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbdd891-30cd-480a-a8f2-8e5219acc27d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:48.812191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-5dbdd891-30cd-480a-a8f2-8e5219acc27d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:34:48.812191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:48.812191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:48.812191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:48.812191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:48.812191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:48.812191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:48.812191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:48.812191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:48.812191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:48.812191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:48.812191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:48.812191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:48.812191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:48.812191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:48.812191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:48.813050 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:48.813050 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:48.813050 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:48.813050 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:48.813050 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:48.813050 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:48.813050 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:48.813050 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:48.813050 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:48.813050 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:48.813050 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:48.813050 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:48.813050 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:48.813050 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:48.813050 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:48.813050 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:48.813848 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:48.813848 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:48.813848 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:48.813848 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:48.813848 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:48.813848 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:48.813848 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:48.813848 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:48.813848 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:48.813848 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:48.813848 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:34:48.813848 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:48.813848 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 216/442] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:34:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:48.814467 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbdd891-30cd-480a-a8f2-8e5219acc27d None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:48.826672 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478944a-d64e-4571-8c7d-12933bbd17ae None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:48.839243 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:48.863882 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40b576-c8c8-476e-8e98-ab11126af45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:48.864495 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40b576-c8c8-476e-8e98-ab11126af45b None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:48.864772 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40b576-c8c8-476e-8e98-ab11126af45b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:48.865039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40b576-c8c8-476e-8e98-ab11126af45b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:48.923666 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbdd891-30cd-480a-a8f2-8e5219acc27d None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:48.939421 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40b576-c8c8-476e-8e98-ab11126af45b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:48.940997 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40b576-c8c8-476e-8e98-ab11126af45b None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:48.962674 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e0d08-6d0c-4744-a27d-a1aeb4f3e63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:48.963883 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e0d08-6d0c-4744-a27d-a1aeb4f3e63c None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:48.964158 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e0d08-6d0c-4744-a27d-a1aeb4f3e63c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:48.964425 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e0d08-6d0c-4744-a27d-a1aeb4f3e63c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:48.973189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:49.034715 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e0d08-6d0c-4744-a27d-a1aeb4f3e63c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:49.036218 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e0d08-6d0c-4744-a27d-a1aeb4f3e63c None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:49.054063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 227/443] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:49.054921 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40b576-c8c8-476e-8e98-ab11126af45b None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:49.066910 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:49.144623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 217/444] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:49.145390 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e0d08-6d0c-4744-a27d-a1aeb4f3e63c None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:49.156727 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40b576-c8c8-476e-8e98-ab11126af45b None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:49.186998 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:49.191827 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d85f8f-0707-4bee-8bbe-d6fde42290d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:49.192437 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d85f8f-0707-4bee-8bbe-d6fde42290d2 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:49.192719 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d85f8f-0707-4bee-8bbe-d6fde42290d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:49.192995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d85f8f-0707-4bee-8bbe-d6fde42290d2 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:49.193657 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d85f8f-0707-4bee-8bbe-d6fde42290d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:49.193967 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d85f8f-0707-4bee-8bbe-d6fde42290d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:49.195389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d85f8f-0707-4bee-8bbe-d6fde42290d2 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:49.204251 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 228/445] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:49.205056 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d85f8f-0707-4bee-8bbe-d6fde42290d2 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:49.247910 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e0d08-6d0c-4744-a27d-a1aeb4f3e63c None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:49.274899 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:49.281689 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bc2b9-ddfe-4d9c-b7bd-87e403fbc2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:49.282321 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bc2b9-ddfe-4d9c-b7bd-87e403fbc2cc None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:49.285837 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bc2b9-ddfe-4d9c-b7bd-87e403fbc2cc None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:49.285837 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bc2b9-ddfe-4d9c-b7bd-87e403fbc2cc None admin] PATH_INFO: `/v3/projects/3e8cca114ed04209a31e58f224967b4a` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:49.285837 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818bc2b9-ddfe-4d9c-b7bd-87e403fbc2cc None admin] RBAC: Authorizing `identity:get_project(project_id=3e8cca114ed04209a31e58f224967b4a)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:49.285837 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818bc2b9-ddfe-4d9c-b7bd-87e403fbc2cc None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:49.287197 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 218/446] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:49 2022] GET /identity/v3/projects/3e8cca114ed04209a31e58f224967b4a => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:49.288015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bc2b9-ddfe-4d9c-b7bd-87e403fbc2cc None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:49.310177 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d85f8f-0707-4bee-8bbe-d6fde42290d2 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:49.346447 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b0ab2-4f3c-459c-8181-c28909e286b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:49.347081 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b0ab2-4f3c-459c-8181-c28909e286b3 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:49.347401 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b0ab2-4f3c-459c-8181-c28909e286b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:49.347692 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b0ab2-4f3c-459c-8181-c28909e286b3 None admin] PATH_INFO: `/v3/projects/3e8cca114ed04209a31e58f224967b4a` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:49.348805 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b0ab2-4f3c-459c-8181-c28909e286b3 None admin] RBAC: Authorizing `identity:get_project(project_id=3e8cca114ed04209a31e58f224967b4a)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:49.350271 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b0ab2-4f3c-459c-8181-c28909e286b3 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:49.351946 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 229/447] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:49 2022] GET /identity/v3/projects/3e8cca114ed04209a31e58f224967b4a => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:49.352729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b0ab2-4f3c-459c-8181-c28909e286b3 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:49.393869 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bc2b9-ddfe-4d9c-b7bd-87e403fbc2cc None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:49.401078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:49.432413 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20905dc-da6c-4ba6-b47e-102244561b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:49.433036 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20905dc-da6c-4ba6-b47e-102244561b4f None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:49.433316 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20905dc-da6c-4ba6-b47e-102244561b4f None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:49.433586 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20905dc-da6c-4ba6-b47e-102244561b4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:49.456908 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b0ab2-4f3c-459c-8181-c28909e286b3 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:49.489801 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fad9e-beb2-4d5c-b0ac-ae77d5018230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:49.490444 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fad9e-beb2-4d5c-b0ac-ae77d5018230 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:49.490726 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fad9e-beb2-4d5c-b0ac-ae77d5018230 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:49.491003 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fad9e-beb2-4d5c-b0ac-ae77d5018230 None admin] PATH_INFO: `/v3/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:49.492194 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795fad9e-beb2-4d5c-b0ac-ae77d5018230 None admin] RBAC: Authorizing `identity:get_group(group_id=a8e9c7bd8db745b7a1ef108f9c3fb7f8)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:49.493669 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795fad9e-beb2-4d5c-b0ac-ae77d5018230 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:49.495959 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 230/448] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 1 13:34:49 2022] GET /identity/v3/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:49.496738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fad9e-beb2-4d5c-b0ac-ae77d5018230 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:49.507760 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20905dc-da6c-4ba6-b47e-102244561b4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:49.508012 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:49.509530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20905dc-da6c-4ba6-b47e-102244561b4f None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:49.600149 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fad9e-beb2-4d5c-b0ac-ae77d5018230 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:49.610841 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 219/449] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:49.611723 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20905dc-da6c-4ba6-b47e-102244561b4f None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:49.622303 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:49.635796 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df92bcd-ac48-4866-ad74-8a69c579ed89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:49.636421 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df92bcd-ac48-4866-ad74-8a69c579ed89 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:49.636701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df92bcd-ac48-4866-ad74-8a69c579ed89 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:49.636972 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df92bcd-ac48-4866-ad74-8a69c579ed89 None admin] PATH_INFO: `/v3/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:49.638076 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df92bcd-ac48-4866-ad74-8a69c579ed89 None admin] RBAC: Authorizing `identity:get_group(group_id=a8e9c7bd8db745b7a1ef108f9c3fb7f8)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:49.639566 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df92bcd-ac48-4866-ad74-8a69c579ed89 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:49.641244 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 231/450] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 1 13:34:49 2022] GET /identity/v3/groups/a8e9c7bd8db745b7a1ef108f9c3fb7f8 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:49.642009 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df92bcd-ac48-4866-ad74-8a69c579ed89 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:49.720503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20905dc-da6c-4ba6-b47e-102244561b4f None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:49.725398 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:49.748963 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df92bcd-ac48-4866-ad74-8a69c579ed89 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:49.755330 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86016b-14ef-4433-8335-25e980f42547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:49.755968 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86016b-14ef-4433-8335-25e980f42547 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:49.756248 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86016b-14ef-4433-8335-25e980f42547 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:49.756517 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86016b-14ef-4433-8335-25e980f42547 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:49.757242 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86016b-14ef-4433-8335-25e980f42547 None admin] RBAC: Adding query filter params (group.id=a8e9c7bd8db745b7a1ef108f9c3fb7f8, role.id=3654765b6c2644779fda2924f119aef7, scope.project.id=3e8cca114ed04209a31e58f224967b4a) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:49.757548 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86016b-14ef-4433-8335-25e980f42547 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:49.758992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86016b-14ef-4433-8335-25e980f42547 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:49.765518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 220/451] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Sep 1 13:34:49 2022] GET /identity/v3/role_assignments?group.id=a8e9c7bd8db745b7a1ef108f9c3fb7f8&scope.project.id=3e8cca114ed04209a31e58f224967b4a&role.id=3654765b6c2644779fda2924f119aef7 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:49.766313 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86016b-14ef-4433-8335-25e980f42547 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:49.791990 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69dfc46-b5ab-414c-9c46-93bfded4d20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:49.792644 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69dfc46-b5ab-414c-9c46-93bfded4d20d None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:49.792922 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69dfc46-b5ab-414c-9c46-93bfded4d20d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:49.793237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69dfc46-b5ab-414c-9c46-93bfded4d20d None admin] PATH_INFO: `/v3/projects/c52243fb4fdd4f1bb4f3291630bfbabe` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:49.794520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69dfc46-b5ab-414c-9c46-93bfded4d20d None admin] RBAC: Authorizing `identity:get_project(project_id=c52243fb4fdd4f1bb4f3291630bfbabe)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:49.796701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69dfc46-b5ab-414c-9c46-93bfded4d20d None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:49.798979 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 232/452] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:34:49 2022] GET /identity/v3/projects/c52243fb4fdd4f1bb4f3291630bfbabe => generated 344 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:49.804618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69dfc46-b5ab-414c-9c46-93bfded4d20d None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:49.847807 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:49.884984 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86016b-14ef-4433-8335-25e980f42547 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:49.921255 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29682832-2aba-445c-a3de-b0514fde71da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:49.921864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29682832-2aba-445c-a3de-b0514fde71da None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:49.922142 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29682832-2aba-445c-a3de-b0514fde71da None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:49.922413 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29682832-2aba-445c-a3de-b0514fde71da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:49.923221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29682832-2aba-445c-a3de-b0514fde71da None admin] RBAC: Adding query filter params (group.id=a8e9c7bd8db745b7a1ef108f9c3fb7f8, role.id=f0d2493c03664449802df928b8e8fa53, scope.project.id=3e8cca114ed04209a31e58f224967b4a) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:49.923558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29682832-2aba-445c-a3de-b0514fde71da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:49.925000 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29682832-2aba-445c-a3de-b0514fde71da None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:49.931588 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 221/453] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Sep 1 13:34:49 2022] GET /identity/v3/role_assignments?group.id=a8e9c7bd8db745b7a1ef108f9c3fb7f8&scope.project.id=3e8cca114ed04209a31e58f224967b4a&role.id=f0d2493c03664449802df928b8e8fa53 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:49.945584 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69dfc46-b5ab-414c-9c46-93bfded4d20d None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:49.987222 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6408a02-da4e-4a10-a15f-e91ef282e531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:49.987817 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6408a02-da4e-4a10-a15f-e91ef282e531 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:49.988102 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6408a02-da4e-4a10-a15f-e91ef282e531 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:49.988379 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6408a02-da4e-4a10-a15f-e91ef282e531 None admin] PATH_INFO: `/v3/groups/933e51bac6cc4b6eb6612aafe08ef9cf` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:49.989751 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6408a02-da4e-4a10-a15f-e91ef282e531 None admin] RBAC: Authorizing `identity:get_group(group_id=933e51bac6cc4b6eb6612aafe08ef9cf)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:49.991235 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6408a02-da4e-4a10-a15f-e91ef282e531 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:49.992943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 233/454] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Sep 1 13:34:49 2022] GET /identity/v3/groups/933e51bac6cc4b6eb6612aafe08ef9cf => generated 229 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:49.999233 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29682832-2aba-445c-a3de-b0514fde71da None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:50.117510 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29682832-2aba-445c-a3de-b0514fde71da None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:50.156252 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44443b4a-a9cd-4207-9374-189ab427b937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:50.156863 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44443b4a-a9cd-4207-9374-189ab427b937 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:50.157140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44443b4a-a9cd-4207-9374-189ab427b937 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:50.157410 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44443b4a-a9cd-4207-9374-189ab427b937 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:50.158139 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44443b4a-a9cd-4207-9374-189ab427b937 None admin] RBAC: Adding query filter params (group.id=933e51bac6cc4b6eb6612aafe08ef9cf, role.id=98ffd3c114804da292d7cb33721e9085, scope.project.id=c52243fb4fdd4f1bb4f3291630bfbabe) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:50.158449 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44443b4a-a9cd-4207-9374-189ab427b937 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:50.159919 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44443b4a-a9cd-4207-9374-189ab427b937 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:50.162008 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:50.167259 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 222/455] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Sep 1 13:34:49 2022] GET /identity/v3/role_assignments?group.id=933e51bac6cc4b6eb6612aafe08ef9cf&scope.project.id=c52243fb4fdd4f1bb4f3291630bfbabe&role.id=98ffd3c114804da292d7cb33721e9085 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:52.428443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed960bf1-a0f1-4493-a694-45bf29ee37f1 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:52.428968 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed960bf1-a0f1-4493-a694-45bf29ee37f1 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:52.428968 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed960bf1-a0f1-4493-a694-45bf29ee37f1 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:52.430599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 234/456] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:52.436880 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9cfa0-ed06-4605-94a7-ae3bbb5e26a4 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:52.437850 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9cfa0-ed06-4605-94a7-ae3bbb5e26a4 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:52.438336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9cfa0-ed06-4605-94a7-ae3bbb5e26a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:52.458840 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-11e9cfa0-ed06-4605-94a7-ae3bbb5e26a4 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:52.460412 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-11e9cfa0-ed06-4605-94a7-ae3bbb5e26a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:52.541768 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 223/457] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:34:52.750771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea4f7c-e202-4423-8ccd-1c7e5ff316ae None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:52.751424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea4f7c-e202-4423-8ccd-1c7e5ff316ae None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:52.751891 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea4f7c-e202-4423-8ccd-1c7e5ff316ae None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:52.753417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 235/458] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:52.758914 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c7e20-76db-4d0b-a573-6bacd7eaa51b None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:52.760053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c7e20-76db-4d0b-a573-6bacd7eaa51b None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:52.760540 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c7e20-76db-4d0b-a573-6bacd7eaa51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:52.784308 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-c27c7e20-76db-4d0b-a573-6bacd7eaa51b None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:52.785876 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c27c7e20-76db-4d0b-a573-6bacd7eaa51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:52.880111 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 224/459] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:52.937723 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea4f7c-e202-4423-8ccd-1c7e5ff316ae None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:52.952084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f1128-9b7b-461e-a92e-dde480986f11 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:52.952387 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f1128-9b7b-461e-a92e-dde480986f11 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:52.952639 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f1128-9b7b-461e-a92e-dde480986f11 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:52.954247 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 225/460] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:52.963407 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:52.963574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da4406-2442-4ec8-a524-77b8a4bd1851 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:52.963574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da4406-2442-4ec8-a524-77b8a4bd1851 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:52.963574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da4406-2442-4ec8-a524-77b8a4bd1851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:53.002600 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-03da4406-2442-4ec8-a524-77b8a4bd1851 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:53.002600 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-03da4406-2442-4ec8-a524-77b8a4bd1851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:53.100140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:53.127489 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 226/461] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:34:53.139481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea4f7c-e202-4423-8ccd-1c7e5ff316ae None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:53.194948 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2dc43-fba4-4f92-8515-886c9329b183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:53.195908 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2dc43-fba4-4f92-8515-886c9329b183 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:53.196337 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2dc43-fba4-4f92-8515-886c9329b183 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:53.196775 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2dc43-fba4-4f92-8515-886c9329b183 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:53.212451 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2dc43-fba4-4f92-8515-886c9329b183 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:53.214143 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2dc43-fba4-4f92-8515-886c9329b183 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:53.233693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-5bd2dc43-fba4-4f92-8515-886c9329b183 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:34:53.233693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:53.233693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:53.233693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:53.233693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:53.233693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:53.233693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:53.233693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:53.233693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:53.233693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:53.233693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:53.233693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:53.233693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:34:53.233693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:34:53.233693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:34:53.233693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:34:53.234844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:53.234844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:53.234844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:53.234844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:53.234844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:53.234844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:53.234844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:53.234844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:53.234844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:53.234844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:53.234844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:53.234844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:53.234844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:53.234844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:53.234844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:53.234844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:53.234844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:34:53.235936 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:34:53.235936 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:34:53.235936 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:53.237344 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 236/462] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:34:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:53.243178 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da4406-2442-4ec8-a524-77b8a4bd1851 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:53.321406 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2dc43-fba4-4f92-8515-886c9329b183 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:53.370435 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da4406-2442-4ec8-a524-77b8a4bd1851 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:53.419699 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ac63d-0a9d-414a-852a-5c912abcca83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:53.419699 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ac63d-0a9d-414a-852a-5c912abcca83 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:53.419699 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ac63d-0a9d-414a-852a-5c912abcca83 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:53.419699 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ac63d-0a9d-414a-852a-5c912abcca83 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:53.420155 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ac63d-0a9d-414a-852a-5c912abcca83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:53.420155 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ac63d-0a9d-414a-852a-5c912abcca83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:53.420155 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ac63d-0a9d-414a-852a-5c912abcca83 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:53.433068 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 227/463] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:53.433931 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ac63d-0a9d-414a-852a-5c912abcca83 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:53.442642 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:53.488631 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2dc43-fba4-4f92-8515-886c9329b183 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:53.492861 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:53.526700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f373da-de2a-422d-8191-3842459b51dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:53.527334 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f373da-de2a-422d-8191-3842459b51dc None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:53.527649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f373da-de2a-422d-8191-3842459b51dc None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:53.527926 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f373da-de2a-422d-8191-3842459b51dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:53.540276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f373da-de2a-422d-8191-3842459b51dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:53.542311 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f373da-de2a-422d-8191-3842459b51dc None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:53.557773 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-23f373da-de2a-422d-8191-3842459b51dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:34:53.557773 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:53.557773 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:53.557773 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:53.557773 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:53.557773 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:53.557773 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:53.557773 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:53.557773 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:53.557773 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:53.557773 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:53.557773 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:53.557773 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:34:53.557773 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:34:53.557773 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:34:53.557773 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:34:53.558767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:53.558767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:53.558767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:53.558767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:53.558767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:53.558767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:53.558767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:53.558767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:53.558767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:53.558767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:53.558767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:53.558767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:53.558767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:53.558767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:53.558767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:53.558767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:53.558767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:34:53.559628 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:34:53.559628 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:34:53.559628 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:53.559786 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ac63d-0a9d-414a-852a-5c912abcca83 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:53.559856 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 237/464] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:34:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:53.560582 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f373da-de2a-422d-8191-3842459b51dc None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:53.594734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c33bc-10e5-43bf-8a76-a23ec5a85821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:53.595285 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c33bc-10e5-43bf-8a76-a23ec5a85821 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:53.595605 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c33bc-10e5-43bf-8a76-a23ec5a85821 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:53.595874 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c33bc-10e5-43bf-8a76-a23ec5a85821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:53.608757 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c33bc-10e5-43bf-8a76-a23ec5a85821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:53.610749 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c33bc-10e5-43bf-8a76-a23ec5a85821 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:53.627065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-1e1c33bc-10e5-43bf-8a76-a23ec5a85821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:34:53.627065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:53.627065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:53.627065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:53.627065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:53.627065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:53.627065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:53.627065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:53.627065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:53.627065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:53.627065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:53.627065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:53.627065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:34:53.627065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:34:53.627065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:34:53.627065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:34:53.628216 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:53.628216 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:53.628216 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:53.628216 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:53.628216 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:53.628216 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:53.628216 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:53.628216 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:53.628216 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:53.628216 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:53.628216 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:53.628216 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:53.628216 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:53.628216 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:53.628216 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:53.628216 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:53.628216 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:34:53.629023 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:34:53.629023 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:34:53.629023 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:53.629023 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 228/465] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:34:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:53.629804 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd62433-879d-4882-b29a-3a7c589016ca None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:53.629804 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd62433-879d-4882-b29a-3a7c589016ca None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:53.630062 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd62433-879d-4882-b29a-3a7c589016ca None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:53.635711 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 229/466] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:53.636395 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd62433-879d-4882-b29a-3a7c589016ca None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:53.680159 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f373da-de2a-422d-8191-3842459b51dc None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:53.697300 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:53.716689 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320059c-de14-49ae-bd18-26d65c0f336b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:53.722986 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320059c-de14-49ae-bd18-26d65c0f336b None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:53.722986 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320059c-de14-49ae-bd18-26d65c0f336b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:53.722986 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320059c-de14-49ae-bd18-26d65c0f336b None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:53.722986 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320059c-de14-49ae-bd18-26d65c0f336b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:53.722986 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320059c-de14-49ae-bd18-26d65c0f336b None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:53.745865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:53.751500 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd62433-879d-4882-b29a-3a7c589016ca None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:53.785908 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06823d68-b6b2-4478-bdad-29c949641339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:53.786638 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06823d68-b6b2-4478-bdad-29c949641339 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:53.786915 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06823d68-b6b2-4478-bdad-29c949641339 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:53.787186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06823d68-b6b2-4478-bdad-29c949641339 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:53.787890 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06823d68-b6b2-4478-bdad-29c949641339 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:53.788192 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06823d68-b6b2-4478-bdad-29c949641339 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:53.789577 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06823d68-b6b2-4478-bdad-29c949641339 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:53.802025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 230/467] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:53.802851 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06823d68-b6b2-4478-bdad-29c949641339 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:53.833617 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 238/468] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 1 13:34:53 2022] POST /identity/v3/users => generated 246 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:34:53.835311 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e54349-29b6-4f9c-8e19-d5ab71e05a73 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:53.835624 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e54349-29b6-4f9c-8e19-d5ab71e05a73 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:53.835898 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e54349-29b6-4f9c-8e19-d5ab71e05a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:53.864399 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-86e54349-29b6-4f9c-8e19-d5ab71e05a73 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:53.865943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-86e54349-29b6-4f9c-8e19-d5ab71e05a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:53.950232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06823d68-b6b2-4478-bdad-29c949641339 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:53.954642 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 239/469] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:53.955845 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e54349-29b6-4f9c-8e19-d5ab71e05a73 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:54.013224 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c06cf8-2f14-4161-9181-ea80bdecda5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:54.014309 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c06cf8-2f14-4161-9181-ea80bdecda5e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:54.015611 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c06cf8-2f14-4161-9181-ea80bdecda5e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:54.016073 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c06cf8-2f14-4161-9181-ea80bdecda5e None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:54.016906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c06cf8-2f14-4161-9181-ea80bdecda5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:54.017426 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c06cf8-2f14-4161-9181-ea80bdecda5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:54.018983 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c06cf8-2f14-4161-9181-ea80bdecda5e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:54.036702 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 231/470] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:54.042971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c06cf8-2f14-4161-9181-ea80bdecda5e None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:54.075441 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:54.096163 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e54349-29b6-4f9c-8e19-d5ab71e05a73 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:54.098172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:54.139826 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dccb560-6071-44c4-b999-e942a2c79b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:54.140802 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccb560-6071-44c4-b999-e942a2c79b1f None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:54.141373 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccb560-6071-44c4-b999-e942a2c79b1f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:54.141729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccb560-6071-44c4-b999-e942a2c79b1f None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:54.142457 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dccb560-6071-44c4-b999-e942a2c79b1f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:54.144161 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dccb560-6071-44c4-b999-e942a2c79b1f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:54.180702 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c06cf8-2f14-4161-9181-ea80bdecda5e None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:54.222053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837e8fa-e3f5-4b36-b0f7-a8ac612838fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:54.222671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837e8fa-e3f5-4b36-b0f7-a8ac612838fb None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:54.222946 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837e8fa-e3f5-4b36-b0f7-a8ac612838fb None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:54.223213 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837e8fa-e3f5-4b36-b0f7-a8ac612838fb None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:54.223904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837e8fa-e3f5-4b36-b0f7-a8ac612838fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:54.225344 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837e8fa-e3f5-4b36-b0f7-a8ac612838fb None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:54.359495 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 240/471] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 1 13:34:53 2022] POST /identity/v3/users => generated 248 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:34:54.360666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e106a8-497a-4ea0-93da-9fbddb0638f3 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:54.361018 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e106a8-497a-4ea0-93da-9fbddb0638f3 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:54.361292 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e106a8-497a-4ea0-93da-9fbddb0638f3 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:54.362643 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 241/472] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:54.363236 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e106a8-497a-4ea0-93da-9fbddb0638f3 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:54.376907 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 232/473] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 1 13:34:54 2022] POST /identity/v3/users => generated 248 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:34:54.385610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe8af1-adb5-43d9-9592-d78f609a3fbe None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:54.385934 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe8af1-adb5-43d9-9592-d78f609a3fbe None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:54.386168 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe8af1-adb5-43d9-9592-d78f609a3fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:54.428597 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-44fe8af1-adb5-43d9-9592-d78f609a3fbe None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:54.429834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-44fe8af1-adb5-43d9-9592-d78f609a3fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:54.533694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e106a8-497a-4ea0-93da-9fbddb0638f3 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:54.561430 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 233/474] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:54.593219 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424df9a9-d41b-41a5-9aad-e26a99bbffc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:54.593854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424df9a9-d41b-41a5-9aad-e26a99bbffc4 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:54.594126 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424df9a9-d41b-41a5-9aad-e26a99bbffc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:54.594436 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424df9a9-d41b-41a5-9aad-e26a99bbffc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:54.606733 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424df9a9-d41b-41a5-9aad-e26a99bbffc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:54.608502 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424df9a9-d41b-41a5-9aad-e26a99bbffc4 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:54.624237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-424df9a9-d41b-41a5-9aad-e26a99bbffc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:34:54.624237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:54.624237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:54.624237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:54.624237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:54.624237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:54.624237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:54.624237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:54.624237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:54.624237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:54.624237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:54.624237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:54.624237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:34:54.624237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:34:54.624237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:34:54.624237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:34:54.625150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:54.625150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:54.625150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:54.625150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:54.625150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:54.625150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:54.625150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:54.625150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:54.625150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:54.625150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:54.625150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:54.625150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:54.625150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:54.625150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:54.625150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:54.625150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:54.625150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:34:54.625956 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:34:54.625956 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:34:54.625956 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:54.625956 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 242/475] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:34:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:54.632496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe8af1-adb5-43d9-9592-d78f609a3fbe None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:54.646148 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:54.775870 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe8af1-adb5-43d9-9592-d78f609a3fbe None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:54.824338 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbb2c7-4cbf-4d6c-8720-f1a77a7f0066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:54.824949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbb2c7-4cbf-4d6c-8720-f1a77a7f0066 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:54.825226 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbb2c7-4cbf-4d6c-8720-f1a77a7f0066 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:54.825494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbb2c7-4cbf-4d6c-8720-f1a77a7f0066 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:54.826136 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbb2c7-4cbf-4d6c-8720-f1a77a7f0066 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:54.826434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbb2c7-4cbf-4d6c-8720-f1a77a7f0066 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:54.827832 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbb2c7-4cbf-4d6c-8720-f1a77a7f0066 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:54.847181 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 234/476] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:54.855774 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424df9a9-d41b-41a5-9aad-e26a99bbffc4 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:54.879514 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbb2c7-4cbf-4d6c-8720-f1a77a7f0066 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:54.881612 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:54.963542 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:55.024470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbb2c7-4cbf-4d6c-8720-f1a77a7f0066 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:55.062043 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424df9a9-d41b-41a5-9aad-e26a99bbffc4 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:55.082310 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e129b9b-a976-41df-ab26-62ceb4722944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:55.082930 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e129b9b-a976-41df-ab26-62ceb4722944 None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:55.084511 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e129b9b-a976-41df-ab26-62ceb4722944 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:55.084795 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e129b9b-a976-41df-ab26-62ceb4722944 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:55.085767 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e129b9b-a976-41df-ab26-62ceb4722944 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:55.088067 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e129b9b-a976-41df-ab26-62ceb4722944 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:55.117613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63eb8b-32d8-4878-a845-e8c4527c6ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:55.118224 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63eb8b-32d8-4878-a845-e8c4527c6ca9 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:55.118560 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63eb8b-32d8-4878-a845-e8c4527c6ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:55.119507 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63eb8b-32d8-4878-a845-e8c4527c6ca9 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:55.120165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c63eb8b-32d8-4878-a845-e8c4527c6ca9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:55.121616 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c63eb8b-32d8-4878-a845-e8c4527c6ca9 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:55.162929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.sql.core [None req-3e129b9b-a976-41df-ab26-62ceb4722944 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 13:34:55.162929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 13:34:55.162929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [parameters: {'id': '9304c604affb43c69e608a67c1e7cb43', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 13:34:55.162929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88418) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 13:34:55.180221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-3e129b9b-a976-41df-ab26-62ceb4722944 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 13:34:55.180221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:55.180221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 13:34:55.180221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 13:34:55.180221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 13:34:55.180221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 13:34:55.180221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 13:34:55.180221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 13:34:55.180221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 13:34:55.180221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application conn.query(q) Sep 01 13:34:55.180221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 13:34:55.180221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 13:34:55.180221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 13:34:55.180221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application result.read() Sep 01 13:34:55.180221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 13:34:55.181134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 13:34:55.181134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 13:34:55.181134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 13:34:55.181134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 13:34:55.181134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 13:34:55.181134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 13:34:55.181134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 13:34:55.181134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 13:34:55.181134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:55.181134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 13:34:55.181134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:55.181134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:55.181134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 13:34:55.181134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 13:34:55.181134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 01 13:34:55.181134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return ref.to_dict() Sep 01 13:34:55.181134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 13:34:55.181134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application next(self.gen) Sep 01 13:34:55.181989 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 13:34:55.181989 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application yield resource Sep 01 13:34:55.181989 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 13:34:55.181989 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application next(self.gen) Sep 01 13:34:55.181989 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 13:34:55.181989 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 13:34:55.181989 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 13:34:55.181989 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 13:34:55.181989 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 13:34:55.181989 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise self.value Sep 01 13:34:55.181989 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 13:34:55.181989 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 13:34:55.181989 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 13:34:55.181989 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application session.commit() Sep 01 13:34:55.181989 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 13:34:55.181989 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 13:34:55.181989 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 13:34:55.182782 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 13:34:55.182782 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 13:34:55.182782 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self.session.flush() Sep 01 13:34:55.182782 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 13:34:55.182782 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 13:34:55.182782 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 13:34:55.182782 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 13:34:55.182782 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 13:34:55.182782 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application compat.raise_( Sep 01 13:34:55.182782 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 13:34:55.182782 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception Sep 01 13:34:55.182782 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 13:34:55.182782 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 13:34:55.182782 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 13:34:55.182782 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 13:34:55.182782 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 13:34:55.182782 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 13:34:55.183645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 13:34:55.183645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 13:34:55.183645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 13:34:55.183645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 13:34:55.183645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 13:34:55.183645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 13:34:55.183645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 13:34:55.183645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 13:34:55.183645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 13:34:55.183645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 13:34:55.183645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 13:34:55.183645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 13:34:55.183645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 13:34:55.183645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 13:34:55.183645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 13:34:55.183645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception Sep 01 13:34:55.184404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 13:34:55.184404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 13:34:55.184404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 13:34:55.184404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 13:34:55.184404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 13:34:55.184404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 13:34:55.184404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 13:34:55.184404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application conn.query(q) Sep 01 13:34:55.184404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 13:34:55.184404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 13:34:55.184404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 13:34:55.184404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application result.read() Sep 01 13:34:55.184404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 13:34:55.184404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 13:34:55.184404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 13:34:55.184404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 13:34:55.185149 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 13:34:55.185149 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 13:34:55.185149 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 13:34:55.185149 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 13:34:55.185149 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 13:34:55.185149 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 13:34:55.185149 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [parameters: {'id': '9304c604affb43c69e608a67c1e7cb43', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 13:34:55.185149 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 13:34:55.185149 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:55.185149 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:34:55.185149 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:55.185149 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:55.185149 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:55.185149 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:55.185149 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:55.185149 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:55.185888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:55.185888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:55.185888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:55.185888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:55.185888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:55.185888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:55.185888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 01 13:34:55.185888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 01 13:34:55.185888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:55.185888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:55.185888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 01 13:34:55.185888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 01 13:34:55.185888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 13:34:55.185888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 13:34:55.185888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 13:34:55.185888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:55.186694 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 235/477] 10.222.0.50 () {60 vars in 1131 bytes} [Thu Sep 1 13:34:54 2022] POST /identity/v3/roles => generated 144 bytes in 303 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:34:55.188112 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e129b9b-a976-41df-ab26-62ceb4722944 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:55.292776 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 243/478] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 1 13:34:54 2022] POST /identity/v3/users => generated 249 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:34:55.308531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e129b9b-a976-41df-ab26-62ceb4722944 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:55.339712 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:55.351106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38aff2-2b31-47d7-b746-8e258d461119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:55.351779 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38aff2-2b31-47d7-b746-8e258d461119 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:55.352061 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38aff2-2b31-47d7-b746-8e258d461119 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:55.352335 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38aff2-2b31-47d7-b746-8e258d461119 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:55.370205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38aff2-2b31-47d7-b746-8e258d461119 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:55.380293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-bd38aff2-2b31-47d7-b746-8e258d461119 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:34:55.380293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:55.380293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:55.380293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:55.380293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:55.380293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:55.380293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:55.380293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:55.380293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:55.380293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:55.380293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:55.380293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:55.380293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:55.380293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:55.380293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:55.380293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:55.382104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:55.382104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:55.382104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:55.382104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:55.382104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:55.382104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:55.382104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:55.382104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:55.382104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:55.382104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:55.382104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:55.382104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:55.382104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:55.382104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:55.382104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:55.382104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:55.386859 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:55.386859 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:55.386859 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:55.386859 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:55.386859 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:55.386859 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:55.386859 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:55.386859 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:55.386859 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:55.386859 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:55.386859 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:34:55.386859 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:55.386859 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 236/479] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 1 13:34:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:55.388480 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63eb8b-32d8-4878-a845-e8c4527c6ca9 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:55.492214 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:55.537445 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63eb8b-32d8-4878-a845-e8c4527c6ca9 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:55.580356 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e8f77-887d-4fa5-9c4c-67f92cd767d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:55.581277 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e8f77-887d-4fa5-9c4c-67f92cd767d0 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:55.581705 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e8f77-887d-4fa5-9c4c-67f92cd767d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:55.582124 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e8f77-887d-4fa5-9c4c-67f92cd767d0 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:55.582937 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e8f77-887d-4fa5-9c4c-67f92cd767d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:55.583441 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e8f77-887d-4fa5-9c4c-67f92cd767d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:55.584986 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e8f77-887d-4fa5-9c4c-67f92cd767d0 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:55.595018 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 244/480] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:34:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:56.346461 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59e115-35ae-40ce-bfb7-0643adcb562f None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:56.347582 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59e115-35ae-40ce-bfb7-0643adcb562f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:56.348157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59e115-35ae-40ce-bfb7-0643adcb562f None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:56.350057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 237/481] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:56.355622 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4b4a1-0231-42bc-a7b3-d52b765713c6 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:56.356172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4b4a1-0231-42bc-a7b3-d52b765713c6 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:56.356649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4b4a1-0231-42bc-a7b3-d52b765713c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:56.384418 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-75b4b4a1-0231-42bc-a7b3-d52b765713c6 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:56.385991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-75b4b4a1-0231-42bc-a7b3-d52b765713c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:56.472129 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 245/482] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:56.738973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8df54-bf9e-46a3-b18c-3e44be317faf None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:56.739651 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8df54-bf9e-46a3-b18c-3e44be317faf None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:56.740235 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8df54-bf9e-46a3-b18c-3e44be317faf None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:56.742138 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 238/483] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:56.747401 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ab61c-eeb3-4df5-9477-52bc60ae5238 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:56.748283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ab61c-eeb3-4df5-9477-52bc60ae5238 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:56.748767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ab61c-eeb3-4df5-9477-52bc60ae5238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:56.772763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-2b9ab61c-eeb3-4df5-9477-52bc60ae5238 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:56.774412 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-2b9ab61c-eeb3-4df5-9477-52bc60ae5238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:56.816471 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b63f6-a7eb-41f6-9837-1881323d0ad0 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:56.817109 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b63f6-a7eb-41f6-9837-1881323d0ad0 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:56.817763 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b63f6-a7eb-41f6-9837-1881323d0ad0 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:56.819765 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 239/484] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:34:56.839584 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:56.842856 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1f113-833b-4337-ac19-8f737a01d0a5 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:56.842856 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1f113-833b-4337-ac19-8f737a01d0a5 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:56.842856 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1f113-833b-4337-ac19-8f737a01d0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:56.868938 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-31c1f113-833b-4337-ac19-8f737a01d0a5 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:56.870238 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-31c1f113-833b-4337-ac19-8f737a01d0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:56.873995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 246/485] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:56.949166 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ab61c-eeb3-4df5-9477-52bc60ae5238 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:56.979377 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 240/486] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:57.072146 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ab61c-eeb3-4df5-9477-52bc60ae5238 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:57.109379 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d540c-21ad-46ab-863b-e372c840e1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:57.110026 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d540c-21ad-46ab-863b-e372c840e1a2 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:57.110307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d540c-21ad-46ab-863b-e372c840e1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:57.110573 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d540c-21ad-46ab-863b-e372c840e1a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:57.122118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d540c-21ad-46ab-863b-e372c840e1a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:57.126881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-370d540c-21ad-46ab-863b-e372c840e1a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:34:57.126881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:57.126881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:57.126881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:57.126881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:57.126881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:57.126881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:57.126881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:57.126881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:57.126881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:57.126881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:57.126881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:57.126881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:57.126881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:57.126881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:57.126881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:57.129093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:57.129093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:57.129093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:57.129093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:57.129093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:57.129093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:57.129093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:57.129093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:57.129093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:57.129093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:57.129093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:57.129093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:57.129093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:57.129093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:57.129093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:57.129093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:57.129854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:57.129854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:57.129854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:57.129854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:57.129854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:57.129854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:57.129854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:57.129854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:57.129854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:57.129854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:57.129854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:34:57.129854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:57.129854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 247/487] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 1 13:34:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:34:57.136452 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1f113-833b-4337-ac19-8f737a01d0a5 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:57.226578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d540c-21ad-46ab-863b-e372c840e1a2 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:57.267237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1f113-833b-4337-ac19-8f737a01d0a5 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:57.303720 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:57.336907 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa91a6-d342-4855-adff-d1a8e1e9cdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:57.337496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa91a6-d342-4855-adff-d1a8e1e9cdd2 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:57.337779 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa91a6-d342-4855-adff-d1a8e1e9cdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:57.338050 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa91a6-d342-4855-adff-d1a8e1e9cdd2 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:57.338244 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:57.339008 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa91a6-d342-4855-adff-d1a8e1e9cdd2 None admin] RBAC: Adding query filter params (name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:57.339008 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa91a6-d342-4855-adff-d1a8e1e9cdd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:57.340419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa91a6-d342-4855-adff-d1a8e1e9cdd2 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:57.350867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 241/488] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 1 13:34:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:57.358279 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa91a6-d342-4855-adff-d1a8e1e9cdd2 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:57.421288 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d540c-21ad-46ab-863b-e372c840e1a2 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:57.459831 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fc99a-41d5-4763-9297-3046b6084af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:57.460822 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fc99a-41d5-4763-9297-3046b6084af3 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:57.461297 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fc99a-41d5-4763-9297-3046b6084af3 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:57.461749 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fc99a-41d5-4763-9297-3046b6084af3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:57.474036 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6fc99a-41d5-4763-9297-3046b6084af3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:57.479326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-9c6fc99a-41d5-4763-9297-3046b6084af3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:34:57.479326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:57.479326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:57.479326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:57.479326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:57.479326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:57.479326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:57.479326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:57.479326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:57.479326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:57.479326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:57.479326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:57.479326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:57.479326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:57.479326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:57.479326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:57.480211 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:57.480211 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:57.480211 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:57.480211 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:57.480211 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:57.480211 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:57.480211 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:57.480211 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:57.480211 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:57.480211 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:57.480211 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:57.480211 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:57.480211 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:57.480211 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:57.480211 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:57.480211 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:57.480991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:57.480991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:57.480991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:57.480991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:57.480991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:57.480991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:57.480991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:57.480991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:57.480991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:57.480991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:57.480991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:34:57.480991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:57.483822 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 248/489] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 1 13:34:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:57.484013 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa91a6-d342-4855-adff-d1a8e1e9cdd2 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:57.485087 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fc99a-41d5-4763-9297-3046b6084af3 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:57.534775 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff695e4-c92e-4c15-b8b2-81912f53e670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:57.535430 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff695e4-c92e-4c15-b8b2-81912f53e670 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:57.536013 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff695e4-c92e-4c15-b8b2-81912f53e670 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:57.536304 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff695e4-c92e-4c15-b8b2-81912f53e670 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:57.552165 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff695e4-c92e-4c15-b8b2-81912f53e670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:57.554472 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff695e4-c92e-4c15-b8b2-81912f53e670 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:57.574518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-dff695e4-c92e-4c15-b8b2-81912f53e670 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:34:57.574518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:57.574518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:57.574518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:57.574518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:57.574518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:57.574518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:57.574518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:57.574518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:57.574518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:57.574518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:57.574518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:57.574518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:34:57.574518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:34:57.574518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:34:57.574518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:34:57.575503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:57.575503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:57.575503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:57.575503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:57.575503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:57.575503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:57.575503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:57.575503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:57.575503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:57.575503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:57.575503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:57.575503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:57.575503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:57.575503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:57.575503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:57.575503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:57.575503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:34:57.576329 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:34:57.576329 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:34:57.576329 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:57.577158 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 242/490] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:34:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:57.579335 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff695e4-c92e-4c15-b8b2-81912f53e670 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:57.600260 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fc99a-41d5-4763-9297-3046b6084af3 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:57.610282 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:57.619982 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:57.636933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e2ec8-4081-4a0d-a6ab-c692ddd64df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:57.637485 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e2ec8-4081-4a0d-a6ab-c692ddd64df5 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:57.637769 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e2ec8-4081-4a0d-a6ab-c692ddd64df5 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:57.638043 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e2ec8-4081-4a0d-a6ab-c692ddd64df5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:57.650558 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e2ec8-4081-4a0d-a6ab-c692ddd64df5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:57.655709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-be9e2ec8-4081-4a0d-a6ab-c692ddd64df5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:34:57.655709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:57.655709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:57.655709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:57.655709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:57.655709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:57.655709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:57.655709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:57.655709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:57.655709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:57.655709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:57.655709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:57.655709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:57.655709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:57.655709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:57.655709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:57.656747 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:57.656747 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:57.656747 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:57.656747 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:57.656747 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:57.656747 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:57.656747 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:57.656747 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:57.656747 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:57.656747 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:57.656747 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:57.656747 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:57.656747 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:57.656747 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:57.656747 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:57.656747 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:57.657508 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:57.657508 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:57.657508 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:57.657508 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:57.657508 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:57.657508 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:57.657508 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:57.657508 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:57.657508 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:57.657508 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:57.657508 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:34:57.657508 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:57.657508 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 249/491] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 1 13:34:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:57.658154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e2ec8-4081-4a0d-a6ab-c692ddd64df5 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:57.701933 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff695e4-c92e-4c15-b8b2-81912f53e670 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:57.740952 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb7ca1-751c-4ace-8769-fc224d1054ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:57.741892 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb7ca1-751c-4ace-8769-fc224d1054ab None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:57.742312 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb7ca1-751c-4ace-8769-fc224d1054ab None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:57.742753 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb7ca1-751c-4ace-8769-fc224d1054ab None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:57.743624 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb7ca1-751c-4ace-8769-fc224d1054ab None admin] RBAC: Adding query filter params (name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:57.744066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb7ca1-751c-4ace-8769-fc224d1054ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:57.745668 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb7ca1-751c-4ace-8769-fc224d1054ab None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:57.755066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 243/492] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 1 13:34:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:57.756115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb7ca1-751c-4ace-8769-fc224d1054ab None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:57.779209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e2ec8-4081-4a0d-a6ab-c692ddd64df5 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:57.816099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ce8bc-36a1-475a-8e1e-647d5fb71791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:57.816920 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ce8bc-36a1-475a-8e1e-647d5fb71791 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:57.817357 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ce8bc-36a1-475a-8e1e-647d5fb71791 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:57.817764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ce8bc-36a1-475a-8e1e-647d5fb71791 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:57.818583 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ce8bc-36a1-475a-8e1e-647d5fb71791 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:57.818992 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ce8bc-36a1-475a-8e1e-647d5fb71791 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:57.820565 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ce8bc-36a1-475a-8e1e-647d5fb71791 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:57.845368 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 250/493] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:57.850772 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ce8bc-36a1-475a-8e1e-647d5fb71791 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:57.864139 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:57.870856 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb7ca1-751c-4ace-8769-fc224d1054ab None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:57.881858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:57.908610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8ba69-7d12-4b41-8c82-58ce5a23f8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:57.909460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8ba69-7d12-4b41-8c82-58ce5a23f8f3 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:57.909907 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8ba69-7d12-4b41-8c82-58ce5a23f8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:57.910349 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8ba69-7d12-4b41-8c82-58ce5a23f8f3 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:57.911154 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8ba69-7d12-4b41-8c82-58ce5a23f8f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:57.911627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8ba69-7d12-4b41-8c82-58ce5a23f8f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:57.913199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8ba69-7d12-4b41-8c82-58ce5a23f8f3 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:57.922290 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 244/494] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 1 13:34:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:57.927759 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8ba69-7d12-4b41-8c82-58ce5a23f8f3 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:57.970015 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ce8bc-36a1-475a-8e1e-647d5fb71791 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:58.005269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cd8aa-7a81-4ab3-b1df-56fc69889613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:58.005909 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cd8aa-7a81-4ab3-b1df-56fc69889613 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:58.006190 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cd8aa-7a81-4ab3-b1df-56fc69889613 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:58.006471 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cd8aa-7a81-4ab3-b1df-56fc69889613 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:58.017198 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1cd8aa-7a81-4ab3-b1df-56fc69889613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:58.018707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1cd8aa-7a81-4ab3-b1df-56fc69889613 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:58.034358 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-2e1cd8aa-7a81-4ab3-b1df-56fc69889613 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:34:58.034358 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:58.034358 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:58.034358 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:58.034358 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:58.034358 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:58.034358 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:58.034358 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:58.034358 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:58.034358 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:58.034358 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:58.034358 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:58.034358 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:34:58.034358 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:34:58.034358 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:34:58.034358 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:34:58.035548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:58.035548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:58.035548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:58.035548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:58.035548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:58.035548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:58.035548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:58.035548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:58.035548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:58.035548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:58.035548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:58.035548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:58.035548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:58.035548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:58.035548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:58.035548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:58.035548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:34:58.036704 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:34:58.036704 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:34:58.036704 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:58.036917 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8ba69-7d12-4b41-8c82-58ce5a23f8f3 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:58.036997 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 251/495] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:34:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:58.036997 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cd8aa-7a81-4ab3-b1df-56fc69889613 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:58.073353 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb5f85-47d1-4f9d-a535-d362ad0a493e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:58.073994 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb5f85-47d1-4f9d-a535-d362ad0a493e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:58.074274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb5f85-47d1-4f9d-a535-d362ad0a493e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:58.074542 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb5f85-47d1-4f9d-a535-d362ad0a493e None admin] PATH_INFO: `/v3/users/nova` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:58.082904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb5f85-47d1-4f9d-a535-d362ad0a493e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:58.084401 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb5f85-47d1-4f9d-a535-d362ad0a493e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:58.098199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-47cb5f85-47d1-4f9d-a535-d362ad0a493e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:34:58.098199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:58.098199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:58.098199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:58.098199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:58.098199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:58.098199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:58.098199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:58.098199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:58.098199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:58.098199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:58.098199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:58.098199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:34:58.098199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:34:58.098199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:34:58.098199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:34:58.099314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:58.099314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:58.099314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:34:58.099314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:34:58.099314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:34:58.099314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:34:58.099314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:58.099314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:58.099314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:58.099314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:58.099314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:58.099314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:58.099314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:58.099314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:58.099314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:58.099314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:58.099314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:58.099314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:58.100257 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:58.100257 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:58.100257 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:34:58.100257 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:34:58.100257 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:34:58.100257 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:34:58.100257 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:34:58.100257 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:34:58.100257 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:34:58.100257 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:58.100257 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 245/496] 10.222.0.50 () {56 vars in 1093 bytes} [Thu Sep 1 13:34:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:58.100846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d305e-4cf4-4c32-816d-78bdec55c0fe None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:58.101001 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d305e-4cf4-4c32-816d-78bdec55c0fe None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:58.101278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d305e-4cf4-4c32-816d-78bdec55c0fe None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:58.102538 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 246/497] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:58.103718 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b0cd5-b4aa-4ad8-bfc3-24d66a25dcf8 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:58.104070 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b0cd5-b4aa-4ad8-bfc3-24d66a25dcf8 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:58.104230 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b0cd5-b4aa-4ad8-bfc3-24d66a25dcf8 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:58.105424 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 247/498] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:34:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:34:58.106125 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b0cd5-b4aa-4ad8-bfc3-24d66a25dcf8 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:58.128412 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:58.129756 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:58.147701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cd8aa-7a81-4ab3-b1df-56fc69889613 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:58.182206 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fccba-c668-4278-bc04-675ea63428d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:58.182951 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fccba-c668-4278-bc04-675ea63428d3 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:58.183310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fccba-c668-4278-bc04-675ea63428d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:58.183618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fccba-c668-4278-bc04-675ea63428d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:58.194185 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559fccba-c668-4278-bc04-675ea63428d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:58.195664 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559fccba-c668-4278-bc04-675ea63428d3 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:58.210947 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-559fccba-c668-4278-bc04-675ea63428d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:34:58.210947 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:58.210947 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:58.210947 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:58.210947 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:58.210947 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:58.210947 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:58.210947 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:58.210947 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:58.210947 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:58.210947 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:58.210947 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:58.210947 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:34:58.210947 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:34:58.210947 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:34:58.210947 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:34:58.212606 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:58.212606 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:58.212606 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:58.212606 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:58.212606 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:58.212606 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:58.212606 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:58.212606 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:58.212606 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:58.212606 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:58.212606 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:58.212606 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:58.212606 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:58.212606 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:58.212606 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:58.212606 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:58.212606 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:34:58.213496 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:34:58.213496 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:34:58.213496 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:34:58.213496 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 252/499] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:34:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:58.213752 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fccba-c668-4278-bc04-675ea63428d3 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:58.216623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b0cd5-b4aa-4ad8-bfc3-24d66a25dcf8 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:58.255788 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ce1dd-bf63-4537-9292-30e7427adbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:58.256404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ce1dd-bf63-4537-9292-30e7427adbda None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:58.256676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ce1dd-bf63-4537-9292-30e7427adbda None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:58.256974 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ce1dd-bf63-4537-9292-30e7427adbda None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:58.257619 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ce1dd-bf63-4537-9292-30e7427adbda None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:58.257916 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ce1dd-bf63-4537-9292-30e7427adbda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:58.259387 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ce1dd-bf63-4537-9292-30e7427adbda None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:58.273214 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 248/500] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:58.274446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c65ee-0369-4f3c-a1b9-fcf69d662a9e None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:58.275253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c65ee-0369-4f3c-a1b9-fcf69d662a9e None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:58.275548 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c65ee-0369-4f3c-a1b9-fcf69d662a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:58.293569 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-888c65ee-0369-4f3c-a1b9-fcf69d662a9e None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:58.294779 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-888c65ee-0369-4f3c-a1b9-fcf69d662a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:58.324355 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fccba-c668-4278-bc04-675ea63428d3 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:58.355554 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:58.360752 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e34d5-32f9-4ea7-bff2-5666eed24ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:58.361362 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e34d5-32f9-4ea7-bff2-5666eed24ec3 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:58.361651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e34d5-32f9-4ea7-bff2-5666eed24ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:58.361929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e34d5-32f9-4ea7-bff2-5666eed24ec3 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:58.362390 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 249/501] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:58.362835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e34d5-32f9-4ea7-bff2-5666eed24ec3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:58.362964 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e34d5-32f9-4ea7-bff2-5666eed24ec3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:58.363500 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cde71-e7dd-4076-9a27-f1c59af39e65 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:58.363787 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cde71-e7dd-4076-9a27-f1c59af39e65 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:58.364058 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cde71-e7dd-4076-9a27-f1c59af39e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:58.364453 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e34d5-32f9-4ea7-bff2-5666eed24ec3 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:58.388232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-e76cde71-e7dd-4076-9a27-f1c59af39e65 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:34:58.389482 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-e76cde71-e7dd-4076-9a27-f1c59af39e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:34:58.391548 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:58.409481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 253/502] 10.222.0.50 () {56 vars in 1133 bytes} [Thu Sep 1 13:34:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:58.409481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e34d5-32f9-4ea7-bff2-5666eed24ec3 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:58.465577 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 250/503] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:34:58.466600 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cde71-e7dd-4076-9a27-f1c59af39e65 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:58.541108 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e34d5-32f9-4ea7-bff2-5666eed24ec3 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:58.580706 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cde71-e7dd-4076-9a27-f1c59af39e65 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:58.585485 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6291ea-f4d7-4e01-a053-c76fc82fd2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:58.586289 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6291ea-f4d7-4e01-a053-c76fc82fd2da None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:58.586708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6291ea-f4d7-4e01-a053-c76fc82fd2da None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:58.587174 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6291ea-f4d7-4e01-a053-c76fc82fd2da None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:58.588485 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6291ea-f4d7-4e01-a053-c76fc82fd2da None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:58.588923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6291ea-f4d7-4e01-a053-c76fc82fd2da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:58.590965 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6291ea-f4d7-4e01-a053-c76fc82fd2da None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:58.611005 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 254/504] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:58.611005 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6291ea-f4d7-4e01-a053-c76fc82fd2da None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:58.625272 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092b3ee-5913-4cda-b813-0db08f773875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:58.626046 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092b3ee-5913-4cda-b813-0db08f773875 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:58.626434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092b3ee-5913-4cda-b813-0db08f773875 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:58.626808 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092b3ee-5913-4cda-b813-0db08f773875 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:58.635182 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092b3ee-5913-4cda-b813-0db08f773875 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:58.636660 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092b3ee-5913-4cda-b813-0db08f773875 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:58.638556 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:58.650563 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-f092b3ee-5913-4cda-b813-0db08f773875 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 13:34:58.650563 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:58.650563 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:58.650563 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:58.650563 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:58.650563 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:58.650563 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:58.650563 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:58.650563 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:58.650563 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:58.650563 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:58.650563 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:58.650563 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:34:58.650563 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:34:58.650563 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:34:58.650563 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:34:58.658858 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:58.658858 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:58.658858 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:34:58.658858 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:34:58.658858 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:34:58.658858 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:34:58.658858 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:58.658858 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:58.658858 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:58.658858 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:58.658858 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:58.658858 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:58.658858 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:58.658858 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:58.658858 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:58.658858 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:58.658858 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:58.658858 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:58.659976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:58.659976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:58.659976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:34:58.659976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:34:58.659976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:34:58.659976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:34:58.659976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:34:58.659976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:34:58.659976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 13:34:58.659976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:58.659976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 251/505] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:58.659976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092b3ee-5913-4cda-b813-0db08f773875 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:58.673137 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:58.726470 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6291ea-f4d7-4e01-a053-c76fc82fd2da None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:58.758036 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092b3ee-5913-4cda-b813-0db08f773875 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:58.760488 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c01a1-d1e6-48bd-8c63-92a06e641d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:58.761093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c01a1-d1e6-48bd-8c63-92a06e641d22 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:58.761371 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c01a1-d1e6-48bd-8c63-92a06e641d22 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:58.761644 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c01a1-d1e6-48bd-8c63-92a06e641d22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:58.792109 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99317191-66a3-4795-9d0a-14f895f088e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:58.792722 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99317191-66a3-4795-9d0a-14f895f088e9 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:58.792999 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99317191-66a3-4795-9d0a-14f895f088e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:58.793267 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99317191-66a3-4795-9d0a-14f895f088e9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:58.800607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99317191-66a3-4795-9d0a-14f895f088e9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:58.802039 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99317191-66a3-4795-9d0a-14f895f088e9 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:58.812845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-99317191-66a3-4795-9d0a-14f895f088e9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 13:34:58.812845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:58.812845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:58.812845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:58.812845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:58.812845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:58.812845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:58.812845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:58.812845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:58.812845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:58.812845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:58.812845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:58.812845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:34:58.812845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:34:58.812845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:34:58.812845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:34:58.813896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:58.813896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:58.813896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:34:58.813896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:34:58.813896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:34:58.813896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:34:58.813896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:58.813896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:58.813896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:58.813896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:58.813896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:58.813896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:58.813896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:58.813896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:58.813896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:58.813896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:58.813896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:58.813896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:58.814781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:58.814781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:58.814781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:34:58.814781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:34:58.814781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:34:58.814781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:34:58.814781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:34:58.814781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:34:58.814781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 13:34:58.814781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:58.814781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 252/506] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:34:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:58.814781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99317191-66a3-4795-9d0a-14f895f088e9 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:58.833037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c01a1-d1e6-48bd-8c63-92a06e641d22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:58.834544 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c01a1-d1e6-48bd-8c63-92a06e641d22 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:58.874378 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:58.883668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:58.916245 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99317191-66a3-4795-9d0a-14f895f088e9 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:58.933771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 255/507] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:58.934622 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c01a1-d1e6-48bd-8c63-92a06e641d22 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:58.950228 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac87e8-c99f-4db0-b50b-16c14854e880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:58.950853 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac87e8-c99f-4db0-b50b-16c14854e880 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:58.951132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac87e8-c99f-4db0-b50b-16c14854e880 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:58.951427 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac87e8-c99f-4db0-b50b-16c14854e880 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:58.961969 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac87e8-c99f-4db0-b50b-16c14854e880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:34:58.967593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-39ac87e8-c99f-4db0-b50b-16c14854e880 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:34:58.967593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:58.967593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:58.967593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:58.967593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:58.967593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:58.967593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:58.967593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:58.967593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:58.967593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:58.967593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:58.967593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:58.967593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:34:58.967593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:34:58.967593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:34:58.967593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:34:58.968453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:34:58.968453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:34:58.968453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:34:58.968453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:34:58.968453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:58.968453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:58.968453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:58.968453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:58.968453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:58.968453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:58.968453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:58.968453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:58.968453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:58.968453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:58.968453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:58.968453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:58.969250 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:58.969250 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:58.969250 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:58.969250 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:58.969250 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:34:58.969250 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:34:58.969250 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:34:58.969250 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:34:58.969250 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:34:58.969250 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:34:58.969250 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:34:58.969250 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:58.969250 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 253/508] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 1 13:34:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:58.969873 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac87e8-c99f-4db0-b50b-16c14854e880 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:59.040985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c01a1-d1e6-48bd-8c63-92a06e641d22 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:59.069052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac87e8-c99f-4db0-b50b-16c14854e880 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:59.074830 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7117ea-6b51-4681-9942-1b92f9bb990f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:59.075455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7117ea-6b51-4681-9942-1b92f9bb990f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:59.075743 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7117ea-6b51-4681-9942-1b92f9bb990f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:59.076012 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7117ea-6b51-4681-9942-1b92f9bb990f None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:59.076757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7117ea-6b51-4681-9942-1b92f9bb990f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:59.077063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7117ea-6b51-4681-9942-1b92f9bb990f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:59.078531 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7117ea-6b51-4681-9942-1b92f9bb990f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:59.086956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:59.096842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 256/509] 10.222.0.50 () {56 vars in 1137 bytes} [Thu Sep 1 13:34:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:59.097676 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7117ea-6b51-4681-9942-1b92f9bb990f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:59.104744 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08cf5ff-6434-43c9-b2dc-c97aaf084648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:59.105402 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cf5ff-6434-43c9-b2dc-c97aaf084648 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:59.105679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cf5ff-6434-43c9-b2dc-c97aaf084648 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:59.105955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cf5ff-6434-43c9-b2dc-c97aaf084648 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:59.108716 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:59.117490 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08cf5ff-6434-43c9-b2dc-c97aaf084648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:59.119602 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08cf5ff-6434-43c9-b2dc-c97aaf084648 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:59.133830 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-d08cf5ff-6434-43c9-b2dc-c97aaf084648 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:34:59.133830 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:59.133830 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:59.133830 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:59.133830 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:59.133830 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:59.133830 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:59.133830 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:59.133830 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:59.133830 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:59.133830 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:59.133830 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:59.133830 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:34:59.133830 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:34:59.133830 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:34:59.133830 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:34:59.135340 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:59.135340 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:59.135340 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:59.135340 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:59.135340 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:59.135340 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:59.135340 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:59.135340 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:59.135340 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:59.135340 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:59.135340 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:59.135340 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:59.135340 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:59.135340 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:59.135340 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:59.135340 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:59.135340 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:34:59.136214 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:34:59.136214 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:34:59.136214 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:59.136214 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 254/510] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:34:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:59.136427 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08cf5ff-6434-43c9-b2dc-c97aaf084648 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:59.200606 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7117ea-6b51-4681-9942-1b92f9bb990f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:59.235412 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17323bb1-9f8e-4996-8f53-96866cde42a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:59.235629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08cf5ff-6434-43c9-b2dc-c97aaf084648 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:59.236016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17323bb1-9f8e-4996-8f53-96866cde42a7 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:59.236298 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17323bb1-9f8e-4996-8f53-96866cde42a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:59.236571 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17323bb1-9f8e-4996-8f53-96866cde42a7 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:59.237302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17323bb1-9f8e-4996-8f53-96866cde42a7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:59.237615 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17323bb1-9f8e-4996-8f53-96866cde42a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:59.239116 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17323bb1-9f8e-4996-8f53-96866cde42a7 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:59.256633 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 257/511] 10.222.0.50 () {56 vars in 1137 bytes} [Thu Sep 1 13:34:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:59.257449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17323bb1-9f8e-4996-8f53-96866cde42a7 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:59.270271 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588dd60-e5aa-4ede-a167-638d68437887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:59.270896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588dd60-e5aa-4ede-a167-638d68437887 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:59.271174 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588dd60-e5aa-4ede-a167-638d68437887 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:59.271476 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588dd60-e5aa-4ede-a167-638d68437887 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:59.282671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d588dd60-e5aa-4ede-a167-638d68437887 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:59.284151 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d588dd60-e5aa-4ede-a167-638d68437887 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:59.298574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-d588dd60-e5aa-4ede-a167-638d68437887 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:34:59.298574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:59.298574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:59.298574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:59.298574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:59.298574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:59.298574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:59.298574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:59.298574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:59.298574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:59.298574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:59.298574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:59.298574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:34:59.298574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:34:59.298574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:34:59.298574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:34:59.299507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:59.299507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:59.299507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:59.299507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:59.299507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:59.299507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:59.299507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:59.299507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:59.299507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:59.299507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:59.299507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:59.299507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:59.299507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:59.299507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:59.299507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:59.299507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:59.299507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:34:59.300334 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:34:59.300334 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:34:59.300334 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:59.300334 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 255/512] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:34:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:59.300857 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588dd60-e5aa-4ede-a167-638d68437887 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:59.325317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:59.332131 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:59.365842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17323bb1-9f8e-4996-8f53-96866cde42a7 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:59.399289 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588dd60-e5aa-4ede-a167-638d68437887 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:59.399899 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa9a91-2132-47a1-b294-d1dc88fe92ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:59.400505 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa9a91-2132-47a1-b294-d1dc88fe92ef None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:59.400785 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa9a91-2132-47a1-b294-d1dc88fe92ef None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:59.401055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa9a91-2132-47a1-b294-d1dc88fe92ef None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:59.401718 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa9a91-2132-47a1-b294-d1dc88fe92ef None admin] RBAC: Adding query filter params (name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:59.402020 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa9a91-2132-47a1-b294-d1dc88fe92ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:59.403409 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa9a91-2132-47a1-b294-d1dc88fe92ef None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:59.411336 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 258/513] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 1 13:34:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:59.412162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa9a91-2132-47a1-b294-d1dc88fe92ef None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:59.434089 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85cce6-41a4-48d5-8232-5c24b2522b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:59.434670 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85cce6-41a4-48d5-8232-5c24b2522b41 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:59.434941 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85cce6-41a4-48d5-8232-5c24b2522b41 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:59.435214 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85cce6-41a4-48d5-8232-5c24b2522b41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:59.502486 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85cce6-41a4-48d5-8232-5c24b2522b41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:59.503978 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85cce6-41a4-48d5-8232-5c24b2522b41 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:59.514012 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa9a91-2132-47a1-b294-d1dc88fe92ef None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:59.526480 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:59.541440 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:59.549878 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7b184-90a1-428b-805a-056eb47d8433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:59.550214 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7b184-90a1-428b-805a-056eb47d8433 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:59.550494 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7b184-90a1-428b-805a-056eb47d8433 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:59.550767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7b184-90a1-428b-805a-056eb47d8433 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:59.551423 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7b184-90a1-428b-805a-056eb47d8433 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:59.551728 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7b184-90a1-428b-805a-056eb47d8433 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:59.553116 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7b184-90a1-428b-805a-056eb47d8433 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:59.565495 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 259/514] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:59.566120 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7b184-90a1-428b-805a-056eb47d8433 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:59.607078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 256/515] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:59.608207 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85cce6-41a4-48d5-8232-5c24b2522b41 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:59.668754 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7b184-90a1-428b-805a-056eb47d8433 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:59.702917 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085fa09-15a8-42df-9436-0365f6c56174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:59.703551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085fa09-15a8-42df-9436-0365f6c56174 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:59.703837 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085fa09-15a8-42df-9436-0365f6c56174 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:59.704105 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085fa09-15a8-42df-9436-0365f6c56174 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:59.706584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85cce6-41a4-48d5-8232-5c24b2522b41 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:59.729440 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:59.741721 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631deca-424e-42bd-a647-4f54aff7aaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:59.742314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631deca-424e-42bd-a647-4f54aff7aaec None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:59.742589 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631deca-424e-42bd-a647-4f54aff7aaec None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:59.742891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631deca-424e-42bd-a647-4f54aff7aaec None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:59.745082 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631deca-424e-42bd-a647-4f54aff7aaec None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:34:59.745082 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631deca-424e-42bd-a647-4f54aff7aaec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:59.745379 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631deca-424e-42bd-a647-4f54aff7aaec None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:59.756961 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 257/516] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:34:59.757867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631deca-424e-42bd-a647-4f54aff7aaec None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:59.760547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:59.773161 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085fa09-15a8-42df-9436-0365f6c56174 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:59.775220 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085fa09-15a8-42df-9436-0365f6c56174 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:59.856587 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631deca-424e-42bd-a647-4f54aff7aaec None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:34:59.878229 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 260/517] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:34:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:34:59.879636 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085fa09-15a8-42df-9436-0365f6c56174 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:59.890245 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5c414-fdcb-40c9-b0a7-97fba20ebb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:34:59.890873 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5c414-fdcb-40c9-b0a7-97fba20ebb60 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:34:59.891155 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5c414-fdcb-40c9-b0a7-97fba20ebb60 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:34:59.891460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5c414-fdcb-40c9-b0a7-97fba20ebb60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:34:59.901868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5c414-fdcb-40c9-b0a7-97fba20ebb60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:34:59.903339 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5c414-fdcb-40c9-b0a7-97fba20ebb60 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:34:59.918956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-5aa5c414-fdcb-40c9-b0a7-97fba20ebb60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:34:59.918956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:34:59.918956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:34:59.918956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:34:59.918956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:34:59.918956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:34:59.918956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:34:59.918956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:34:59.918956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:34:59.918956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:34:59.918956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:34:59.918956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:34:59.918956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:34:59.918956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:34:59.918956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:34:59.918956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:34:59.920045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:34:59.920045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:34:59.920045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:34:59.920045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:34:59.920045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:34:59.920045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:34:59.920045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:34:59.920045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:34:59.920045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:34:59.920045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:34:59.920045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:34:59.920045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:34:59.920045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:34:59.920045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:34:59.920045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:34:59.920045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:34:59.920045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:34:59.921407 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:34:59.921407 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:34:59.921407 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:34:59.921407 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 258/518] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:34:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:34:59.921407 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5c414-fdcb-40c9-b0a7-97fba20ebb60 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:34:59.953344 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:59.970670 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:34:59.983313 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085fa09-15a8-42df-9436-0365f6c56174 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:00.017035 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d1732-8b86-4b16-83a7-57d576466f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:00.017666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d1732-8b86-4b16-83a7-57d576466f37 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:00.018205 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d1732-8b86-4b16-83a7-57d576466f37 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:00.018684 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5c414-fdcb-40c9-b0a7-97fba20ebb60 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:00.018786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d1732-8b86-4b16-83a7-57d576466f37 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:00.019390 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d1732-8b86-4b16-83a7-57d576466f37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:00.021218 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d1732-8b86-4b16-83a7-57d576466f37 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:00.052312 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc52bcf-db9c-407a-84b9-ff74158e4fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:00.052936 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc52bcf-db9c-407a-84b9-ff74158e4fa1 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:00.053215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc52bcf-db9c-407a-84b9-ff74158e4fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:00.053483 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc52bcf-db9c-407a-84b9-ff74158e4fa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:00.063303 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc52bcf-db9c-407a-84b9-ff74158e4fa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:00.064787 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc52bcf-db9c-407a-84b9-ff74158e4fa1 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:00.079478 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-cfc52bcf-db9c-407a-84b9-ff74158e4fa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:00.079478 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:00.079478 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:00.079478 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:00.079478 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:00.079478 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:00.079478 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:00.079478 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:00.079478 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:00.079478 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:00.079478 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:00.079478 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:00.079478 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:00.079478 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:00.079478 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:00.079478 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:00.080494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:00.080494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:00.080494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:00.080494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:00.080494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:00.080494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:00.080494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:00.080494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:00.080494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:00.080494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:00.080494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:00.080494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:00.080494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:00.080494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:00.080494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:00.080494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:00.080494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:00.081293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:00.081293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:00.081293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:00.081293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 259/519] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:34:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:00.081293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc52bcf-db9c-407a-84b9-ff74158e4fa1 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:00.096060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 261/520] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 1 13:34:59 2022] POST /identity/v3/users => generated 247 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:35:00.096978 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d1732-8b86-4b16-83a7-57d576466f37 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:00.177752 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:00.194205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc52bcf-db9c-407a-84b9-ff74158e4fa1 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:00.220477 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d1732-8b86-4b16-83a7-57d576466f37 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:00.232342 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbf371-758d-4ccd-b8b4-15bed9936771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:00.232973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbf371-758d-4ccd-b8b4-15bed9936771 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:00.233248 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbf371-758d-4ccd-b8b4-15bed9936771 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:00.233515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbf371-758d-4ccd-b8b4-15bed9936771 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:00.241558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cbf371-758d-4ccd-b8b4-15bed9936771 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:00.242372 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cbf371-758d-4ccd-b8b4-15bed9936771 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:00.254864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-b3cbf371-758d-4ccd-b8b4-15bed9936771 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:00.254864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:00.254864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:00.254864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:00.254864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:00.254864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:00.254864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:00.254864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:00.254864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:00.254864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:00.254864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:00.254864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:00.254864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:35:00.254864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:35:00.254864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:35:00.255799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:35:00.255799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:00.255799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:00.255799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:00.255799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:00.255799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:00.255799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:00.255799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:00.255799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:00.255799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:00.255799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:00.255799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:00.255799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:00.255799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:00.255799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:00.255799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:00.255799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:00.256741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:35:00.256741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:35:00.256741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:35:00.256741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:35:00.256741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:35:00.256741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:35:00.256741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:00.256741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:00.256741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 260/521] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:00.257239 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbf371-758d-4ccd-b8b4-15bed9936771 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:00.268303 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83616aa-0445-4a74-9490-00eace3a7578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:00.269293 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83616aa-0445-4a74-9490-00eace3a7578 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:00.269601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83616aa-0445-4a74-9490-00eace3a7578 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:00.269885 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83616aa-0445-4a74-9490-00eace3a7578 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:00.282481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83616aa-0445-4a74-9490-00eace3a7578 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:00.284001 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83616aa-0445-4a74-9490-00eace3a7578 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:00.288395 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:00.302964 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-f83616aa-0445-4a74-9490-00eace3a7578 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:00.302964 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:00.302964 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:00.302964 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:00.302964 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:00.302964 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:00.302964 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:00.302964 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:00.302964 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:00.302964 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:00.302964 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:00.302964 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:00.302964 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:00.302964 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:00.302964 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:00.302964 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:00.304119 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:00.304119 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:00.304119 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:00.304119 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:00.304119 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:00.304119 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:00.304119 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:00.304119 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:00.304119 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:00.304119 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:00.304119 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:00.304119 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:00.304119 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:00.304119 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:00.304119 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:00.304119 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:00.304119 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:00.305173 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:00.305173 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:00.305173 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:00.305173 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 262/522] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:00.305173 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83616aa-0445-4a74-9490-00eace3a7578 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:00.377144 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbf371-758d-4ccd-b8b4-15bed9936771 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:00.418399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d3703-51ab-4763-9a24-47a45b47fd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:00.419027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d3703-51ab-4763-9a24-47a45b47fd21 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:00.419263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d3703-51ab-4763-9a24-47a45b47fd21 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:00.419604 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d3703-51ab-4763-9a24-47a45b47fd21 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:00.420211 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d3703-51ab-4763-9a24-47a45b47fd21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:00.420642 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d3703-51ab-4763-9a24-47a45b47fd21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:00.421898 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d3703-51ab-4763-9a24-47a45b47fd21 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:00.426482 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83616aa-0445-4a74-9490-00eace3a7578 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:00.434433 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 261/523] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:00.435335 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d3703-51ab-4763-9a24-47a45b47fd21 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:00.447727 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:00.465519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeef526-2e1f-4871-adb5-bb1b53df6857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:00.466133 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeef526-2e1f-4871-adb5-bb1b53df6857 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:00.472050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeef526-2e1f-4871-adb5-bb1b53df6857 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:00.472050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeef526-2e1f-4871-adb5-bb1b53df6857 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:00.472050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeef526-2e1f-4871-adb5-bb1b53df6857 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:00.472050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeef526-2e1f-4871-adb5-bb1b53df6857 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:00.472050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeef526-2e1f-4871-adb5-bb1b53df6857 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:00.485529 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 263/524] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:00.486402 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeef526-2e1f-4871-adb5-bb1b53df6857 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:00.547533 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:00.552032 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d3703-51ab-4763-9a24-47a45b47fd21 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:00.588598 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca3d15-ce3a-4926-8067-3f7474a04fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:00.589206 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca3d15-ce3a-4926-8067-3f7474a04fd5 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:00.589486 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca3d15-ce3a-4926-8067-3f7474a04fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:00.589762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca3d15-ce3a-4926-8067-3f7474a04fd5 None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:00.590458 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca3d15-ce3a-4926-8067-3f7474a04fd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:00.590765 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca3d15-ce3a-4926-8067-3f7474a04fd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:00.592224 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca3d15-ce3a-4926-8067-3f7474a04fd5 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:00.596180 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeef526-2e1f-4871-adb5-bb1b53df6857 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:00.610846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 262/525] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:35:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:00.611817 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca3d15-ce3a-4926-8067-3f7474a04fd5 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:00.640280 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651a241-152f-47d0-8bd2-6c32686353f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:00.640989 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651a241-152f-47d0-8bd2-6c32686353f0 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:00.641192 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651a241-152f-47d0-8bd2-6c32686353f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:00.641429 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651a241-152f-47d0-8bd2-6c32686353f0 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:00.642120 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651a241-152f-47d0-8bd2-6c32686353f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:00.642390 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651a241-152f-47d0-8bd2-6c32686353f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:00.643781 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651a241-152f-47d0-8bd2-6c32686353f0 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:00.655466 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 264/526] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:00.656306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651a241-152f-47d0-8bd2-6c32686353f0 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:00.689457 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:00.724528 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca3d15-ce3a-4926-8067-3f7474a04fd5 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:00.758753 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fb05c-ef45-478b-98c6-99b4ed5d3542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:00.759975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fb05c-ef45-478b-98c6-99b4ed5d3542 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:00.760254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fb05c-ef45-478b-98c6-99b4ed5d3542 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:00.760531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fb05c-ef45-478b-98c6-99b4ed5d3542 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:00.764665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651a241-152f-47d0-8bd2-6c32686353f0 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:00.772150 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55fb05c-ef45-478b-98c6-99b4ed5d3542 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:00.773667 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55fb05c-ef45-478b-98c6-99b4ed5d3542 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:00.783898 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:00.785717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-a55fb05c-ef45-478b-98c6-99b4ed5d3542 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 13:35:00.785717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:00.785717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:00.785717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:00.785717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:00.785717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:00.785717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:00.785717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:00.785717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:00.785717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:00.785717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:00.785717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:00.785717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:35:00.785717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:35:00.785717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:35:00.785717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:35:00.786762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:00.786762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:00.786762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:35:00.786762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:00.786762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:35:00.786762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:00.786762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:00.786762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:00.786762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:00.786762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:00.786762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:00.786762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:00.786762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:00.786762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:00.786762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:00.786762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:00.786762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:00.786762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:00.787804 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:00.787804 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:00.787804 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:35:00.787804 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:35:00.787804 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:35:00.787804 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:35:00.787804 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:35:00.787804 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:35:00.787804 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 13:35:00.787804 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:00.787804 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 263/527] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 1 13:35:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:00.788346 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fb05c-ef45-478b-98c6-99b4ed5d3542 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:00.807648 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c60994-ad71-4f7b-b99e-ea76cc2853fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:00.808616 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c60994-ad71-4f7b-b99e-ea76cc2853fc None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:00.809031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c60994-ad71-4f7b-b99e-ea76cc2853fc None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:00.809538 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c60994-ad71-4f7b-b99e-ea76cc2853fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:00.816768 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c60994-ad71-4f7b-b99e-ea76cc2853fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:00.818662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c60994-ad71-4f7b-b99e-ea76cc2853fc None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:00.832469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-31c60994-ad71-4f7b-b99e-ea76cc2853fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:00.832469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:00.832469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:00.832469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:00.832469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:00.832469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:00.832469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:00.832469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:00.832469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:00.832469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:00.832469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:00.832469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:00.832469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:35:00.832469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:35:00.832469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:35:00.833465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:35:00.833465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:00.833465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:00.833465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:00.833465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:00.833465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:00.833465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:00.833465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:00.833465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:00.833465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:00.833465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:00.833465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:00.833465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:00.833465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:00.833465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:00.833465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:00.833465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:00.834378 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:35:00.834378 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:35:00.834378 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:35:00.834378 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:35:00.834378 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:35:00.834378 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:35:00.834378 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:00.834378 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:00.836384 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 265/528] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:00.837526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c60994-ad71-4f7b-b99e-ea76cc2853fc None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:00.896289 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fb05c-ef45-478b-98c6-99b4ed5d3542 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:00.921613 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:00.931273 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01413ec7-c4ff-4ed7-ba57-0e0a28a23289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:00.931919 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01413ec7-c4ff-4ed7-ba57-0e0a28a23289 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:00.932200 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01413ec7-c4ff-4ed7-ba57-0e0a28a23289 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:00.935405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01413ec7-c4ff-4ed7-ba57-0e0a28a23289 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:00.935405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01413ec7-c4ff-4ed7-ba57-0e0a28a23289 None admin] RBAC: Adding query filter params (role.id=f8c77ddd17fd4bc7af83e8d8905fb404, scope.project.id=6283121e17814cd792df9d0edf81bf2d, user.id=2d231136bcd44d9a97efe6c257f936ed) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:00.935405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01413ec7-c4ff-4ed7-ba57-0e0a28a23289 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:00.935405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01413ec7-c4ff-4ed7-ba57-0e0a28a23289 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:00.941099 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 264/529] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:35:00 2022] GET /identity/v3/role_assignments?user.id=2d231136bcd44d9a97efe6c257f936ed&scope.project.id=6283121e17814cd792df9d0edf81bf2d&role.id=f8c77ddd17fd4bc7af83e8d8905fb404 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:00.952218 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c60994-ad71-4f7b-b99e-ea76cc2853fc None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:00.952754 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01413ec7-c4ff-4ed7-ba57-0e0a28a23289 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:01.002489 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a19bd-9771-4d4d-bd4e-9fd0776676a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:01.003192 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a19bd-9771-4d4d-bd4e-9fd0776676a6 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:01.003559 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a19bd-9771-4d4d-bd4e-9fd0776676a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:01.003844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a19bd-9771-4d4d-bd4e-9fd0776676a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:01.017087 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a19bd-9771-4d4d-bd4e-9fd0776676a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:01.019834 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a19bd-9771-4d4d-bd4e-9fd0776676a6 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:01.036843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-e04a19bd-9771-4d4d-bd4e-9fd0776676a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:01.036843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:01.036843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:01.036843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:01.036843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:01.036843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:01.036843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:01.036843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:01.036843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:01.036843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:01.036843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:01.036843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:01.036843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:35:01.036843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:35:01.036843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:35:01.037760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:35:01.037760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:01.037760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:01.037760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:01.037760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:01.037760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:01.037760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:01.037760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:01.037760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:01.037760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:01.037760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:01.037760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:01.037760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:01.037760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:01.037760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:01.037760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:01.037760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:01.038594 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:35:01.038594 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:35:01.038594 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:35:01.038594 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:35:01.038594 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:35:01.038594 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:35:01.038594 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:01.038594 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:01.042017 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 266/530] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:01.043075 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a19bd-9771-4d4d-bd4e-9fd0776676a6 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:01.096454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:01.109954 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01413ec7-c4ff-4ed7-ba57-0e0a28a23289 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:01.153956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c778a6-bc76-4f4f-982b-13b9e9aca735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:01.154717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c778a6-bc76-4f4f-982b-13b9e9aca735 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:01.155056 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c778a6-bc76-4f4f-982b-13b9e9aca735 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:01.155383 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c778a6-bc76-4f4f-982b-13b9e9aca735 None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:01.156329 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c778a6-bc76-4f4f-982b-13b9e9aca735 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:01.156630 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c778a6-bc76-4f4f-982b-13b9e9aca735 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:01.158131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c778a6-bc76-4f4f-982b-13b9e9aca735 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:01.190561 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a19bd-9771-4d4d-bd4e-9fd0776676a6 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:01.205910 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 265/531] 10.222.0.50 () {56 vars in 1139 bytes} [Thu Sep 1 13:35:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:01.206876 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c778a6-bc76-4f4f-982b-13b9e9aca735 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:01.229771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063e07c-3b7e-482e-9b86-0820cb4c1a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:01.230384 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063e07c-3b7e-482e-9b86-0820cb4c1a33 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:01.230661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063e07c-3b7e-482e-9b86-0820cb4c1a33 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:01.230929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063e07c-3b7e-482e-9b86-0820cb4c1a33 None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:01.231650 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063e07c-3b7e-482e-9b86-0820cb4c1a33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:01.232207 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063e07c-3b7e-482e-9b86-0820cb4c1a33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:01.233665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063e07c-3b7e-482e-9b86-0820cb4c1a33 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:01.253826 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 267/532] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:35:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:01.254846 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063e07c-3b7e-482e-9b86-0820cb4c1a33 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:01.268105 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:01.324966 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c778a6-bc76-4f4f-982b-13b9e9aca735 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:01.355704 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:01.362728 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063e07c-3b7e-482e-9b86-0820cb4c1a33 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:01.362932 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5dd43-6a7f-4a47-9a2e-e5b3e4681ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:01.363761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5dd43-6a7f-4a47-9a2e-e5b3e4681ae8 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:01.364278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5dd43-6a7f-4a47-9a2e-e5b3e4681ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:01.364694 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5dd43-6a7f-4a47-9a2e-e5b3e4681ae8 None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:01.365536 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5dd43-6a7f-4a47-9a2e-e5b3e4681ae8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:01.365988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5dd43-6a7f-4a47-9a2e-e5b3e4681ae8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:01.367626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5dd43-6a7f-4a47-9a2e-e5b3e4681ae8 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:01.391224 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 266/533] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:35:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:01.392384 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5dd43-6a7f-4a47-9a2e-e5b3e4681ae8 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:01.397941 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5df255-e9eb-4a5c-a651-5080fb971cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:01.398550 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5df255-e9eb-4a5c-a651-5080fb971cb7 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:01.398829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5df255-e9eb-4a5c-a651-5080fb971cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:01.399102 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5df255-e9eb-4a5c-a651-5080fb971cb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:01.474703 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5df255-e9eb-4a5c-a651-5080fb971cb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:01.476144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5df255-e9eb-4a5c-a651-5080fb971cb7 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:01.519929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5dd43-6a7f-4a47-9a2e-e5b3e4681ae8 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:01.531864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:01.564155 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243bbf5-374c-4701-b89f-fcd90f094b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:01.564871 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243bbf5-374c-4701-b89f-fcd90f094b53 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:01.565333 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243bbf5-374c-4701-b89f-fcd90f094b53 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:01.565770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243bbf5-374c-4701-b89f-fcd90f094b53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:01.566620 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243bbf5-374c-4701-b89f-fcd90f094b53 None admin] RBAC: Adding query filter params (role.id=f8c77ddd17fd4bc7af83e8d8905fb404, scope.project.id=6283121e17814cd792df9d0edf81bf2d, user.id=1dc5b80f0e4c48189389d23507a9d2ec) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:01.567072 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243bbf5-374c-4701-b89f-fcd90f094b53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:01.568983 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243bbf5-374c-4701-b89f-fcd90f094b53 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:01.582975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 267/534] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:35:01 2022] GET /identity/v3/role_assignments?user.id=1dc5b80f0e4c48189389d23507a9d2ec&scope.project.id=6283121e17814cd792df9d0edf81bf2d&role.id=f8c77ddd17fd4bc7af83e8d8905fb404 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:01.583566 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:01.585364 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243bbf5-374c-4701-b89f-fcd90f094b53 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:01.593929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 268/535] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:35:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:35:01.604507 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5df255-e9eb-4a5c-a651-5080fb971cb7 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:01.724228 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243bbf5-374c-4701-b89f-fcd90f094b53 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:01.791270 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5df255-e9eb-4a5c-a651-5080fb971cb7 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:01.808300 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b79be6-8209-41c6-8491-9cc37d301a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:01.808918 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b79be6-8209-41c6-8491-9cc37d301a28 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:01.809193 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b79be6-8209-41c6-8491-9cc37d301a28 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:01.809459 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b79be6-8209-41c6-8491-9cc37d301a28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:01.810198 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b79be6-8209-41c6-8491-9cc37d301a28 None admin] RBAC: Adding query filter params (role.id=f8c77ddd17fd4bc7af83e8d8905fb404, scope.project.id=6283121e17814cd792df9d0edf81bf2d, user.id=fc11fe25135d4bf1b1a06b8619e4a2e0) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:01.810500 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b79be6-8209-41c6-8491-9cc37d301a28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:01.811981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b79be6-8209-41c6-8491-9cc37d301a28 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:01.819872 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 268/536] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:35:01 2022] GET /identity/v3/role_assignments?user.id=fc11fe25135d4bf1b1a06b8619e4a2e0&scope.project.id=6283121e17814cd792df9d0edf81bf2d&role.id=f8c77ddd17fd4bc7af83e8d8905fb404 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:01.856370 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c996e6-2b0b-41d6-8572-d377986d2dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:01.857272 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c996e6-2b0b-41d6-8572-d377986d2dec None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:01.857551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c996e6-2b0b-41d6-8572-d377986d2dec None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:01.857828 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c996e6-2b0b-41d6-8572-d377986d2dec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:01.874944 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c996e6-2b0b-41d6-8572-d377986d2dec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:01.876500 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c996e6-2b0b-41d6-8572-d377986d2dec None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:01.893742 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-b1c996e6-2b0b-41d6-8572-d377986d2dec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:01.893742 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:01.893742 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:01.893742 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:01.893742 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:01.893742 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:01.893742 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:01.893742 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:01.893742 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:01.893742 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:01.893742 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:01.893742 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:01.893742 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:01.893742 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:01.893742 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:01.893742 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:01.894674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:01.894674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:01.894674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:01.894674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:01.894674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:01.894674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:01.894674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:01.894674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:01.894674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:01.894674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:01.894674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:01.894674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:01.894674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:01.894674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:01.894674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:01.894674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:01.894674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:01.895551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:01.895551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:01.895551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:01.895551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 269/537] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:01.901434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b79be6-8209-41c6-8491-9cc37d301a28 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:01.939236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:02.024270 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b79be6-8209-41c6-8491-9cc37d301a28 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:02.077679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c3629-0ad9-4a04-8ffa-efcc6b0d9740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:02.078211 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c3629-0ad9-4a04-8ffa-efcc6b0d9740 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:02.078581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c3629-0ad9-4a04-8ffa-efcc6b0d9740 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:02.078856 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c3629-0ad9-4a04-8ffa-efcc6b0d9740 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:02.079531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c3629-0ad9-4a04-8ffa-efcc6b0d9740 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:02.079832 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c3629-0ad9-4a04-8ffa-efcc6b0d9740 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:02.081219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c3629-0ad9-4a04-8ffa-efcc6b0d9740 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:02.095031 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 269/538] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:02.100721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c996e6-2b0b-41d6-8572-d377986d2dec None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:02.144326 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a38a0-9e73-4aeb-b78b-fe18c6500ab2 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:02.145559 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a38a0-9e73-4aeb-b78b-fe18c6500ab2 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:02.145838 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a38a0-9e73-4aeb-b78b-fe18c6500ab2 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:02.147614 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 270/539] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:02.155971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76749487-09b0-45b7-8ca6-41451d665531 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:02.156302 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76749487-09b0-45b7-8ca6-41451d665531 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:02.156524 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76749487-09b0-45b7-8ca6-41451d665531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:02.164328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:02.177522 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-76749487-09b0-45b7-8ca6-41451d665531 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:02.178753 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-76749487-09b0-45b7-8ca6-41451d665531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:02.278205 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c996e6-2b0b-41d6-8572-d377986d2dec None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:02.278626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 271/540] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:35:02.333968 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04944c5-365c-4e35-94f8-8925fae0e639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:02.334525 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04944c5-365c-4e35-94f8-8925fae0e639 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:02.334803 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04944c5-365c-4e35-94f8-8925fae0e639 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:02.335076 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04944c5-365c-4e35-94f8-8925fae0e639 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:02.343091 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04944c5-365c-4e35-94f8-8925fae0e639 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:02.344575 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04944c5-365c-4e35-94f8-8925fae0e639 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:02.363469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-d04944c5-365c-4e35-94f8-8925fae0e639 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:02.363469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:02.363469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:02.363469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:02.363469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:02.363469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:02.363469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:02.363469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:02.363469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:02.363469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:02.363469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:02.363469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:02.363469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:35:02.363469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:35:02.363469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:35:02.364360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:35:02.364360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:02.364360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:02.364360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:02.364360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:02.364360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:02.364360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:02.364360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:02.364360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:02.364360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:02.364360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:02.364360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:02.364360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:02.364360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:02.364360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:02.364360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:02.364360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:02.365176 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:35:02.365176 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:35:02.365176 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:35:02.365176 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:35:02.365176 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:35:02.365176 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:35:02.365176 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:02.365176 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:02.365176 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 270/541] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:02.370642 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76749487-09b0-45b7-8ca6-41451d665531 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:02.423028 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:02.534158 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76749487-09b0-45b7-8ca6-41451d665531 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:02.580235 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e851007-00be-441d-bc9c-9ab02ffa2be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:02.580849 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e851007-00be-441d-bc9c-9ab02ffa2be6 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:02.581126 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e851007-00be-441d-bc9c-9ab02ffa2be6 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:02.581394 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e851007-00be-441d-bc9c-9ab02ffa2be6 None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:02.582091 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e851007-00be-441d-bc9c-9ab02ffa2be6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:02.582397 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e851007-00be-441d-bc9c-9ab02ffa2be6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:02.583879 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e851007-00be-441d-bc9c-9ab02ffa2be6 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:02.600899 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 272/542] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:35:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:02.606281 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04944c5-365c-4e35-94f8-8925fae0e639 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:02.644545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e851007-00be-441d-bc9c-9ab02ffa2be6 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:02.725510 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04944c5-365c-4e35-94f8-8925fae0e639 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:02.735173 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:02.791746 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:02.797050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931b336-cb67-4cdf-af0f-9ab9945e7a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:02.797948 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931b336-cb67-4cdf-af0f-9ab9945e7a12 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:02.798454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931b336-cb67-4cdf-af0f-9ab9945e7a12 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:02.798923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931b336-cb67-4cdf-af0f-9ab9945e7a12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:02.799882 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931b336-cb67-4cdf-af0f-9ab9945e7a12 None admin] RBAC: Adding query filter params (role.id=f8c77ddd17fd4bc7af83e8d8905fb404, scope.project.id=6283121e17814cd792df9d0edf81bf2d, user.id=72f0d372f6c34d1a9a990222d6b98948) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:02.801127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931b336-cb67-4cdf-af0f-9ab9945e7a12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:02.802954 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931b336-cb67-4cdf-af0f-9ab9945e7a12 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:02.814658 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 271/543] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:35:02 2022] GET /identity/v3/role_assignments?user.id=72f0d372f6c34d1a9a990222d6b98948&scope.project.id=6283121e17814cd792df9d0edf81bf2d&role.id=f8c77ddd17fd4bc7af83e8d8905fb404 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:02.822065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e851007-00be-441d-bc9c-9ab02ffa2be6 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:02.902487 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2494e-0f95-4451-98a8-f8f3725d3a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:02.903529 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2494e-0f95-4451-98a8-f8f3725d3a69 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:02.904036 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2494e-0f95-4451-98a8-f8f3725d3a69 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:02.904506 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2494e-0f95-4451-98a8-f8f3725d3a69 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:02.927531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2494e-0f95-4451-98a8-f8f3725d3a69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:35:02.933576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-7ff2494e-0f95-4451-98a8-f8f3725d3a69 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:35:02.933576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:02.933576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:02.933576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:02.933576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:02.933576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:02.933576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:02.933576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:02.933576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:02.933576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:02.933576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:02.933576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:02.933576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:35:02.933576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:35:02.933576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:35:02.933576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:35:02.934491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:35:02.934491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:35:02.934491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:35:02.934491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:35:02.934491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:02.934491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:02.934491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:02.934491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:02.934491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:02.934491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:02.934491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:02.934491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:02.934491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:02.934491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:02.934491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:02.934491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:02.935254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:02.935254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:02.935254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:02.935254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:02.935254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:35:02.935254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:35:02.935254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:35:02.935254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:35:02.935254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:35:02.935254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:35:02.935254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:35:02.935254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:02.937759 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 273/544] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 1 13:35:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:35:02.945884 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931b336-cb67-4cdf-af0f-9ab9945e7a12 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:03.043277 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1596b10-6686-44b7-9fd2-fbe1579c0a94 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:03.043836 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1596b10-6686-44b7-9fd2-fbe1579c0a94 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:03.044198 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1596b10-6686-44b7-9fd2-fbe1579c0a94 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:03.047557 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 274/545] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:35:03.052678 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e73cb-fc64-4d59-ada8-45e401b6261a None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:03.053059 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e73cb-fc64-4d59-ada8-45e401b6261a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:03.053800 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e73cb-fc64-4d59-ada8-45e401b6261a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:03.082493 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-760e73cb-fc64-4d59-ada8-45e401b6261a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:03.083399 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931b336-cb67-4cdf-af0f-9ab9945e7a12 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:03.083905 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-760e73cb-fc64-4d59-ada8-45e401b6261a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:03.128077 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cc015-4fb8-46df-ace8-e87cc006509b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:03.129331 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cc015-4fb8-46df-ace8-e87cc006509b None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:03.130108 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cc015-4fb8-46df-ace8-e87cc006509b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:03.131552 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cc015-4fb8-46df-ace8-e87cc006509b None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:03.132275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8cc015-4fb8-46df-ace8-e87cc006509b None admin] RBAC: Adding query filter params (name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:03.132587 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8cc015-4fb8-46df-ace8-e87cc006509b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:03.134583 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8cc015-4fb8-46df-ace8-e87cc006509b None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:03.148890 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 272/546] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 1 13:35:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:03.150816 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cc015-4fb8-46df-ace8-e87cc006509b None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:03.179548 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 275/547] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:35:03.192128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:03.267037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cc015-4fb8-46df-ace8-e87cc006509b None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:03.310543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1a016-781c-40fd-87c1-4edc8561ad66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:03.311678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1a016-781c-40fd-87c1-4edc8561ad66 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:03.312166 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1a016-781c-40fd-87c1-4edc8561ad66 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:03.312639 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1a016-781c-40fd-87c1-4edc8561ad66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:03.325395 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1a016-781c-40fd-87c1-4edc8561ad66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:03.327306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1a016-781c-40fd-87c1-4edc8561ad66 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:03.352351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-baf1a016-781c-40fd-87c1-4edc8561ad66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:03.352351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:03.352351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:03.352351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:03.352351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:03.352351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:03.352351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:03.352351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:03.352351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:03.352351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:03.352351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:03.352351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:03.352351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:03.352351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:03.352351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:03.352351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:03.353275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:03.353275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:03.353275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:03.353275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:03.353275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:03.353275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:03.353275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:03.353275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:03.353275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:03.353275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:03.353275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:03.353275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:03.353275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:03.353275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:03.353275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:03.353275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:03.353275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:03.354583 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:03.354583 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:03.354583 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:03.356410 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 273/548] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:03.362723 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e73cb-fc64-4d59-ada8-45e401b6261a None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:03.447781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:03.464923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1a016-781c-40fd-87c1-4edc8561ad66 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:03.483340 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e73cb-fc64-4d59-ada8-45e401b6261a None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:03.561196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4c579-ee1b-4ddb-a57b-6cec5fd3414e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:03.562665 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4c579-ee1b-4ddb-a57b-6cec5fd3414e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:03.563143 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4c579-ee1b-4ddb-a57b-6cec5fd3414e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:03.563691 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4c579-ee1b-4ddb-a57b-6cec5fd3414e None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:03.564519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4c579-ee1b-4ddb-a57b-6cec5fd3414e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:03.564994 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4c579-ee1b-4ddb-a57b-6cec5fd3414e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:03.566548 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4c579-ee1b-4ddb-a57b-6cec5fd3414e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:03.567385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:03.584345 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1a016-781c-40fd-87c1-4edc8561ad66 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:03.589115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 276/549] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:03.594794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4c579-ee1b-4ddb-a57b-6cec5fd3414e None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:03.623373 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b22ad1-6f40-4109-ae69-c48ac6a25f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:03.624086 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b22ad1-6f40-4109-ae69-c48ac6a25f71 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:03.624423 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b22ad1-6f40-4109-ae69-c48ac6a25f71 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:03.624705 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b22ad1-6f40-4109-ae69-c48ac6a25f71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:03.648433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b22ad1-6f40-4109-ae69-c48ac6a25f71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:35:03.656242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-d8b22ad1-6f40-4109-ae69-c48ac6a25f71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:35:03.656242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:03.656242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:03.656242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:03.656242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:03.656242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:03.656242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:03.656242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:03.656242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:03.656242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:03.656242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:03.656242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:03.656242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:35:03.656242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:35:03.656242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:35:03.656242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:35:03.657172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:35:03.657172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:35:03.657172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:35:03.657172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:35:03.657172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:03.657172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:03.657172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:03.657172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:03.657172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:03.657172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:03.657172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:03.657172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:03.657172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:03.657172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:03.657172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:03.657172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:03.657952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:03.657952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:03.657952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:03.657952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:03.657952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:35:03.657952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:35:03.657952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:35:03.657952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:35:03.657952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:35:03.657952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:35:03.657952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:35:03.657952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:03.659601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 274/550] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 1 13:35:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:35:03.665535 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b22ad1-6f40-4109-ae69-c48ac6a25f71 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:03.788415 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4c579-ee1b-4ddb-a57b-6cec5fd3414e None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:03.864646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5985064-08e9-4e81-b2d7-9cf21974caec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:03.865556 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5985064-08e9-4e81-b2d7-9cf21974caec None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:03.866052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5985064-08e9-4e81-b2d7-9cf21974caec None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:03.866471 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5985064-08e9-4e81-b2d7-9cf21974caec None admin] PATH_INFO: `/v3/users/swift` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:03.868644 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b22ad1-6f40-4109-ae69-c48ac6a25f71 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:03.877212 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5985064-08e9-4e81-b2d7-9cf21974caec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:03.878978 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5985064-08e9-4e81-b2d7-9cf21974caec None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:03.887391 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:03.907399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-b5985064-08e9-4e81-b2d7-9cf21974caec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 13:35:03.907399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:03.907399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:03.907399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:03.907399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:03.907399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:03.907399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:03.907399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:03.907399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:03.907399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:03.907399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:03.907399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:03.907399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:35:03.907399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:35:03.907399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:35:03.907399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:35:03.908512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:03.908512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:03.908512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:35:03.908512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:03.908512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:35:03.908512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:03.908512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:03.908512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:03.908512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:03.908512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:03.908512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:03.908512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:03.908512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:03.908512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:03.908512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:03.908512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:03.908512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:03.908512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:03.909607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:03.909607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:03.909607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:35:03.909607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:35:03.909607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:35:03.909607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:35:03.909607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:35:03.909607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:35:03.909607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 13:35:03.909607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:03.909607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 277/551] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:35:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:35:03.912360 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5985064-08e9-4e81-b2d7-9cf21974caec None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:03.913779 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b570f-6ca6-49d5-8261-29d1e0c97db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:03.914632 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b570f-6ca6-49d5-8261-29d1e0c97db9 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:03.915567 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b570f-6ca6-49d5-8261-29d1e0c97db9 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:03.916053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b570f-6ca6-49d5-8261-29d1e0c97db9 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:03.916945 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492b570f-6ca6-49d5-8261-29d1e0c97db9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:03.917360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492b570f-6ca6-49d5-8261-29d1e0c97db9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:03.918942 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492b570f-6ca6-49d5-8261-29d1e0c97db9 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:03.928195 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 275/552] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 1 13:35:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:35:03.937991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b570f-6ca6-49d5-8261-29d1e0c97db9 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:03.969425 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:04.071234 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b570f-6ca6-49d5-8261-29d1e0c97db9 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:04.098774 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5985064-08e9-4e81-b2d7-9cf21974caec None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:04.107539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44fb23-168b-4841-9696-03056cf2e2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:04.115108 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44fb23-168b-4841-9696-03056cf2e2b5 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:04.115108 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44fb23-168b-4841-9696-03056cf2e2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:04.115108 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44fb23-168b-4841-9696-03056cf2e2b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:04.119885 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44fb23-168b-4841-9696-03056cf2e2b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:04.121351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44fb23-168b-4841-9696-03056cf2e2b5 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:04.136416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-8f44fb23-168b-4841-9696-03056cf2e2b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:04.136416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:04.136416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:04.136416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:04.136416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:04.136416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:04.136416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:04.136416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:04.136416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:04.136416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:04.136416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:04.136416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:04.136416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:04.136416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:04.136416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:04.136416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:04.137875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:04.137875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:04.137875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:04.137875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:04.137875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:04.137875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:04.137875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:04.137875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:04.137875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:04.137875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:04.137875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:04.137875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:04.137875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:04.137875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:04.137875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:04.137875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:04.137875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:04.138729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:04.138729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:04.138729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:04.138729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 276/553] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:04.139270 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7e1b3-9fea-484f-8fb5-ddc26a2325d7 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:04.139390 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7e1b3-9fea-484f-8fb5-ddc26a2325d7 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:04.143381 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7e1b3-9fea-484f-8fb5-ddc26a2325d7 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:04.143381 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 277/554] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:04.143381 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7e1b3-9fea-484f-8fb5-ddc26a2325d7 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:04.144161 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db8c92-92ca-488b-babd-1da37af49770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:04.144877 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db8c92-92ca-488b-babd-1da37af49770 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:04.145228 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db8c92-92ca-488b-babd-1da37af49770 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:04.145662 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db8c92-92ca-488b-babd-1da37af49770 None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:04.146820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db8c92-92ca-488b-babd-1da37af49770 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:04.147247 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db8c92-92ca-488b-babd-1da37af49770 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:04.153264 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db8c92-92ca-488b-babd-1da37af49770 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:04.197839 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 278/555] 10.222.0.50 () {56 vars in 1135 bytes} [Thu Sep 1 13:35:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:04.199575 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cab09-c713-4e33-b121-104b0b850422 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:04.199939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cab09-c713-4e33-b121-104b0b850422 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:04.200692 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cab09-c713-4e33-b121-104b0b850422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:04.211401 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:04.226729 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-159cab09-c713-4e33-b121-104b0b850422 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:04.229828 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-159cab09-c713-4e33-b121-104b0b850422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:04.262175 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7e1b3-9fea-484f-8fb5-ddc26a2325d7 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:04.298229 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:04.300210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4152475-e4ad-4b41-a227-1fbf22eaf450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:04.301053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4152475-e4ad-4b41-a227-1fbf22eaf450 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:04.301582 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4152475-e4ad-4b41-a227-1fbf22eaf450 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:04.302050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4152475-e4ad-4b41-a227-1fbf22eaf450 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:04.302954 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4152475-e4ad-4b41-a227-1fbf22eaf450 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:04.303476 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4152475-e4ad-4b41-a227-1fbf22eaf450 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:04.305102 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4152475-e4ad-4b41-a227-1fbf22eaf450 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:04.318507 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 278/556] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:04.319790 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4152475-e4ad-4b41-a227-1fbf22eaf450 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:04.323632 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 279/557] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:35:04.324436 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cab09-c713-4e33-b121-104b0b850422 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:04.456179 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cab09-c713-4e33-b121-104b0b850422 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:04.506635 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca0964-dc5a-4901-a6b6-889b54bafb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:04.516173 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca0964-dc5a-4901-a6b6-889b54bafb70 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:04.516461 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca0964-dc5a-4901-a6b6-889b54bafb70 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:04.516730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca0964-dc5a-4901-a6b6-889b54bafb70 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:04.535651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4152475-e4ad-4b41-a227-1fbf22eaf450 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:04.536520 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca0964-dc5a-4901-a6b6-889b54bafb70 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:04.538001 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca0964-dc5a-4901-a6b6-889b54bafb70 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:04.561067 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:04.564949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-b0ca0964-dc5a-4901-a6b6-889b54bafb70 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:35:04.564949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:04.564949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:04.564949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:04.564949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:04.564949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:04.564949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:04.564949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:04.564949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:04.564949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:04.564949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:04.564949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:04.564949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:35:04.564949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:35:04.564949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:35:04.564949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:35:04.566627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:04.566627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:04.566627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:35:04.566627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:04.566627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:35:04.566627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:04.566627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:04.566627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:04.566627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:04.566627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:04.566627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:04.566627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:04.566627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:04.566627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:04.566627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:04.566627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:04.566627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:04.566627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:04.567612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:04.567612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:04.567612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:35:04.567612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:35:04.567612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:35:04.567612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:35:04.567612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:35:04.567612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:35:04.567612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:35:04.567612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:04.567612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 280/558] 10.222.0.50 () {56 vars in 1093 bytes} [Thu Sep 1 13:35:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:04.572454 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a07a7d-fc47-47b3-9b97-c1b5b75d982f None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:04.572742 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a07a7d-fc47-47b3-9b97-c1b5b75d982f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:04.575708 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a07a7d-fc47-47b3-9b97-c1b5b75d982f None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:04.575708 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 281/559] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:04.580059 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598c5a9-46fe-49fd-90e5-94eb8f7eabde None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:04.580454 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598c5a9-46fe-49fd-90e5-94eb8f7eabde None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:04.580734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598c5a9-46fe-49fd-90e5-94eb8f7eabde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:04.582151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c01c8-bf31-4c23-808d-4978fbf1d6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:04.582765 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c01c8-bf31-4c23-808d-4978fbf1d6e2 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:04.583043 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c01c8-bf31-4c23-808d-4978fbf1d6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:04.583315 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c01c8-bf31-4c23-808d-4978fbf1d6e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:04.599067 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-c598c5a9-46fe-49fd-90e5-94eb8f7eabde None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:04.600304 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c598c5a9-46fe-49fd-90e5-94eb8f7eabde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:04.646790 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:04.674058 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 282/560] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:35:04.674924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598c5a9-46fe-49fd-90e5-94eb8f7eabde None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:04.678290 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c01c8-bf31-4c23-808d-4978fbf1d6e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:04.681371 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c01c8-bf31-4c23-808d-4978fbf1d6e2 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:04.798176 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598c5a9-46fe-49fd-90e5-94eb8f7eabde None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:04.807884 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 279/561] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:35:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:35:04.808753 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c01c8-bf31-4c23-808d-4978fbf1d6e2 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:04.839781 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:04.845767 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe9a29-f307-4133-9edb-5c6e51ec121c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:04.846682 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe9a29-f307-4133-9edb-5c6e51ec121c None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:04.847794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe9a29-f307-4133-9edb-5c6e51ec121c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:04.848331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe9a29-f307-4133-9edb-5c6e51ec121c None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:04.849282 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe9a29-f307-4133-9edb-5c6e51ec121c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:04.849878 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe9a29-f307-4133-9edb-5c6e51ec121c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:04.851541 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe9a29-f307-4133-9edb-5c6e51ec121c None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:04.872254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 283/562] 10.222.0.50 () {56 vars in 1133 bytes} [Thu Sep 1 13:35:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:04.873443 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe9a29-f307-4133-9edb-5c6e51ec121c None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:04.912929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:04.948480 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c01c8-bf31-4c23-808d-4978fbf1d6e2 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:04.989089 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45c605-36b5-479f-ad38-4cec3284dfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:04.989723 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45c605-36b5-479f-ad38-4cec3284dfc3 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:04.990008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45c605-36b5-479f-ad38-4cec3284dfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:04.990276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45c605-36b5-479f-ad38-4cec3284dfc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:04.993620 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe9a29-f307-4133-9edb-5c6e51ec121c None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:05.000855 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45c605-36b5-479f-ad38-4cec3284dfc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:35:05.005786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-3a45c605-36b5-479f-ad38-4cec3284dfc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:35:05.005786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:05.005786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:05.005786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:05.005786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:05.005786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:05.005786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:05.005786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:05.005786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:05.005786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:05.005786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:05.005786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:05.005786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:35:05.005786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:35:05.005786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:35:05.005786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:35:05.006661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:35:05.006661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:35:05.006661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:35:05.006661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:35:05.006661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:05.006661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:05.006661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:05.006661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:05.006661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:05.006661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:05.006661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:05.006661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:05.006661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:05.006661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:05.006661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:05.006661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:05.007935 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:05.007935 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:05.007935 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:05.007935 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:05.007935 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:35:05.007935 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:35:05.007935 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:35:05.007935 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:35:05.007935 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:35:05.007935 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:35:05.007935 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:35:05.007935 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:05.007935 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 280/563] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 1 13:35:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:05.007935 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45c605-36b5-479f-ad38-4cec3284dfc3 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:05.035038 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5b302-7de9-4522-8eb4-161f7f019ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:05.035709 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5b302-7de9-4522-8eb4-161f7f019ffd None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:05.035992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5b302-7de9-4522-8eb4-161f7f019ffd None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:05.036266 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5b302-7de9-4522-8eb4-161f7f019ffd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:05.047015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5b302-7de9-4522-8eb4-161f7f019ffd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:05.048494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5b302-7de9-4522-8eb4-161f7f019ffd None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:05.062846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-d2f5b302-7de9-4522-8eb4-161f7f019ffd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:05.062846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:05.062846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:05.062846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:05.062846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:05.062846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:05.062846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:05.062846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:05.062846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:05.062846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:05.062846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:05.062846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:05.062846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:05.062846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:05.062846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:05.062846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:05.063770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:05.063770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:05.063770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:05.063770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:05.063770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:05.063770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:05.063770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:05.063770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:05.063770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:05.063770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:05.063770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:05.063770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:05.063770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:05.063770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:05.063770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:05.063770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:05.063770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:05.064642 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:05.064642 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:05.064642 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:05.064642 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 284/564] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:05.064865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5b302-7de9-4522-8eb4-161f7f019ffd None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:05.094557 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:05.114010 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45c605-36b5-479f-ad38-4cec3284dfc3 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:05.148613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d618c56-3818-4ca3-b861-a9243b8b1c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:05.149756 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d618c56-3818-4ca3-b861-a9243b8b1c13 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:05.150056 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d618c56-3818-4ca3-b861-a9243b8b1c13 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:05.150334 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d618c56-3818-4ca3-b861-a9243b8b1c13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:05.150472 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:05.160468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d618c56-3818-4ca3-b861-a9243b8b1c13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:05.161963 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d618c56-3818-4ca3-b861-a9243b8b1c13 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:05.167409 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5b302-7de9-4522-8eb4-161f7f019ffd None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:05.179262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-5d618c56-3818-4ca3-b861-a9243b8b1c13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:05.179262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:05.179262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:05.179262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:05.179262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:05.179262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:05.179262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:05.179262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:05.179262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:05.179262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:05.179262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:05.179262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:05.179262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:05.179262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:05.179262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:05.179262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:05.180422 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:05.180422 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:05.180422 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:05.180422 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:05.180422 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:05.180422 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:05.180422 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:05.180422 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:05.180422 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:05.180422 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:05.180422 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:05.180422 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:05.180422 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:05.180422 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:05.180422 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:05.180422 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:05.180422 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:05.181299 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:05.181299 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:05.181299 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:05.181299 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 281/565] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:05.181745 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d618c56-3818-4ca3-b861-a9243b8b1c13 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:05.206670 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7fac5-7a32-42a9-bc61-84501f8735aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:05.207294 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7fac5-7a32-42a9-bc61-84501f8735aa None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:05.207607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7fac5-7a32-42a9-bc61-84501f8735aa None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:05.207891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7fac5-7a32-42a9-bc61-84501f8735aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:05.218600 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7fac5-7a32-42a9-bc61-84501f8735aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:35:05.223523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-47d7fac5-7a32-42a9-bc61-84501f8735aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:35:05.223523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:05.223523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:05.223523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:05.223523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:05.223523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:05.223523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:05.223523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:05.223523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:05.223523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:05.223523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:05.223523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:05.223523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:35:05.223523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:35:05.223523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:35:05.223523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:35:05.224436 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:35:05.224436 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:35:05.224436 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:35:05.224436 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:35:05.224436 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:05.224436 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:05.224436 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:05.224436 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:05.224436 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:05.224436 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:05.224436 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:05.224436 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:05.224436 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:05.224436 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:05.224436 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:05.224436 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:05.225237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:05.225237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:05.225237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:05.225237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:05.225237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:35:05.225237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:35:05.225237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:35:05.225237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:35:05.225237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:35:05.225237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:35:05.225237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:35:05.225237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:05.225237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 285/566] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 1 13:35:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:05.225894 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f1846-9a94-44e9-abfe-53308e827713 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:05.226479 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f1846-9a94-44e9-abfe-53308e827713 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:05.226479 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f1846-9a94-44e9-abfe-53308e827713 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:05.233036 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 286/567] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:05.233797 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f1846-9a94-44e9-abfe-53308e827713 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:05.286175 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d618c56-3818-4ca3-b861-a9243b8b1c13 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:05.314412 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:05.319308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce2571-b3f6-4918-bbe2-0f7fbe8c6a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:05.319951 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce2571-b3f6-4918-bbe2-0f7fbe8c6a7f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:05.320233 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce2571-b3f6-4918-bbe2-0f7fbe8c6a7f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:05.320510 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce2571-b3f6-4918-bbe2-0f7fbe8c6a7f None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:05.321704 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce2571-b3f6-4918-bbe2-0f7fbe8c6a7f None admin] RBAC: Adding query filter params (name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:05.322014 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce2571-b3f6-4918-bbe2-0f7fbe8c6a7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:05.323419 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce2571-b3f6-4918-bbe2-0f7fbe8c6a7f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:05.331994 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 282/568] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 1 13:35:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:05.332821 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce2571-b3f6-4918-bbe2-0f7fbe8c6a7f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:05.334283 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f1846-9a94-44e9-abfe-53308e827713 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:05.370399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbd61c-4110-4f94-95d7-0434076a8b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:05.370971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbd61c-4110-4f94-95d7-0434076a8b91 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:05.371249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbd61c-4110-4f94-95d7-0434076a8b91 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:05.371548 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbd61c-4110-4f94-95d7-0434076a8b91 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:05.372188 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cbd61c-4110-4f94-95d7-0434076a8b91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:05.372486 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cbd61c-4110-4f94-95d7-0434076a8b91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:05.373880 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cbd61c-4110-4f94-95d7-0434076a8b91 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:05.385557 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 287/569] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:05.386358 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbd61c-4110-4f94-95d7-0434076a8b91 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:05.389672 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:05.435189 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce2571-b3f6-4918-bbe2-0f7fbe8c6a7f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:05.471035 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9187ad-7b29-4636-8a8e-b74022207aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:05.471658 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9187ad-7b29-4636-8a8e-b74022207aae None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:05.471937 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9187ad-7b29-4636-8a8e-b74022207aae None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:05.472208 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9187ad-7b29-4636-8a8e-b74022207aae None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:05.472844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9187ad-7b29-4636-8a8e-b74022207aae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:05.473141 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9187ad-7b29-4636-8a8e-b74022207aae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:05.474509 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9187ad-7b29-4636-8a8e-b74022207aae None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:05.484460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbd61c-4110-4f94-95d7-0434076a8b91 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:05.485746 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 283/570] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:05.486892 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f32ba-b00d-4181-8115-30f67b2ce136 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:05.487171 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f32ba-b00d-4181-8115-30f67b2ce136 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:05.487465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f32ba-b00d-4181-8115-30f67b2ce136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:05.504711 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-b71f32ba-b00d-4181-8115-30f67b2ce136 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:05.505901 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b71f32ba-b00d-4181-8115-30f67b2ce136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:05.523339 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73831aac-910a-41aa-9bca-98854cc386c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:05.523972 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73831aac-910a-41aa-9bca-98854cc386c1 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:05.524840 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73831aac-910a-41aa-9bca-98854cc386c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:05.525288 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73831aac-910a-41aa-9bca-98854cc386c1 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:05.526029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73831aac-910a-41aa-9bca-98854cc386c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:05.526339 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73831aac-910a-41aa-9bca-98854cc386c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:05.527731 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73831aac-910a-41aa-9bca-98854cc386c1 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:05.537102 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 288/571] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 1 13:35:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:05.538529 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73831aac-910a-41aa-9bca-98854cc386c1 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:05.558047 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:05.575341 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 284/572] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:35:05.576029 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f32ba-b00d-4181-8115-30f67b2ce136 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:05.634363 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:05.671052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73831aac-910a-41aa-9bca-98854cc386c1 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:05.680927 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f32ba-b00d-4181-8115-30f67b2ce136 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:05.705659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af961e86-889c-41e0-bcf3-943ec7d625b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:05.706281 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af961e86-889c-41e0-bcf3-943ec7d625b3 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:05.706562 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af961e86-889c-41e0-bcf3-943ec7d625b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:05.707113 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af961e86-889c-41e0-bcf3-943ec7d625b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:05.716753 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd26c0-8921-4de4-a152-bd7ffaadbc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:05.717564 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd26c0-8921-4de4-a152-bd7ffaadbc0d None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:05.717928 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af961e86-889c-41e0-bcf3-943ec7d625b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:05.718172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd26c0-8921-4de4-a152-bd7ffaadbc0d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:05.718608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd26c0-8921-4de4-a152-bd7ffaadbc0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:05.719402 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af961e86-889c-41e0-bcf3-943ec7d625b3 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:05.726833 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd26c0-8921-4de4-a152-bd7ffaadbc0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:05.729049 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd26c0-8921-4de4-a152-bd7ffaadbc0d None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:05.733668 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-af961e86-889c-41e0-bcf3-943ec7d625b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:05.733668 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:05.733668 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:05.733668 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:05.733668 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:05.733668 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:05.733668 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:05.733668 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:05.733668 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:05.733668 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:05.733668 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:05.733668 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:05.733668 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:05.733668 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:05.733668 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:05.733668 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:05.734679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:05.734679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:05.734679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:05.734679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:05.734679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:05.734679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:05.734679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:05.734679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:05.734679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:05.734679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:05.734679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:05.734679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:05.734679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:05.734679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:05.734679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:05.734679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:05.734679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:05.735593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:05.735593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:05.735593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:05.739525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 289/573] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:05.740362 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af961e86-889c-41e0-bcf3-943ec7d625b3 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:05.741949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-11cd26c0-8921-4de4-a152-bd7ffaadbc0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:05.741949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:05.741949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:05.741949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:05.741949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:05.741949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:05.741949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:05.741949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:05.741949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:05.741949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:05.741949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:05.741949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:05.741949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:35:05.741949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:35:05.741949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:35:05.742750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:35:05.742750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:05.742750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:05.742750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:05.742750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:05.742750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:05.742750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:05.742750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:05.742750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:05.742750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:05.742750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:05.742750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:05.742750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:05.742750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:05.742750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:05.742750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:05.742750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:05.744218 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:35:05.744218 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:35:05.744218 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:35:05.744218 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:35:05.744218 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:35:05.744218 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:35:05.744218 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:05.744218 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:05.744218 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 285/574] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:05.745384 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd26c0-8921-4de4-a152-bd7ffaadbc0d None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:05.800476 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:05.853139 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af961e86-889c-41e0-bcf3-943ec7d625b3 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:05.862396 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd26c0-8921-4de4-a152-bd7ffaadbc0d None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:05.871525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:05.889278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac499cc-731c-4489-a18a-342a9e3537e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:05.889838 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac499cc-731c-4489-a18a-342a9e3537e9 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:05.890119 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac499cc-731c-4489-a18a-342a9e3537e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:05.890389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac499cc-731c-4489-a18a-342a9e3537e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:05.897048 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac499cc-731c-4489-a18a-342a9e3537e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:05.897486 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e0625-d283-42e9-b590-af2cdffdc9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:05.898110 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e0625-d283-42e9-b590-af2cdffdc9b3 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:05.898394 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e0625-d283-42e9-b590-af2cdffdc9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:05.898484 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac499cc-731c-4489-a18a-342a9e3537e9 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:05.898677 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e0625-d283-42e9-b590-af2cdffdc9b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:05.909945 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-4ac499cc-731c-4489-a18a-342a9e3537e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:05.909945 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:05.909945 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:05.909945 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:05.909945 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:05.909945 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:05.909945 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:05.909945 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:05.909945 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:05.909945 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:05.909945 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:05.909945 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:05.909945 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:35:05.909945 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:35:05.909945 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:35:05.910909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:35:05.910909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:05.910909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:05.910909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:05.910909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:05.910909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:05.910909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:05.910909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:05.910909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:05.910909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:05.910909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:05.910909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:05.910909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:05.910909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:05.910909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:05.910909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:05.910909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:05.911826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:35:05.911826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:35:05.911826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:35:05.911826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:35:05.911826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:35:05.911826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:35:05.911826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:05.911826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:05.913869 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e0625-d283-42e9-b590-af2cdffdc9b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:05.915494 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e0625-d283-42e9-b590-af2cdffdc9b3 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:05.915621 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 290/575] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:05.916379 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac499cc-731c-4489-a18a-342a9e3537e9 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:05.930182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-f81e0625-d283-42e9-b590-af2cdffdc9b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:05.930182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:05.930182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:05.930182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:05.930182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:05.930182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:05.930182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:05.930182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:05.930182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:05.930182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:05.930182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:05.930182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:05.930182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:05.930182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:05.930182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:05.930182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:05.931933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:05.931933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:05.931933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:05.931933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:05.931933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:05.931933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:05.931933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:05.931933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:05.931933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:05.931933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:05.931933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:05.931933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:05.931933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:05.931933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:05.931933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:05.931933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:05.931933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:05.932826 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:05.932826 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:05.932826 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:05.932826 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 286/576] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:05.932826 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e0625-d283-42e9-b590-af2cdffdc9b3 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:06.021131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac499cc-731c-4489-a18a-342a9e3537e9 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:06.031423 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:06.037689 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e0625-d283-42e9-b590-af2cdffdc9b3 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:06.057552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59da00-15eb-4eb8-8bda-d9381cc7d087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:06.058179 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59da00-15eb-4eb8-8bda-d9381cc7d087 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:06.058460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59da00-15eb-4eb8-8bda-d9381cc7d087 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:06.058731 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59da00-15eb-4eb8-8bda-d9381cc7d087 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:06.059404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59da00-15eb-4eb8-8bda-d9381cc7d087 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:06.059710 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59da00-15eb-4eb8-8bda-d9381cc7d087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:06.061101 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59da00-15eb-4eb8-8bda-d9381cc7d087 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:06.073637 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 291/577] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:06.074584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59da00-15eb-4eb8-8bda-d9381cc7d087 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:06.074959 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205c57a-f577-48fd-8b5e-403e915f681d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:06.075646 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205c57a-f577-48fd-8b5e-403e915f681d None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:06.075931 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205c57a-f577-48fd-8b5e-403e915f681d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:06.076207 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205c57a-f577-48fd-8b5e-403e915f681d None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:06.076933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205c57a-f577-48fd-8b5e-403e915f681d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:06.077244 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205c57a-f577-48fd-8b5e-403e915f681d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:06.078730 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205c57a-f577-48fd-8b5e-403e915f681d None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:06.091191 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 287/578] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:35:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:06.092116 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205c57a-f577-48fd-8b5e-403e915f681d None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:06.122086 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:06.198549 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59da00-15eb-4eb8-8bda-d9381cc7d087 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:06.210314 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205c57a-f577-48fd-8b5e-403e915f681d None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:06.238091 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4df0fc-7ac4-4922-9a8c-dad606aaf15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:06.238722 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4df0fc-7ac4-4922-9a8c-dad606aaf15e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:06.239002 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4df0fc-7ac4-4922-9a8c-dad606aaf15e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:06.239272 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4df0fc-7ac4-4922-9a8c-dad606aaf15e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:06.248313 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f5ce5-9609-46ac-b543-809ddcb58187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:06.249275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f5ce5-9609-46ac-b543-809ddcb58187 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:06.249697 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f5ce5-9609-46ac-b543-809ddcb58187 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:06.250001 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f5ce5-9609-46ac-b543-809ddcb58187 None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:06.250303 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4df0fc-7ac4-4922-9a8c-dad606aaf15e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:35:06.251140 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f5ce5-9609-46ac-b543-809ddcb58187 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:06.251548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f5ce5-9609-46ac-b543-809ddcb58187 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:06.253491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f5ce5-9609-46ac-b543-809ddcb58187 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:06.255052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-ee4df0fc-7ac4-4922-9a8c-dad606aaf15e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:35:06.255052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:06.255052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:06.255052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:06.255052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:06.255052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:06.255052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:06.255052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:06.255052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:06.255052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:06.255052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:06.255052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:06.255052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:35:06.255052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:35:06.255052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:35:06.255052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:35:06.255999 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:35:06.255999 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:35:06.255999 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:35:06.255999 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:35:06.255999 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:06.255999 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:06.255999 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:06.255999 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:06.255999 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:06.255999 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:06.255999 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:06.255999 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:06.255999 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:06.255999 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:06.255999 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:06.255999 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:06.260205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:06.260205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:06.260205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:06.260205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:06.260205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:35:06.260205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:35:06.260205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:35:06.260205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:35:06.260205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:35:06.260205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:35:06.260205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:35:06.260205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:06.260205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 292/579] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 1 13:35:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:06.260205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4df0fc-7ac4-4922-9a8c-dad606aaf15e None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:06.270442 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 288/580] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:35:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:06.272669 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f5ce5-9609-46ac-b543-809ddcb58187 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:06.293628 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:06.362515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:06.366080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4df0fc-7ac4-4922-9a8c-dad606aaf15e None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:06.380250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f5ce5-9609-46ac-b543-809ddcb58187 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:06.401813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07e02e-8417-4591-abd0-0999ec6073eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:06.402424 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07e02e-8417-4591-abd0-0999ec6073eb None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:06.402706 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07e02e-8417-4591-abd0-0999ec6073eb None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:06.402982 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07e02e-8417-4591-abd0-0999ec6073eb None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:06.403658 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07e02e-8417-4591-abd0-0999ec6073eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:06.403964 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07e02e-8417-4591-abd0-0999ec6073eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:06.405339 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07e02e-8417-4591-abd0-0999ec6073eb None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:06.414378 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d51740-9533-4d4e-a84e-db5768d0cc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:06.415675 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d51740-9533-4d4e-a84e-db5768d0cc21 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:06.415953 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d51740-9533-4d4e-a84e-db5768d0cc21 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:06.416220 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d51740-9533-4d4e-a84e-db5768d0cc21 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:06.417163 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 293/581] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:06.417996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07e02e-8417-4591-abd0-0999ec6073eb None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:06.427603 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d51740-9533-4d4e-a84e-db5768d0cc21 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:06.429068 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d51740-9533-4d4e-a84e-db5768d0cc21 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:06.441835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-37d51740-9533-4d4e-a84e-db5768d0cc21 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 13:35:06.441835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:06.441835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:06.441835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:06.441835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:06.441835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:06.441835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:06.441835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:06.441835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:06.441835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:06.441835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:06.441835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:06.441835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:35:06.441835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:35:06.441835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:35:06.441835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:35:06.442934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:06.442934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:06.442934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:35:06.442934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:06.442934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:35:06.442934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:06.442934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:06.442934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:06.442934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:06.442934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:06.442934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:06.442934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:06.442934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:06.442934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:06.442934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:06.442934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:06.442934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:06.442934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:06.444054 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:06.444054 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:06.444054 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:35:06.444054 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:35:06.444054 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:35:06.444054 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:35:06.444054 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:35:06.444054 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:35:06.444054 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 13:35:06.444054 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:06.444054 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 289/582] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:35:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:06.444054 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d51740-9533-4d4e-a84e-db5768d0cc21 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:06.520676 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:06.521695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07e02e-8417-4591-abd0-0999ec6073eb None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:06.543407 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d51740-9533-4d4e-a84e-db5768d0cc21 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:06.557759 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b8418-30ff-492d-b9a0-2967cdba86fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:06.558365 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b8418-30ff-492d-b9a0-2967cdba86fc None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:06.562626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b8418-30ff-492d-b9a0-2967cdba86fc None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:06.562626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b8418-30ff-492d-b9a0-2967cdba86fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:06.562626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b8418-30ff-492d-b9a0-2967cdba86fc None admin] RBAC: Adding query filter params (role.id=f8c77ddd17fd4bc7af83e8d8905fb404, scope.project.id=6283121e17814cd792df9d0edf81bf2d, user.id=85bbede0f8674384bcc3028ea77eb724) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:06.562626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b8418-30ff-492d-b9a0-2967cdba86fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:06.562626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b8418-30ff-492d-b9a0-2967cdba86fc None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:06.566993 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 294/583] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:35:06 2022] GET /identity/v3/role_assignments?user.id=85bbede0f8674384bcc3028ea77eb724&scope.project.id=6283121e17814cd792df9d0edf81bf2d&role.id=f8c77ddd17fd4bc7af83e8d8905fb404 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:06.567794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b8418-30ff-492d-b9a0-2967cdba86fc None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:06.597248 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:06.601250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4759f-5f95-47de-8b49-1c99840c8504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:06.601883 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4759f-5f95-47de-8b49-1c99840c8504 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:06.602191 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4759f-5f95-47de-8b49-1c99840c8504 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:06.602465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4759f-5f95-47de-8b49-1c99840c8504 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:06.603150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4759f-5f95-47de-8b49-1c99840c8504 None admin] RBAC: Adding query filter params (name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:06.603499 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4759f-5f95-47de-8b49-1c99840c8504 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:06.605209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4759f-5f95-47de-8b49-1c99840c8504 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:06.620185 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 290/584] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 1 13:35:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:06.620185 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4759f-5f95-47de-8b49-1c99840c8504 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:06.690796 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b8418-30ff-492d-b9a0-2967cdba86fc None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:06.727670 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406ee44-9db8-4974-95cd-757ef1c8adca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:06.728333 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406ee44-9db8-4974-95cd-757ef1c8adca None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:06.728618 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406ee44-9db8-4974-95cd-757ef1c8adca None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:06.728899 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406ee44-9db8-4974-95cd-757ef1c8adca None admin] PATH_INFO: `/v3/projects/6283121e17814cd792df9d0edf81bf2d/users/2d231136bcd44d9a97efe6c257f936ed/roles/f8c77ddd17fd4bc7af83e8d8905fb404` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:06.735639 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4759f-5f95-47de-8b49-1c99840c8504 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:06.744383 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406ee44-9db8-4974-95cd-757ef1c8adca None admin] RBAC: Authorizing `identity:create_grant(project_id=6283121e17814cd792df9d0edf81bf2d, user_id=2d231136bcd44d9a97efe6c257f936ed, role_id=f8c77ddd17fd4bc7af83e8d8905fb404)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:06.745843 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406ee44-9db8-4974-95cd-757ef1c8adca None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:06.770495 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d281c6-dda5-4e4a-9c44-c963ba844bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:06.771179 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d281c6-dda5-4e4a-9c44-c963ba844bc3 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:06.771435 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d281c6-dda5-4e4a-9c44-c963ba844bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:06.771710 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d281c6-dda5-4e4a-9c44-c963ba844bc3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:06.779306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d281c6-dda5-4e4a-9c44-c963ba844bc3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:06.780778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d281c6-dda5-4e4a-9c44-c963ba844bc3 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:06.782557 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:06.792943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-80d281c6-dda5-4e4a-9c44-c963ba844bc3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 13:35:06.792943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:06.792943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:06.792943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:06.792943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:06.792943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:06.792943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:06.792943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:06.792943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:06.792943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:06.792943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:06.792943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:06.792943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:35:06.792943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:35:06.792943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:35:06.792943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:35:06.793930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:06.793930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:06.793930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:35:06.793930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:06.793930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:35:06.793930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:06.793930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:06.793930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:06.793930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:06.793930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:06.793930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:06.793930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:06.793930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:06.793930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:06.793930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:06.793930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:06.793930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:06.793930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:06.794834 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:06.794834 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:06.794834 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:35:06.794834 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:35:06.794834 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:35:06.794834 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:35:06.794834 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:35:06.794834 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:35:06.794834 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 13:35:06.794834 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:06.794834 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 291/585] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:35:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:06.795417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d281c6-dda5-4e4a-9c44-c963ba844bc3 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:06.832884 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 295/586] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 1 13:35:06 2022] PUT /identity/v3/projects/6283121e17814cd792df9d0edf81bf2d/users/2d231136bcd44d9a97efe6c257f936ed/roles/f8c77ddd17fd4bc7af83e8d8905fb404 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:35:06.842371 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406ee44-9db8-4974-95cd-757ef1c8adca None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:06.918731 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d281c6-dda5-4e4a-9c44-c963ba844bc3 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:06.934203 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:06.959521 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3200bbc-c5ba-46d9-bcdb-bdb842e25765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:06.960441 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3200bbc-c5ba-46d9-bcdb-bdb842e25765 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:06.960869 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3200bbc-c5ba-46d9-bcdb-bdb842e25765 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:06.961305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3200bbc-c5ba-46d9-bcdb-bdb842e25765 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:06.962349 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3200bbc-c5ba-46d9-bcdb-bdb842e25765 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:06.962934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3200bbc-c5ba-46d9-bcdb-bdb842e25765 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:06.964615 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3200bbc-c5ba-46d9-bcdb-bdb842e25765 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:06.978415 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406ee44-9db8-4974-95cd-757ef1c8adca None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:06.988691 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 292/587] 10.222.0.50 () {56 vars in 1137 bytes} [Thu Sep 1 13:35:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:06.989839 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3200bbc-c5ba-46d9-bcdb-bdb842e25765 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:07.028090 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8b266-b39f-4813-9c6b-5f79d7c30ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:07.028747 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8b266-b39f-4813-9c6b-5f79d7c30ede None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:07.029164 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8b266-b39f-4813-9c6b-5f79d7c30ede None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:07.029439 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8b266-b39f-4813-9c6b-5f79d7c30ede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:07.046741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8b266-b39f-4813-9c6b-5f79d7c30ede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:07.048246 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8b266-b39f-4813-9c6b-5f79d7c30ede None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:07.064478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:07.066029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-20d8b266-b39f-4813-9c6b-5f79d7c30ede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:07.066029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:07.066029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:07.066029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:07.066029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:07.066029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:07.066029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:07.066029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:07.066029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:07.066029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:07.066029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:07.066029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:07.066029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:07.066029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:07.066029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:07.066029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:07.066939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:07.066939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:07.066939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:07.066939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:07.066939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:07.066939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:07.066939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:07.066939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:07.066939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:07.066939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:07.066939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:07.066939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:07.066939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:07.066939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:07.066939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:07.066939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:07.066939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:07.069017 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:07.069017 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:07.069017 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:07.069017 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 296/588] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:07.069017 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8b266-b39f-4813-9c6b-5f79d7c30ede None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:07.127909 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3200bbc-c5ba-46d9-bcdb-bdb842e25765 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:07.174562 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8243bd-b6fb-4409-96f4-526210ad3256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:07.175400 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8243bd-b6fb-4409-96f4-526210ad3256 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:07.175692 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8243bd-b6fb-4409-96f4-526210ad3256 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:07.175970 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8243bd-b6fb-4409-96f4-526210ad3256 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:07.177240 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8243bd-b6fb-4409-96f4-526210ad3256 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:07.177766 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8243bd-b6fb-4409-96f4-526210ad3256 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:07.179755 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8243bd-b6fb-4409-96f4-526210ad3256 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:07.182670 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8b266-b39f-4813-9c6b-5f79d7c30ede None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:07.203924 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 293/589] 10.222.0.50 () {56 vars in 1137 bytes} [Thu Sep 1 13:35:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:07.205357 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8243bd-b6fb-4409-96f4-526210ad3256 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:07.208096 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:07.221544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1012f-0094-4d2a-ba6f-ebac0758bb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:07.222557 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1012f-0094-4d2a-ba6f-ebac0758bb34 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:07.223136 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1012f-0094-4d2a-ba6f-ebac0758bb34 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:07.223645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1012f-0094-4d2a-ba6f-ebac0758bb34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:07.236100 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1012f-0094-4d2a-ba6f-ebac0758bb34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:07.238055 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1012f-0094-4d2a-ba6f-ebac0758bb34 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:07.253732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-cfa1012f-0094-4d2a-ba6f-ebac0758bb34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:07.253732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:07.253732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:07.253732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:07.253732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:07.253732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:07.253732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:07.253732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:07.253732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:07.253732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:07.253732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:07.253732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:07.253732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:07.253732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:07.253732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:07.253732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:07.254794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:07.254794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:07.254794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:07.254794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:07.254794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:07.254794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:07.254794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:07.254794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:07.254794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:07.254794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:07.254794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:07.254794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:07.254794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:07.254794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:07.254794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:07.254794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:07.254794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:07.255689 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:07.255689 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:07.255689 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:07.263665 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 297/590] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:07.264765 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1012f-0094-4d2a-ba6f-ebac0758bb34 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:07.337327 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8243bd-b6fb-4409-96f4-526210ad3256 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:07.359986 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:07.380639 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1012f-0094-4d2a-ba6f-ebac0758bb34 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:07.388188 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df9f47-2865-4562-a83c-8d1f4e81a33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:07.389873 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df9f47-2865-4562-a83c-8d1f4e81a33d None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:07.390369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df9f47-2865-4562-a83c-8d1f4e81a33d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:07.390897 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df9f47-2865-4562-a83c-8d1f4e81a33d None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:07.392257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df9f47-2865-4562-a83c-8d1f4e81a33d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:07.393183 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df9f47-2865-4562-a83c-8d1f4e81a33d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:07.395197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df9f47-2865-4562-a83c-8d1f4e81a33d None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:07.413365 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 294/591] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:07.415841 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df9f47-2865-4562-a83c-8d1f4e81a33d None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:07.420995 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cf03a-43c1-4e39-8ae0-63ee6724c873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:07.421337 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cf03a-43c1-4e39-8ae0-63ee6724c873 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:07.421624 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cf03a-43c1-4e39-8ae0-63ee6724c873 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:07.421897 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cf03a-43c1-4e39-8ae0-63ee6724c873 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:07.434285 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1cf03a-43c1-4e39-8ae0-63ee6724c873 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:07.435911 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1cf03a-43c1-4e39-8ae0-63ee6724c873 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:07.453446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-6d1cf03a-43c1-4e39-8ae0-63ee6724c873 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:07.453446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:07.453446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:07.453446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:07.453446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:07.453446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:07.453446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:07.453446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:07.453446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:07.453446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:07.453446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:07.453446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:07.453446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:07.453446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:07.453446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:07.453446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:07.454446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:07.454446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:07.454446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:07.454446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:07.454446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:07.454446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:07.454446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:07.454446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:07.454446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:07.454446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:07.454446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:07.454446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:07.454446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:07.454446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:07.454446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:07.454446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:07.454446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:07.455293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:07.455293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:07.455293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:07.455293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 298/592] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:07.456355 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cf03a-43c1-4e39-8ae0-63ee6724c873 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:07.488690 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:07.565012 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df9f47-2865-4562-a83c-8d1f4e81a33d None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:07.573033 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cf03a-43c1-4e39-8ae0-63ee6724c873 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:07.616280 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ca160-4fd6-4d7c-b2b5-ff57c85bed3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:07.616836 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23301e94-bd37-44b5-9cff-879ef3537b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:07.617349 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ca160-4fd6-4d7c-b2b5-ff57c85bed3f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:07.617714 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23301e94-bd37-44b5-9cff-879ef3537b42 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:07.617981 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ca160-4fd6-4d7c-b2b5-ff57c85bed3f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:07.618201 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23301e94-bd37-44b5-9cff-879ef3537b42 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:07.618553 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ca160-4fd6-4d7c-b2b5-ff57c85bed3f None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:07.618676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23301e94-bd37-44b5-9cff-879ef3537b42 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:07.619483 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ca160-4fd6-4d7c-b2b5-ff57c85bed3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:07.619943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ca160-4fd6-4d7c-b2b5-ff57c85bed3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:07.621841 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ca160-4fd6-4d7c-b2b5-ff57c85bed3f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:07.627525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23301e94-bd37-44b5-9cff-879ef3537b42 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:07.629217 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23301e94-bd37-44b5-9cff-879ef3537b42 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:07.640975 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 295/593] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:07.641975 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ca160-4fd6-4d7c-b2b5-ff57c85bed3f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:07.648136 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-23301e94-bd37-44b5-9cff-879ef3537b42 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 13:35:07.648136 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:07.648136 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:07.648136 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:07.648136 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:07.648136 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:07.648136 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:07.648136 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:07.648136 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:07.648136 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:07.648136 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:07.648136 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:07.648136 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:35:07.648136 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:35:07.648136 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:35:07.648136 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:35:07.649772 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:07.649772 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:07.649772 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:35:07.649772 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:07.649772 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:35:07.649772 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:07.649772 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:07.649772 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:07.649772 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:07.649772 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:07.649772 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:07.649772 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:07.649772 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:07.649772 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:07.649772 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:07.649772 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:07.649772 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:07.649772 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:07.650820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:07.650820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:07.650820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:35:07.650820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:35:07.650820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:35:07.650820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:35:07.650820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:35:07.650820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:35:07.650820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 13:35:07.650820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:07.653019 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 299/594] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 1 13:35:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:07.653985 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23301e94-bd37-44b5-9cff-879ef3537b42 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:07.690568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:07.763830 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ca160-4fd6-4d7c-b2b5-ff57c85bed3f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:07.777295 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:07.793537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23301e94-bd37-44b5-9cff-879ef3537b42 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:07.802268 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972ca36-4988-467d-ba8b-be3f913e21ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:07.802930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972ca36-4988-467d-ba8b-be3f913e21ac None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:07.803323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972ca36-4988-467d-ba8b-be3f913e21ac None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:07.803755 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972ca36-4988-467d-ba8b-be3f913e21ac None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:07.804650 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0972ca36-4988-467d-ba8b-be3f913e21ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:07.805304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0972ca36-4988-467d-ba8b-be3f913e21ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:07.806817 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0972ca36-4988-467d-ba8b-be3f913e21ac None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:07.823279 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 296/595] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:07.824386 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972ca36-4988-467d-ba8b-be3f913e21ac None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:07.840146 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30324cb8-76d6-4b74-a422-0f96669490e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:07.841081 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30324cb8-76d6-4b74-a422-0f96669490e8 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:07.841502 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30324cb8-76d6-4b74-a422-0f96669490e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:07.841912 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30324cb8-76d6-4b74-a422-0f96669490e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:07.858660 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30324cb8-76d6-4b74-a422-0f96669490e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:07.860693 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30324cb8-76d6-4b74-a422-0f96669490e8 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:07.874419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-30324cb8-76d6-4b74-a422-0f96669490e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:07.874419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:07.874419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:07.874419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:07.874419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:07.874419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:07.874419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:07.874419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:07.874419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:07.874419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:07.874419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:07.874419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:07.874419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:35:07.874419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:35:07.874419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:35:07.875476 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:35:07.875476 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:07.875476 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:07.875476 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:07.875476 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:07.875476 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:07.875476 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:07.875476 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:07.875476 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:07.875476 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:07.875476 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:07.875476 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:07.875476 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:07.875476 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:07.875476 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:07.875476 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:07.875476 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:07.876662 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:35:07.876662 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:35:07.876662 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:35:07.876662 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:35:07.876662 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:35:07.876662 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:35:07.876662 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:07.876662 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:07.879263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 300/596] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:07.879439 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30324cb8-76d6-4b74-a422-0f96669490e8 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:07.953631 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:07.962247 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972ca36-4988-467d-ba8b-be3f913e21ac None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:08.014233 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e1aaa-69f6-49b1-9201-bd116c42fc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:08.014878 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e1aaa-69f6-49b1-9201-bd116c42fc32 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:08.015159 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e1aaa-69f6-49b1-9201-bd116c42fc32 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:08.015644 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e1aaa-69f6-49b1-9201-bd116c42fc32 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:08.016612 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e1aaa-69f6-49b1-9201-bd116c42fc32 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:08.016924 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e1aaa-69f6-49b1-9201-bd116c42fc32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:08.019316 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e1aaa-69f6-49b1-9201-bd116c42fc32 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:08.022361 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30324cb8-76d6-4b74-a422-0f96669490e8 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:08.047782 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 297/597] 10.222.0.50 () {56 vars in 1139 bytes} [Thu Sep 1 13:35:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:08.048734 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e1aaa-69f6-49b1-9201-bd116c42fc32 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:08.072516 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a738a-6176-4101-89af-8edae30b8e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:08.073799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a738a-6176-4101-89af-8edae30b8e33 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:08.074242 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a738a-6176-4101-89af-8edae30b8e33 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:08.074675 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a738a-6176-4101-89af-8edae30b8e33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:08.084971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a738a-6176-4101-89af-8edae30b8e33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:08.087522 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a738a-6176-4101-89af-8edae30b8e33 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:08.100847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-592a738a-6176-4101-89af-8edae30b8e33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:08.100847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:08.100847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:08.100847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:08.100847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:08.100847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:08.100847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:08.100847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:08.100847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:08.100847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:08.100847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:08.100847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:08.100847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:35:08.100847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:35:08.100847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:35:08.101975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:35:08.101975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:08.101975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:08.101975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:08.101975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:08.101975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:08.101975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:08.101975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:08.101975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:08.101975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:08.101975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:08.101975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:08.101975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:08.101975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:08.101975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:08.101975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:08.101975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:08.104190 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:35:08.104190 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:35:08.104190 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:35:08.104190 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:35:08.104190 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:35:08.104190 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:35:08.104190 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:08.104190 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:08.104190 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 301/598] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:08.104190 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a738a-6176-4101-89af-8edae30b8e33 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:08.114692 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:08.176298 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e1aaa-69f6-49b1-9201-bd116c42fc32 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:08.208189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a738a-6176-4101-89af-8edae30b8e33 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:08.216157 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08afc1-afdc-4119-9c2b-cce7458cdc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:08.217024 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08afc1-afdc-4119-9c2b-cce7458cdc4f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:08.217556 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08afc1-afdc-4119-9c2b-cce7458cdc4f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:08.218004 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08afc1-afdc-4119-9c2b-cce7458cdc4f None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:08.219042 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08afc1-afdc-4119-9c2b-cce7458cdc4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:08.219531 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08afc1-afdc-4119-9c2b-cce7458cdc4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:08.221164 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08afc1-afdc-4119-9c2b-cce7458cdc4f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:08.239868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 298/599] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:35:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:08.241107 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08afc1-afdc-4119-9c2b-cce7458cdc4f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:08.243681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a320440-ebae-4495-ab02-c244a0b663e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:08.244312 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a320440-ebae-4495-ab02-c244a0b663e1 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:08.244585 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a320440-ebae-4495-ab02-c244a0b663e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:08.244853 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a320440-ebae-4495-ab02-c244a0b663e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:08.256067 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a320440-ebae-4495-ab02-c244a0b663e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:08.257546 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a320440-ebae-4495-ab02-c244a0b663e1 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:08.261124 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:08.273040 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-7a320440-ebae-4495-ab02-c244a0b663e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:08.273040 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:08.273040 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:08.273040 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:08.273040 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:08.273040 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:08.273040 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:08.273040 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:08.273040 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:08.273040 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:08.273040 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:08.273040 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:08.273040 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:08.273040 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:08.273040 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:08.273040 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:08.276996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:08.276996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:08.276996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:08.276996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:08.276996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:08.276996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:08.276996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:08.276996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:08.276996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:08.276996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:08.276996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:08.276996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:08.276996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:08.276996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:08.276996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:08.276996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:08.276996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:08.277993 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:08.277993 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:08.277993 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:08.277993 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 302/600] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:08.277993 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a320440-ebae-4495-ab02-c244a0b663e1 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:08.341526 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:08.364312 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08afc1-afdc-4119-9c2b-cce7458cdc4f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:08.383917 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a320440-ebae-4495-ab02-c244a0b663e1 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:08.403642 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb71f8-c9a1-43ec-b694-9364ab0f119b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:08.404624 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb71f8-c9a1-43ec-b694-9364ab0f119b None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:08.405062 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb71f8-c9a1-43ec-b694-9364ab0f119b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:08.405495 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb71f8-c9a1-43ec-b694-9364ab0f119b None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:08.406353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb71f8-c9a1-43ec-b694-9364ab0f119b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:08.406931 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb71f8-c9a1-43ec-b694-9364ab0f119b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:08.408675 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb71f8-c9a1-43ec-b694-9364ab0f119b None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:08.418756 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202642d-0684-45ae-9fb7-a738b0c023ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:08.419440 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202642d-0684-45ae-9fb7-a738b0c023ec None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:08.419715 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202642d-0684-45ae-9fb7-a738b0c023ec None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:08.420317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202642d-0684-45ae-9fb7-a738b0c023ec None admin] PATH_INFO: `/v3/projects/6283121e17814cd792df9d0edf81bf2d/users/1dc5b80f0e4c48189389d23507a9d2ec/roles/f8c77ddd17fd4bc7af83e8d8905fb404` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:08.423725 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 299/601] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:35:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:08.429587 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb71f8-c9a1-43ec-b694-9364ab0f119b None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:08.437184 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202642d-0684-45ae-9fb7-a738b0c023ec None admin] RBAC: Authorizing `identity:create_grant(project_id=6283121e17814cd792df9d0edf81bf2d, user_id=1dc5b80f0e4c48189389d23507a9d2ec, role_id=f8c77ddd17fd4bc7af83e8d8905fb404)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:08.438637 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202642d-0684-45ae-9fb7-a738b0c023ec None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:08.505339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:08.531621 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 303/602] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 1 13:35:08 2022] PUT /identity/v3/projects/6283121e17814cd792df9d0edf81bf2d/users/1dc5b80f0e4c48189389d23507a9d2ec/roles/f8c77ddd17fd4bc7af83e8d8905fb404 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:35:08.533096 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202642d-0684-45ae-9fb7-a738b0c023ec None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:08.553423 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb71f8-c9a1-43ec-b694-9364ab0f119b None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:08.605450 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402dbe3-d3ad-451e-9633-c6af647b338f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:08.606597 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402dbe3-d3ad-451e-9633-c6af647b338f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:08.607460 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402dbe3-d3ad-451e-9633-c6af647b338f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:08.607955 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402dbe3-d3ad-451e-9633-c6af647b338f None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:08.609603 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402dbe3-d3ad-451e-9633-c6af647b338f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:08.610462 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402dbe3-d3ad-451e-9633-c6af647b338f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:08.612960 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402dbe3-d3ad-451e-9633-c6af647b338f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:08.637012 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 300/603] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:08.637245 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dc1d2-11c2-418b-8af9-835eae8d2b86 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:08.637851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dc1d2-11c2-418b-8af9-835eae8d2b86 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:08.637851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dc1d2-11c2-418b-8af9-835eae8d2b86 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:08.641752 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 301/604] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:08.643806 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dc1d2-11c2-418b-8af9-835eae8d2b86 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:08.674619 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202642d-0684-45ae-9fb7-a738b0c023ec None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:08.690747 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:08.728938 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c49cf4-ac0a-4fe9-a4a5-327a04cfb4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:08.730300 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c49cf4-ac0a-4fe9-a4a5-327a04cfb4f1 None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:08.731074 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c49cf4-ac0a-4fe9-a4a5-327a04cfb4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:08.732290 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c49cf4-ac0a-4fe9-a4a5-327a04cfb4f1 None admin] PATH_INFO: `/v3/projects/6283121e17814cd792df9d0edf81bf2d/users/fc11fe25135d4bf1b1a06b8619e4a2e0/roles/f8c77ddd17fd4bc7af83e8d8905fb404` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:08.753349 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c49cf4-ac0a-4fe9-a4a5-327a04cfb4f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=6283121e17814cd792df9d0edf81bf2d, user_id=fc11fe25135d4bf1b1a06b8619e4a2e0, role_id=f8c77ddd17fd4bc7af83e8d8905fb404)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:08.755785 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c49cf4-ac0a-4fe9-a4a5-327a04cfb4f1 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:08.779234 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dc1d2-11c2-418b-8af9-835eae8d2b86 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:08.811064 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:08.816204 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff2276-bbab-4cbc-b855-3fca9025b5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:08.816960 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff2276-bbab-4cbc-b855-3fca9025b5e7 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:08.817314 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff2276-bbab-4cbc-b855-3fca9025b5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:08.817668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff2276-bbab-4cbc-b855-3fca9025b5e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:08.825148 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff2276-bbab-4cbc-b855-3fca9025b5e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:08.830475 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff2276-bbab-4cbc-b855-3fca9025b5e7 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:08.838661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-b7ff2276-bbab-4cbc-b855-3fca9025b5e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:08.838661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:08.838661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:08.838661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:08.838661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:08.838661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:08.838661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:08.838661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:08.838661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:08.838661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:08.838661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:08.838661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:08.838661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:35:08.838661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:35:08.838661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:35:08.839809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:35:08.839809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:08.839809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:08.839809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:08.839809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:08.839809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:08.839809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:08.839809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:08.839809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:08.839809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:08.839809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:08.839809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:08.839809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:08.839809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:08.839809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:08.839809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:08.839809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:08.840842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:35:08.840842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:35:08.840842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:35:08.840842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:35:08.840842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:35:08.840842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:35:08.840842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:08.840842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:08.841382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 302/605] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:08.849041 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4217b6-4a0d-4c14-9215-19b901832168 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:08.849041 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4217b6-4a0d-4c14-9215-19b901832168 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:08.849041 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4217b6-4a0d-4c14-9215-19b901832168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:08.862822 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 304/606] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 1 13:35:08 2022] PUT /identity/v3/projects/6283121e17814cd792df9d0edf81bf2d/users/fc11fe25135d4bf1b1a06b8619e4a2e0/roles/f8c77ddd17fd4bc7af83e8d8905fb404 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:35:08.868886 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-bc4217b6-4a0d-4c14-9215-19b901832168 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:08.870531 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-bc4217b6-4a0d-4c14-9215-19b901832168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:08.871129 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c49cf4-ac0a-4fe9-a4a5-327a04cfb4f1 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:08.963978 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 303/607] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:35:08.965335 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aac169-67c1-46e6-8a7f-5ee7e3468d00 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:08.965624 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aac169-67c1-46e6-8a7f-5ee7e3468d00 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:08.965901 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aac169-67c1-46e6-8a7f-5ee7e3468d00 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:08.972020 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 304/608] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:08.973650 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a986b11-2f43-4bcf-b56b-b7b0c96ac27a None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:08.973989 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a986b11-2f43-4bcf-b56b-b7b0c96ac27a None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:08.974270 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a986b11-2f43-4bcf-b56b-b7b0c96ac27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:09.003811 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-3a986b11-2f43-4bcf-b56b-b7b0c96ac27a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:09.005102 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-3a986b11-2f43-4bcf-b56b-b7b0c96ac27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:09.049699 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c49cf4-ac0a-4fe9-a4a5-327a04cfb4f1 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:09.095673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6ddcb-14a7-4396-a4b8-26e556dd637b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:09.096294 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6ddcb-14a7-4396-a4b8-26e556dd637b None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:09.096609 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6ddcb-14a7-4396-a4b8-26e556dd637b None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:09.096905 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6ddcb-14a7-4396-a4b8-26e556dd637b None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:09.098425 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6ddcb-14a7-4396-a4b8-26e556dd637b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:09.098425 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6ddcb-14a7-4396-a4b8-26e556dd637b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:09.099986 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6ddcb-14a7-4396-a4b8-26e556dd637b None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:09.103722 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 305/609] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:35:09.114911 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 305/610] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:35:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:09.124870 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a986b11-2f43-4bcf-b56b-b7b0c96ac27a None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:09.189557 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:09.252589 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a986b11-2f43-4bcf-b56b-b7b0c96ac27a None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:09.287948 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3d95a-5683-4ec8-8a50-d7616fa386c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:09.288705 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3d95a-5683-4ec8-8a50-d7616fa386c3 None admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:09.288999 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3d95a-5683-4ec8-8a50-d7616fa386c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:09.289257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3d95a-5683-4ec8-8a50-d7616fa386c3 None admin] PATH_INFO: `/v3/projects/6283121e17814cd792df9d0edf81bf2d/users/72f0d372f6c34d1a9a990222d6b98948/roles/f8c77ddd17fd4bc7af83e8d8905fb404` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:09.304780 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3d95a-5683-4ec8-8a50-d7616fa386c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=6283121e17814cd792df9d0edf81bf2d, user_id=72f0d372f6c34d1a9a990222d6b98948, role_id=f8c77ddd17fd4bc7af83e8d8905fb404)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:09.306818 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3d95a-5683-4ec8-8a50-d7616fa386c3 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:09.378056 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6ddcb-14a7-4396-a4b8-26e556dd637b None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:09.406490 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:09.409625 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 306/611] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 1 13:35:09 2022] PUT /identity/v3/projects/6283121e17814cd792df9d0edf81bf2d/users/72f0d372f6c34d1a9a990222d6b98948/roles/f8c77ddd17fd4bc7af83e8d8905fb404 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:35:09.411743 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3d95a-5683-4ec8-8a50-d7616fa386c3 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:09.572688 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6ddcb-14a7-4396-a4b8-26e556dd637b None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:09.600741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3d95a-5683-4ec8-8a50-d7616fa386c3 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:09.607638 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:09.630029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fb36d-c63e-4922-a224-41d6ae5d1d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:09.631162 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fb36d-c63e-4922-a224-41d6ae5d1d5b None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:09.631596 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fb36d-c63e-4922-a224-41d6ae5d1d5b None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:09.631976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fb36d-c63e-4922-a224-41d6ae5d1d5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:09.645638 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22fb36d-c63e-4922-a224-41d6ae5d1d5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:35:09.646282 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4329e38-3da0-4d91-91cb-7061c28a9960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:09.647183 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4329e38-3da0-4d91-91cb-7061c28a9960 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:09.647652 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4329e38-3da0-4d91-91cb-7061c28a9960 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:09.648091 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4329e38-3da0-4d91-91cb-7061c28a9960 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:09.651867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-c22fb36d-c63e-4922-a224-41d6ae5d1d5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:35:09.651867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:09.651867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:09.651867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:09.651867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:09.651867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:09.651867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:09.651867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:09.651867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:09.651867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:09.651867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:09.651867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:09.651867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:35:09.651867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:35:09.651867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:35:09.651867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:35:09.652954 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:35:09.652954 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:35:09.652954 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:35:09.652954 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:35:09.652954 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:09.652954 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:09.652954 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:09.652954 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:09.652954 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:09.652954 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:09.652954 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:09.652954 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:09.652954 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:09.652954 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:09.652954 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:09.652954 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:09.653981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:09.653981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:09.653981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:09.653981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:09.653981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:35:09.653981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:35:09.653981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:35:09.653981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:35:09.653981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:35:09.653981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:35:09.653981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:35:09.653981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:09.656850 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 306/612] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 1 13:35:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:35:09.662064 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fb36d-c63e-4922-a224-41d6ae5d1d5b None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:09.667811 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4329e38-3da0-4d91-91cb-7061c28a9960 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:35:09.673469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-d4329e38-3da0-4d91-91cb-7061c28a9960 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:35:09.673469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:09.673469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:09.673469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:09.673469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:09.673469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:09.673469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:09.673469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:09.673469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:09.673469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:09.673469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:09.673469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:09.673469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:35:09.673469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:35:09.673469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:35:09.673469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:35:09.674369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:35:09.674369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:35:09.674369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:35:09.674369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:35:09.674369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:09.674369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:09.674369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:09.674369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:09.674369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:09.674369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:09.674369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:09.674369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:09.674369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:09.674369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:09.674369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:09.674369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:09.675225 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:09.675225 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:09.675225 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:09.675225 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:09.675225 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:35:09.675225 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:35:09.675225 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:35:09.675225 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:35:09.675225 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:35:09.675225 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:35:09.675225 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:35:09.675225 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:09.677610 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 307/613] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 1 13:35:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:09.683411 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4329e38-3da0-4d91-91cb-7061c28a9960 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:09.789865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:09.816060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4329e38-3da0-4d91-91cb-7061c28a9960 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:09.858129 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fb36d-c63e-4922-a224-41d6ae5d1d5b None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:09.863884 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22bad7-915a-4ac5-a61b-237df2c35fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:09.864727 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22bad7-915a-4ac5-a61b-237df2c35fcf None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:09.865166 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22bad7-915a-4ac5-a61b-237df2c35fcf None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:09.865602 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22bad7-915a-4ac5-a61b-237df2c35fcf None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:09.866416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22bad7-915a-4ac5-a61b-237df2c35fcf None admin] RBAC: Adding query filter params (name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:09.871936 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22bad7-915a-4ac5-a61b-237df2c35fcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:09.873524 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22bad7-915a-4ac5-a61b-237df2c35fcf None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:09.888901 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 308/614] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 1 13:35:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:35:09.895417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22bad7-915a-4ac5-a61b-237df2c35fcf None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:09.935481 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bfb3e-1f20-4cf9-8e3b-f65f4cbb5d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:09.939734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bfb3e-1f20-4cf9-8e3b-f65f4cbb5d0d None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:09.940194 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bfb3e-1f20-4cf9-8e3b-f65f4cbb5d0d None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:09.940614 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bfb3e-1f20-4cf9-8e3b-f65f4cbb5d0d None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:09.941443 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299bfb3e-1f20-4cf9-8e3b-f65f4cbb5d0d None admin] RBAC: Adding query filter params (name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:09.941892 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299bfb3e-1f20-4cf9-8e3b-f65f4cbb5d0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:09.943534 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299bfb3e-1f20-4cf9-8e3b-f65f4cbb5d0d None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:09.950633 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:09.964963 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 307/615] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 1 13:35:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:35:09.973482 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bfb3e-1f20-4cf9-8e3b-f65f4cbb5d0d None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:10.080936 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22bad7-915a-4ac5-a61b-237df2c35fcf None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:10.130052 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd8259-5f1d-4b16-a34e-03fd43e4d3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:10.130783 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd8259-5f1d-4b16-a34e-03fd43e4d3a1 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:10.130783 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd8259-5f1d-4b16-a34e-03fd43e4d3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:10.131165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd8259-5f1d-4b16-a34e-03fd43e4d3a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:10.143845 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd8259-5f1d-4b16-a34e-03fd43e4d3a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:10.145740 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd8259-5f1d-4b16-a34e-03fd43e4d3a1 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:10.164256 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-76cd8259-5f1d-4b16-a34e-03fd43e4d3a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:10.164256 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:10.164256 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:10.164256 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:10.164256 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:10.164256 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:10.164256 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:10.164256 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:10.164256 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:10.164256 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:10.164256 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:10.164256 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:10.164256 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:10.164256 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:10.164256 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:10.164256 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:10.165372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:10.165372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:10.165372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:10.165372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:10.165372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:10.165372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:10.165372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:10.165372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:10.165372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:10.165372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:10.165372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:10.165372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:10.165372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:10.165372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:10.165372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:10.165372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:10.165372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:10.166222 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:10.166222 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:10.166222 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:10.166222 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 309/616] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:10.173620 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd8259-5f1d-4b16-a34e-03fd43e4d3a1 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:10.176549 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bfb3e-1f20-4cf9-8e3b-f65f4cbb5d0d None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:10.252781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a55ca-3069-48cf-866e-4ce2a7215655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:10.253787 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a55ca-3069-48cf-866e-4ce2a7215655 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:10.254256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a55ca-3069-48cf-866e-4ce2a7215655 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:10.254715 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a55ca-3069-48cf-866e-4ce2a7215655 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:10.273153 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a55ca-3069-48cf-866e-4ce2a7215655 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:10.275397 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a55ca-3069-48cf-866e-4ce2a7215655 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:10.277483 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:10.292730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-ff1a55ca-3069-48cf-866e-4ce2a7215655 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:10.292730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:10.292730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:10.292730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:10.292730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:10.292730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:10.292730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:10.292730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:10.292730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:10.292730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:10.292730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:10.292730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:10.292730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:10.292730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:10.292730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:10.292730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:10.301570 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:10.301570 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:10.301570 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:10.301570 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:10.301570 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:10.301570 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:10.301570 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:10.301570 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:10.301570 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:10.301570 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:10.301570 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:10.301570 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:10.301570 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:10.301570 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:10.301570 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:10.301570 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:10.301570 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:10.302625 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:10.302625 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:10.302625 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:10.302625 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 308/617] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:10.303878 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a55ca-3069-48cf-866e-4ce2a7215655 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:10.363761 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:10.401346 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd8259-5f1d-4b16-a34e-03fd43e4d3a1 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:10.439170 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a64640-fe8b-435a-9f68-0bc7aaa65094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:10.439836 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a64640-fe8b-435a-9f68-0bc7aaa65094 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:10.440103 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a64640-fe8b-435a-9f68-0bc7aaa65094 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:10.440372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a64640-fe8b-435a-9f68-0bc7aaa65094 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:10.441189 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a64640-fe8b-435a-9f68-0bc7aaa65094 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:10.441855 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a64640-fe8b-435a-9f68-0bc7aaa65094 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:10.443282 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a64640-fe8b-435a-9f68-0bc7aaa65094 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:10.456659 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 310/618] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:10.462435 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a64640-fe8b-435a-9f68-0bc7aaa65094 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:10.577570 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a64640-fe8b-435a-9f68-0bc7aaa65094 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:10.583887 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a55ca-3069-48cf-866e-4ce2a7215655 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:10.614998 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b8ffa-6aed-4e28-9f8b-8134fe70e0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:10.615684 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b8ffa-6aed-4e28-9f8b-8134fe70e0bc None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:10.615966 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b8ffa-6aed-4e28-9f8b-8134fe70e0bc None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:10.616244 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b8ffa-6aed-4e28-9f8b-8134fe70e0bc None admin] PATH_INFO: `/v3/users/nova` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:10.624874 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b8ffa-6aed-4e28-9f8b-8134fe70e0bc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:10.626378 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b8ffa-6aed-4e28-9f8b-8134fe70e0bc None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:10.633681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824452c9-9758-46fd-b9c1-ac1afdf3b7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:10.634291 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824452c9-9758-46fd-b9c1-ac1afdf3b7db None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:10.634579 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824452c9-9758-46fd-b9c1-ac1afdf3b7db None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:10.634856 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824452c9-9758-46fd-b9c1-ac1afdf3b7db None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:10.635536 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824452c9-9758-46fd-b9c1-ac1afdf3b7db None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:10.635843 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824452c9-9758-46fd-b9c1-ac1afdf3b7db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:10.637213 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824452c9-9758-46fd-b9c1-ac1afdf3b7db None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:10.638781 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-099b8ffa-6aed-4e28-9f8b-8134fe70e0bc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:35:10.638781 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:10.638781 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:10.638781 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:10.638781 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:10.638781 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:10.638781 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:10.638781 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:10.638781 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:10.638781 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:10.638781 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:10.638781 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:10.638781 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:35:10.638781 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:35:10.638781 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:35:10.638781 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:35:10.639741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:10.639741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:10.639741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:35:10.639741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:10.639741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:35:10.639741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:10.639741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:10.639741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:10.639741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:10.639741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:10.639741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:10.639741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:10.639741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:10.639741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:10.639741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:10.639741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:10.639741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:10.639741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:10.640664 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:10.640664 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:10.640664 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:35:10.640664 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:35:10.640664 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:35:10.640664 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:35:10.640664 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:35:10.640664 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:35:10.640664 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:35:10.640664 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:10.640664 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 311/619] 10.222.0.50 () {56 vars in 1093 bytes} [Thu Sep 1 13:35:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:10.643151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:10.645838 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b8ffa-6aed-4e28-9f8b-8134fe70e0bc None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:10.650530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 309/620] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:10.656128 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824452c9-9758-46fd-b9c1-ac1afdf3b7db None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:10.719840 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:10.765199 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b8ffa-6aed-4e28-9f8b-8134fe70e0bc None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:10.768594 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824452c9-9758-46fd-b9c1-ac1afdf3b7db None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:10.810491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032bb31-14a3-4bea-aec8-a6958d3ec591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:10.811868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032bb31-14a3-4bea-aec8-a6958d3ec591 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:10.812585 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032bb31-14a3-4bea-aec8-a6958d3ec591 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:10.813160 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032bb31-14a3-4bea-aec8-a6958d3ec591 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:10.816509 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8f25f-239f-4899-a99b-e40e6559a338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:10.817331 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8f25f-239f-4899-a99b-e40e6559a338 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:10.817499 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8f25f-239f-4899-a99b-e40e6559a338 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:10.817885 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8f25f-239f-4899-a99b-e40e6559a338 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:10.818701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8f25f-239f-4899-a99b-e40e6559a338 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:10.819084 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8f25f-239f-4899-a99b-e40e6559a338 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:10.820749 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8f25f-239f-4899-a99b-e40e6559a338 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:10.823661 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032bb31-14a3-4bea-aec8-a6958d3ec591 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:10.826226 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032bb31-14a3-4bea-aec8-a6958d3ec591 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:10.846201 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 312/621] 10.222.0.50 () {56 vars in 1133 bytes} [Thu Sep 1 13:35:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:10.852588 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e14218-cf4f-4779-9cbb-f2e70a1241e7 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:10.852994 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e14218-cf4f-4779-9cbb-f2e70a1241e7 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:10.853648 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e14218-cf4f-4779-9cbb-f2e70a1241e7 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:10.855984 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 313/622] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:10.857160 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e14218-cf4f-4779-9cbb-f2e70a1241e7 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:10.860553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-7032bb31-14a3-4bea-aec8-a6958d3ec591 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 13:35:10.860553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:10.860553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:10.860553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:10.860553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:10.860553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:10.860553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:10.860553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:10.860553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:10.860553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:10.860553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:10.860553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:10.860553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:35:10.860553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:35:10.860553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:35:10.860553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:35:10.861460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:10.861460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:10.861460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:35:10.861460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:10.861460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:35:10.861460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:10.861460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:10.861460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:10.861460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:10.861460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:10.861460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:10.861460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:10.861460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:10.861460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:10.861460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:10.861460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:10.861460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:10.861460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:10.862371 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:10.862371 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:10.862371 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:35:10.862371 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:35:10.862371 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:35:10.862371 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:35:10.862371 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:35:10.862371 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:35:10.862371 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 13:35:10.862371 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:10.864924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 310/623] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:35:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:10.868529 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbc3e9-ab86-4a26-be26-fb38822d5e18 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:10.869277 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbc3e9-ab86-4a26-be26-fb38822d5e18 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:10.869711 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbc3e9-ab86-4a26-be26-fb38822d5e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:10.893955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-02dbc3e9-ab86-4a26-be26-fb38822d5e18 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:10.896010 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-02dbc3e9-ab86-4a26-be26-fb38822d5e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:10.923944 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:10.976531 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e14218-cf4f-4779-9cbb-f2e70a1241e7 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:10.983576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 311/624] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:35:10.984649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbc3e9-ab86-4a26-be26-fb38822d5e18 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:11.026186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17f5d3-dd50-4d0f-9a84-423e2f4852d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:11.027054 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17f5d3-dd50-4d0f-9a84-423e2f4852d5 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:11.027514 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17f5d3-dd50-4d0f-9a84-423e2f4852d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:11.027937 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17f5d3-dd50-4d0f-9a84-423e2f4852d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:11.037257 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:11.102316 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbc3e9-ab86-4a26-be26-fb38822d5e18 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:11.119125 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17f5d3-dd50-4d0f-9a84-423e2f4852d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:11.121718 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17f5d3-dd50-4d0f-9a84-423e2f4852d5 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:11.144403 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadb931-85ef-46d1-8428-5eb10e39fded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:11.146932 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadb931-85ef-46d1-8428-5eb10e39fded None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:11.146932 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadb931-85ef-46d1-8428-5eb10e39fded None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:11.146932 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadb931-85ef-46d1-8428-5eb10e39fded None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:11.146932 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dadb931-85ef-46d1-8428-5eb10e39fded None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:11.147240 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dadb931-85ef-46d1-8428-5eb10e39fded None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:11.149029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dadb931-85ef-46d1-8428-5eb10e39fded None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:11.169688 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 312/625] 10.222.0.50 () {56 vars in 1135 bytes} [Thu Sep 1 13:35:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:11.171180 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c7103-d52c-4e06-a7f0-d144ab764390 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:11.171638 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c7103-d52c-4e06-a7f0-d144ab764390 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:11.172022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c7103-d52c-4e06-a7f0-d144ab764390 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:11.173691 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 313/626] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:11.192395 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c1ca5-84dc-43d3-95b9-148484f96607 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:11.192395 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c1ca5-84dc-43d3-95b9-148484f96607 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:11.192395 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c1ca5-84dc-43d3-95b9-148484f96607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:11.199196 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:11.211540 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-c74c1ca5-84dc-43d3-95b9-148484f96607 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:11.218434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c74c1ca5-84dc-43d3-95b9-148484f96607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:11.261390 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 314/627] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:35:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:35:11.262654 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17f5d3-dd50-4d0f-9a84-423e2f4852d5 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:11.307444 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 314/628] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:35:11.310337 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c1ca5-84dc-43d3-95b9-148484f96607 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:11.370387 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:11.407307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17f5d3-dd50-4d0f-9a84-423e2f4852d5 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:11.451631 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c1ca5-84dc-43d3-95b9-148484f96607 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:11.453768 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee3d4b-3989-43f7-a4d2-d30ff3deed38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:11.455987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee3d4b-3989-43f7-a4d2-d30ff3deed38 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:11.456467 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee3d4b-3989-43f7-a4d2-d30ff3deed38 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:11.456920 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee3d4b-3989-43f7-a4d2-d30ff3deed38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:11.473762 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee3d4b-3989-43f7-a4d2-d30ff3deed38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:11.475559 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee3d4b-3989-43f7-a4d2-d30ff3deed38 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:11.492816 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc67964-425c-4f20-9e9c-5fe8e4ba119a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:11.493663 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc67964-425c-4f20-9e9c-5fe8e4ba119a None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:11.494035 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc67964-425c-4f20-9e9c-5fe8e4ba119a None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:11.494418 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc67964-425c-4f20-9e9c-5fe8e4ba119a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:11.499111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-3dee3d4b-3989-43f7-a4d2-d30ff3deed38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:11.499111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:11.499111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:11.499111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:11.499111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:11.499111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:11.499111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:11.499111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:11.499111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:11.499111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:11.499111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:11.499111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:11.499111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:11.499111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:11.499111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:11.499111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:11.500194 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:11.500194 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:11.500194 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:11.500194 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:11.500194 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:11.500194 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:11.500194 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:11.500194 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:11.500194 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:11.500194 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:11.500194 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:11.500194 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:11.500194 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:11.500194 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:11.500194 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:11.500194 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:11.500194 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:11.501287 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:11.501287 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:11.501287 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:11.503108 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 315/629] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:11.504709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee3d4b-3989-43f7-a4d2-d30ff3deed38 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:11.508924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc67964-425c-4f20-9e9c-5fe8e4ba119a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:11.511095 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc67964-425c-4f20-9e9c-5fe8e4ba119a None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:11.517412 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:11.527734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-7dc67964-425c-4f20-9e9c-5fe8e4ba119a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:11.527734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:11.527734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:11.527734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:11.527734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:11.527734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:11.527734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:11.527734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:11.527734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:11.527734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:11.527734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:11.527734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:11.527734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:11.527734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:11.527734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:11.527734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:11.533520 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:11.533520 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:11.533520 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:11.533520 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:11.533520 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:11.533520 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:11.533520 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:11.533520 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:11.533520 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:11.533520 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:11.533520 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:11.533520 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:11.533520 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:11.533520 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:11.533520 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:11.533520 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:11.533520 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:11.534508 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:11.534508 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:11.534508 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:11.534865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 315/630] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:11.535903 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc67964-425c-4f20-9e9c-5fe8e4ba119a None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:11.627282 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee3d4b-3989-43f7-a4d2-d30ff3deed38 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:11.647537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:11.663916 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1272454-9235-420b-8652-a1c76fe8392b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:11.664291 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc67964-425c-4f20-9e9c-5fe8e4ba119a None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:11.664628 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1272454-9235-420b-8652-a1c76fe8392b None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:11.664911 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1272454-9235-420b-8652-a1c76fe8392b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:11.665227 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1272454-9235-420b-8652-a1c76fe8392b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:11.676870 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1272454-9235-420b-8652-a1c76fe8392b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:35:11.682737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-b1272454-9235-420b-8652-a1c76fe8392b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:35:11.682737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:11.682737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:11.682737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:11.682737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:11.682737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:11.682737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:11.682737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:11.682737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:11.682737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:11.682737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:11.682737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:11.682737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:35:11.682737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:35:11.682737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:35:11.682737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:35:11.684144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:35:11.684144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:35:11.684144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:35:11.684144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:35:11.684144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:11.684144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:11.684144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:11.684144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:11.684144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:11.684144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:11.684144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:11.684144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:11.684144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:11.684144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:11.684144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:11.684144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:11.684973 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:11.684973 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:11.684973 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:11.684973 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:11.684973 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:35:11.684973 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:35:11.684973 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:35:11.684973 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:35:11.684973 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:35:11.684973 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:35:11.684973 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:35:11.684973 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:11.688662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 316/631] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 1 13:35:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:11.689610 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1272454-9235-420b-8652-a1c76fe8392b None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:11.700921 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2242572-82b4-45fa-a3a0-1a601f0d91f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:11.701534 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2242572-82b4-45fa-a3a0-1a601f0d91f7 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:11.701876 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2242572-82b4-45fa-a3a0-1a601f0d91f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:11.702094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2242572-82b4-45fa-a3a0-1a601f0d91f7 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:11.702742 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2242572-82b4-45fa-a3a0-1a601f0d91f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:11.703051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2242572-82b4-45fa-a3a0-1a601f0d91f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:11.704469 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2242572-82b4-45fa-a3a0-1a601f0d91f7 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:11.716841 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 316/632] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:11.722140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2242572-82b4-45fa-a3a0-1a601f0d91f7 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:11.762929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:11.807600 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1272454-9235-420b-8652-a1c76fe8392b None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:11.826596 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2242572-82b4-45fa-a3a0-1a601f0d91f7 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:11.841835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2aeb75-3830-495e-9314-ce0748e34281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:11.842479 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2aeb75-3830-495e-9314-ce0748e34281 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:11.842769 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2aeb75-3830-495e-9314-ce0748e34281 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:11.843043 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2aeb75-3830-495e-9314-ce0748e34281 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:11.843724 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2aeb75-3830-495e-9314-ce0748e34281 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:11.844039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2aeb75-3830-495e-9314-ce0748e34281 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:11.845441 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2aeb75-3830-495e-9314-ce0748e34281 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:11.859076 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 317/633] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:11.859934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2aeb75-3830-495e-9314-ce0748e34281 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:11.868489 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918028c5-0840-4d45-a9bf-d89c21d72473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:11.869119 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918028c5-0840-4d45-a9bf-d89c21d72473 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:11.869405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918028c5-0840-4d45-a9bf-d89c21d72473 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:11.869704 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918028c5-0840-4d45-a9bf-d89c21d72473 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:11.879918 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918028c5-0840-4d45-a9bf-d89c21d72473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:35:11.885833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-918028c5-0840-4d45-a9bf-d89c21d72473 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:35:11.885833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:11.885833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:11.885833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:11.885833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:11.885833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:11.885833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:11.885833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:11.885833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:11.885833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:11.885833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:11.885833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:11.885833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:35:11.885833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:35:11.885833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:35:11.885833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:35:11.886741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:35:11.886741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:35:11.886741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:35:11.886741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:35:11.886741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:11.886741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:11.886741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:11.886741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:11.886741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:11.886741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:11.886741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:11.886741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:11.886741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:11.886741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:11.886741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:11.886741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:11.887580 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:11.887580 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:11.887580 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:11.887580 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:11.887580 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:35:11.887580 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:35:11.887580 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:35:11.887580 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:35:11.887580 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:35:11.887580 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:35:11.887580 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:35:11.887580 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:11.887580 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 317/634] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 1 13:35:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:11.888261 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918028c5-0840-4d45-a9bf-d89c21d72473 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:11.894356 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:11.959445 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2aeb75-3830-495e-9314-ce0748e34281 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:11.985693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:11.991342 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918028c5-0840-4d45-a9bf-d89c21d72473 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:11.994760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cb3d3-48e9-42b9-8973-c9f71d7d3711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:11.995407 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cb3d3-48e9-42b9-8973-c9f71d7d3711 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:11.995693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cb3d3-48e9-42b9-8973-c9f71d7d3711 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:12.002382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cb3d3-48e9-42b9-8973-c9f71d7d3711 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:12.002382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95cb3d3-48e9-42b9-8973-c9f71d7d3711 None admin] RBAC: Adding query filter params (name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:12.002382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95cb3d3-48e9-42b9-8973-c9f71d7d3711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:12.002382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95cb3d3-48e9-42b9-8973-c9f71d7d3711 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:12.006666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 318/635] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 1 13:35:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:12.009207 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d471b-b958-4255-9b7f-b1caf5928e82 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:12.009603 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d471b-b958-4255-9b7f-b1caf5928e82 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:12.009879 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d471b-b958-4255-9b7f-b1caf5928e82 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:12.011297 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 319/636] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:12.015863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d471b-b958-4255-9b7f-b1caf5928e82 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:12.028064 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862aa9e-933c-41b7-8d3e-24302625091e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:12.028688 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862aa9e-933c-41b7-8d3e-24302625091e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:12.028972 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862aa9e-933c-41b7-8d3e-24302625091e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:12.029242 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862aa9e-933c-41b7-8d3e-24302625091e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:12.035846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862aa9e-933c-41b7-8d3e-24302625091e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:12.037289 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862aa9e-933c-41b7-8d3e-24302625091e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:12.048343 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-d862aa9e-933c-41b7-8d3e-24302625091e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:12.048343 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:12.048343 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:12.048343 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:12.048343 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:12.048343 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:12.048343 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:12.048343 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:12.048343 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:12.048343 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:12.048343 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:12.048343 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:12.048343 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:35:12.048343 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:35:12.048343 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:35:12.049318 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:35:12.049318 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:12.049318 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:12.049318 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:12.049318 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:12.049318 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:12.049318 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:12.049318 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:12.049318 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:12.049318 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:12.049318 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:12.049318 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:12.049318 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:12.049318 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:12.049318 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:12.049318 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:12.049318 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:12.050187 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:35:12.050187 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:35:12.050187 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:35:12.050187 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:35:12.050187 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:35:12.050187 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:35:12.050187 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:12.050187 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:12.054093 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 318/637] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:12.054901 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862aa9e-933c-41b7-8d3e-24302625091e None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:12.117025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:12.119462 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d471b-b958-4255-9b7f-b1caf5928e82 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:12.152585 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9656b-356d-4b55-bffa-f41cdb60d023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:12.153203 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9656b-356d-4b55-bffa-f41cdb60d023 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:12.153618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9656b-356d-4b55-bffa-f41cdb60d023 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:12.153895 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9656b-356d-4b55-bffa-f41cdb60d023 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:12.155117 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862aa9e-933c-41b7-8d3e-24302625091e None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:12.160501 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9656b-356d-4b55-bffa-f41cdb60d023 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:12.161935 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9656b-356d-4b55-bffa-f41cdb60d023 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:12.173547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-89f9656b-356d-4b55-bffa-f41cdb60d023 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:12.173547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:12.173547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:12.173547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:12.173547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:12.173547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:12.173547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:12.173547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:12.173547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:12.173547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:12.173547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:12.173547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:12.173547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:35:12.173547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:35:12.173547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:35:12.174397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:35:12.174397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:12.174397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:12.174397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:12.174397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:12.174397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:12.174397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:12.174397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:12.174397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:12.174397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:12.174397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:12.174397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:12.174397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:12.174397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:12.174397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:12.174397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:12.174397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:12.175325 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:35:12.175325 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:35:12.175325 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:35:12.175325 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:35:12.175325 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:35:12.175325 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:35:12.175325 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:12.175325 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:12.175325 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 320/638] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:12.175862 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9656b-356d-4b55-bffa-f41cdb60d023 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:12.189726 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd04940-034b-4eeb-9347-126826b5266e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:12.190325 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd04940-034b-4eeb-9347-126826b5266e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:12.190602 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd04940-034b-4eeb-9347-126826b5266e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:12.190871 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd04940-034b-4eeb-9347-126826b5266e None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:12.191584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd04940-034b-4eeb-9347-126826b5266e None admin] RBAC: Adding query filter params (name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:12.191883 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd04940-034b-4eeb-9347-126826b5266e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:12.193231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd04940-034b-4eeb-9347-126826b5266e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:12.201342 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 319/639] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 1 13:35:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:12.202527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1957bb7-a251-4f01-a9d1-06d1c05a8728 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:12.202804 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1957bb7-a251-4f01-a9d1-06d1c05a8728 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:12.203075 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1957bb7-a251-4f01-a9d1-06d1c05a8728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:12.220870 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-f1957bb7-a251-4f01-a9d1-06d1c05a8728 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:12.221996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-f1957bb7-a251-4f01-a9d1-06d1c05a8728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:12.227780 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:12.279633 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9656b-356d-4b55-bffa-f41cdb60d023 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:12.289814 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 320/640] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:35:12.290963 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1957bb7-a251-4f01-a9d1-06d1c05a8728 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:12.313619 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77e84a-fc82-407a-9224-0e00685b6e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:12.314530 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77e84a-fc82-407a-9224-0e00685b6e23 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:12.314962 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77e84a-fc82-407a-9224-0e00685b6e23 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:12.315436 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77e84a-fc82-407a-9224-0e00685b6e23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:12.326756 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77e84a-fc82-407a-9224-0e00685b6e23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:12.328484 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77e84a-fc82-407a-9224-0e00685b6e23 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:12.342939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-ca77e84a-fc82-407a-9224-0e00685b6e23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:12.342939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:12.342939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:12.342939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:12.342939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:12.342939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:12.342939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:12.342939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:12.342939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:12.342939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:12.342939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:12.342939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:12.342939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:12.342939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:12.342939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:12.342939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:12.343979 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:12.343979 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:12.343979 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:12.343979 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:12.343979 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:12.343979 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:12.343979 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:12.343979 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:12.343979 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:12.343979 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:12.343979 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:12.343979 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:12.343979 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:12.343979 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:12.343979 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:12.343979 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:12.343979 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:12.344874 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:12.344874 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:12.344874 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:12.344874 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 321/641] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:12.344874 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77e84a-fc82-407a-9224-0e00685b6e23 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:12.366518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:12.419017 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1957bb7-a251-4f01-a9d1-06d1c05a8728 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:12.449222 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:12.452123 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77e84a-fc82-407a-9224-0e00685b6e23 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:12.456250 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4db34-858d-4761-af29-5f33290a3a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:12.456870 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4db34-858d-4761-af29-5f33290a3a6c None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:12.457191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4db34-858d-4761-af29-5f33290a3a6c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:12.457463 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4db34-858d-4761-af29-5f33290a3a6c None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:12.458158 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4db34-858d-4761-af29-5f33290a3a6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:12.458467 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4db34-858d-4761-af29-5f33290a3a6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:12.459950 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4db34-858d-4761-af29-5f33290a3a6c None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:12.473895 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 321/642] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:35:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:12.474654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4db34-858d-4761-af29-5f33290a3a6c None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:12.493302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9d3bd-3240-4d92-adea-dedccc85fbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:12.493985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9d3bd-3240-4d92-adea-dedccc85fbbe None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:12.494271 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9d3bd-3240-4d92-adea-dedccc85fbbe None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:12.494546 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9d3bd-3240-4d92-adea-dedccc85fbbe None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:12.495247 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9d3bd-3240-4d92-adea-dedccc85fbbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:12.495582 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9d3bd-3240-4d92-adea-dedccc85fbbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:12.497040 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9d3bd-3240-4d92-adea-dedccc85fbbe None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:12.508601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 322/643] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:35:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:12.509397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9d3bd-3240-4d92-adea-dedccc85fbbe None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:12.588022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4db34-858d-4761-af29-5f33290a3a6c None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:12.605317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:12.614987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9d3bd-3240-4d92-adea-dedccc85fbbe None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:12.623327 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6bbca-0481-4e89-97c2-fbef6fd1b483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:12.623974 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6bbca-0481-4e89-97c2-fbef6fd1b483 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:12.624250 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6bbca-0481-4e89-97c2-fbef6fd1b483 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:12.624518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6bbca-0481-4e89-97c2-fbef6fd1b483 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:12.634674 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6bbca-0481-4e89-97c2-fbef6fd1b483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:12.636126 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6bbca-0481-4e89-97c2-fbef6fd1b483 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:12.650643 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8329e4e-be52-43cb-af3e-881ecbc8f5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:12.650834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-39e6bbca-0481-4e89-97c2-fbef6fd1b483 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:12.650834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:12.650834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:12.650834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:12.650834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:12.650834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:12.650834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:12.650834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:12.650834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:12.650834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:12.650834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:12.650834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:12.650834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:12.650834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:12.650834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:12.650834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:12.656553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:12.656553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:12.656553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:12.656553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:12.656553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:12.656553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:12.656553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:12.656553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:12.656553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:12.656553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:12.656553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:12.656553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:12.656553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:12.656553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:12.656553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:12.656553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:12.656553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:12.657792 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:12.657792 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:12.657792 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:12.657983 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8329e4e-be52-43cb-af3e-881ecbc8f5d6 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:12.657983 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8329e4e-be52-43cb-af3e-881ecbc8f5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:12.657983 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8329e4e-be52-43cb-af3e-881ecbc8f5d6 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:12.658203 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 322/644] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:12.658293 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8329e4e-be52-43cb-af3e-881ecbc8f5d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:12.658293 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8329e4e-be52-43cb-af3e-881ecbc8f5d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:12.658446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6bbca-0481-4e89-97c2-fbef6fd1b483 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:12.658524 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8329e4e-be52-43cb-af3e-881ecbc8f5d6 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:12.666664 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 323/645] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:12.667591 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8329e4e-be52-43cb-af3e-881ecbc8f5d6 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:12.689281 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:12.756011 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6bbca-0481-4e89-97c2-fbef6fd1b483 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:12.768063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8329e4e-be52-43cb-af3e-881ecbc8f5d6 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:12.789083 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdf7e7-7574-4ae0-833c-519ad9e90f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:12.790328 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdf7e7-7574-4ae0-833c-519ad9e90f39 None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:12.790606 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdf7e7-7574-4ae0-833c-519ad9e90f39 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:12.790868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdf7e7-7574-4ae0-833c-519ad9e90f39 None admin] PATH_INFO: `/v3/projects/6283121e17814cd792df9d0edf81bf2d/users/85bbede0f8674384bcc3028ea77eb724/roles/f8c77ddd17fd4bc7af83e8d8905fb404` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:12.801410 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29ef90-fa39-4bc3-835b-80d00672892a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:12.802230 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29ef90-fa39-4bc3-835b-80d00672892a None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:12.802503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29ef90-fa39-4bc3-835b-80d00672892a None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:12.802770 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29ef90-fa39-4bc3-835b-80d00672892a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:12.803519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29ef90-fa39-4bc3-835b-80d00672892a None admin] RBAC: Adding query filter params (role.id=f8c77ddd17fd4bc7af83e8d8905fb404, scope.project.id=6283121e17814cd792df9d0edf81bf2d, user.id=2d231136bcd44d9a97efe6c257f936ed) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:12.803823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29ef90-fa39-4bc3-835b-80d00672892a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:12.805781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdf7e7-7574-4ae0-833c-519ad9e90f39 None admin] RBAC: Authorizing `identity:create_grant(project_id=6283121e17814cd792df9d0edf81bf2d, user_id=85bbede0f8674384bcc3028ea77eb724, role_id=f8c77ddd17fd4bc7af83e8d8905fb404)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:12.805889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29ef90-fa39-4bc3-835b-80d00672892a None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:12.807240 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdf7e7-7574-4ae0-833c-519ad9e90f39 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:12.811466 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 324/646] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:35:12 2022] GET /identity/v3/role_assignments?user.id=2d231136bcd44d9a97efe6c257f936ed&scope.project.id=6283121e17814cd792df9d0edf81bf2d&role.id=f8c77ddd17fd4bc7af83e8d8905fb404 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:12.812242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29ef90-fa39-4bc3-835b-80d00672892a None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:12.903398 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 323/647] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 1 13:35:12 2022] PUT /identity/v3/projects/6283121e17814cd792df9d0edf81bf2d/users/85bbede0f8674384bcc3028ea77eb724/roles/f8c77ddd17fd4bc7af83e8d8905fb404 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:35:12.903398 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdf7e7-7574-4ae0-833c-519ad9e90f39 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:12.924034 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:12.925493 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:12.946377 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29ef90-fa39-4bc3-835b-80d00672892a None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:12.998815 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430dd21-bbf9-44d6-8140-f0e5acfa4df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:13.000864 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430dd21-bbf9-44d6-8140-f0e5acfa4df8 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:13.000864 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430dd21-bbf9-44d6-8140-f0e5acfa4df8 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:13.000864 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430dd21-bbf9-44d6-8140-f0e5acfa4df8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:13.017004 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430dd21-bbf9-44d6-8140-f0e5acfa4df8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:35:13.022744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-d430dd21-bbf9-44d6-8140-f0e5acfa4df8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:35:13.022744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:13.022744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:13.022744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:13.022744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:13.022744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:13.022744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:13.022744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:13.022744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:13.022744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:13.022744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:13.022744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:13.022744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:35:13.022744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:35:13.022744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:35:13.022744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:35:13.023829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:35:13.023829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:35:13.023829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:35:13.023829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:35:13.023829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:13.023829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:13.023829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:13.023829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:13.023829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:13.023829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:13.023829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:13.023829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:13.023829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:13.023829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:13.023829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:13.023829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:13.024651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:13.024651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:13.024651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:13.024651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:13.024651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:35:13.024651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:35:13.024651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:35:13.024651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:35:13.024651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:35:13.024651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:35:13.024651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:35:13.024651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:13.024651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 325/648] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 1 13:35:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:13.025319 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430dd21-bbf9-44d6-8140-f0e5acfa4df8 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:13.056826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdf7e7-7574-4ae0-833c-519ad9e90f39 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:13.103385 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de29027-7f57-46d8-9376-d034fc66afb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:13.103385 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de29027-7f57-46d8-9376-d034fc66afb1 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:13.103385 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de29027-7f57-46d8-9376-d034fc66afb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:13.103385 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de29027-7f57-46d8-9376-d034fc66afb1 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:13.103809 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de29027-7f57-46d8-9376-d034fc66afb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:13.103809 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de29027-7f57-46d8-9376-d034fc66afb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:13.103932 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de29027-7f57-46d8-9376-d034fc66afb1 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:13.117259 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 324/649] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:13.118989 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de29027-7f57-46d8-9376-d034fc66afb1 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:13.168771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430dd21-bbf9-44d6-8140-f0e5acfa4df8 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:13.212106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24b67c-3af4-46fc-abf4-fb7e1e599c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:13.212738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24b67c-3af4-46fc-abf4-fb7e1e599c04 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:13.213333 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24b67c-3af4-46fc-abf4-fb7e1e599c04 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:13.213440 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:13.213622 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24b67c-3af4-46fc-abf4-fb7e1e599c04 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:13.224744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24b67c-3af4-46fc-abf4-fb7e1e599c04 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:13.226512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24b67c-3af4-46fc-abf4-fb7e1e599c04 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:13.237868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de29027-7f57-46d8-9376-d034fc66afb1 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:13.243099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-af24b67c-3af4-46fc-abf4-fb7e1e599c04 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 13:35:13.243099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:13.243099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:13.243099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:13.243099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:13.243099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:13.243099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:13.243099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:13.243099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:13.243099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:13.243099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:13.243099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:13.243099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:35:13.243099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:35:13.243099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:35:13.243099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:35:13.244053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:13.244053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:13.244053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:35:13.244053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:13.244053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:35:13.244053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:13.244053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:13.244053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:13.244053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:13.244053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:13.244053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:13.244053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:13.244053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:13.244053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:13.244053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:13.244053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:13.244053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:13.244053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:13.245380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:13.245380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:13.245380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:35:13.245380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:35:13.245380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:35:13.245380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:35:13.245380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:35:13.245380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:35:13.245380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 13:35:13.245380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:13.245380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 326/650] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:35:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:13.245380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24b67c-3af4-46fc-abf4-fb7e1e599c04 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:13.251770 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:13.288205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29ac01-26cd-4565-9c1d-5a7aa66b0203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:13.289101 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29ac01-26cd-4565-9c1d-5a7aa66b0203 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:13.289424 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29ac01-26cd-4565-9c1d-5a7aa66b0203 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:13.289710 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29ac01-26cd-4565-9c1d-5a7aa66b0203 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:13.290383 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29ac01-26cd-4565-9c1d-5a7aa66b0203 None admin] RBAC: Adding query filter params (name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:13.290853 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29ac01-26cd-4565-9c1d-5a7aa66b0203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:13.292837 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29ac01-26cd-4565-9c1d-5a7aa66b0203 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:13.303455 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 325/651] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 1 13:35:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:13.304731 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29ac01-26cd-4565-9c1d-5a7aa66b0203 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:13.379556 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24b67c-3af4-46fc-abf4-fb7e1e599c04 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:13.424193 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234a4e2-e189-4fd0-8457-8dce45355e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:13.425378 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234a4e2-e189-4fd0-8457-8dce45355e24 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:13.426220 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234a4e2-e189-4fd0-8457-8dce45355e24 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:13.426945 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234a4e2-e189-4fd0-8457-8dce45355e24 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:13.435353 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29ac01-26cd-4565-9c1d-5a7aa66b0203 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:13.437532 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234a4e2-e189-4fd0-8457-8dce45355e24 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:13.440198 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234a4e2-e189-4fd0-8457-8dce45355e24 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:13.459591 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-a234a4e2-e189-4fd0-8457-8dce45355e24 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 13:35:13.459591 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:13.459591 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:13.459591 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:13.459591 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:13.459591 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:13.459591 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:13.459591 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:13.459591 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:13.459591 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:13.459591 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:13.459591 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:13.459591 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:35:13.459591 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:35:13.459591 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:35:13.459591 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:35:13.460604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:13.460604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:13.460604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:35:13.460604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:13.460604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:35:13.460604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:13.460604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:13.460604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:13.460604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:13.460604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:13.460604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:13.460604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:13.460604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:13.460604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:13.460604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:13.460604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:13.460604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:13.460604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:13.462050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:13.462050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:13.462050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:35:13.462050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:35:13.462050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:35:13.462050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:35:13.462050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:35:13.462050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:35:13.462050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 13:35:13.462050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:13.462050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 327/652] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:35:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:13.462644 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234a4e2-e189-4fd0-8457-8dce45355e24 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:13.483682 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33d64b-0a25-4527-bfd0-ee960ac86786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:13.484306 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33d64b-0a25-4527-bfd0-ee960ac86786 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:13.484591 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33d64b-0a25-4527-bfd0-ee960ac86786 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:13.484870 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33d64b-0a25-4527-bfd0-ee960ac86786 None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:13.486013 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33d64b-0a25-4527-bfd0-ee960ac86786 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:13.486326 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33d64b-0a25-4527-bfd0-ee960ac86786 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:13.488081 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33d64b-0a25-4527-bfd0-ee960ac86786 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:13.501775 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:13.517065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 326/653] 10.222.0.50 () {56 vars in 1137 bytes} [Thu Sep 1 13:35:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:13.517065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33d64b-0a25-4527-bfd0-ee960ac86786 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:13.551008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:13.596367 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234a4e2-e189-4fd0-8457-8dce45355e24 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:13.630655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33d64b-0a25-4527-bfd0-ee960ac86786 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:13.631785 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b602bf-be53-4656-9578-b533c005e5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:13.632414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b602bf-be53-4656-9578-b533c005e5b5 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:13.632694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b602bf-be53-4656-9578-b533c005e5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:13.633531 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b602bf-be53-4656-9578-b533c005e5b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:13.649752 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b602bf-be53-4656-9578-b533c005e5b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:13.652049 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b602bf-be53-4656-9578-b533c005e5b5 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:13.670128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-01b602bf-be53-4656-9578-b533c005e5b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:13.670128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:13.670128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:13.670128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:13.670128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:13.670128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:13.670128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:13.670128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:13.670128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:13.670128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:13.670128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:13.670128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:13.670128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:13.670128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:13.670128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:13.670128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:13.671078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:13.671078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:13.671078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:13.671078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:13.671078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:13.671078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:13.671078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:13.671078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:13.671078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:13.671078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:13.671078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:13.671078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:13.671078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:13.671078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:13.671078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:13.671078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:13.671078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:13.671973 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:13.671973 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:13.671973 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:13.672148 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3baab7-a4b3-41d6-827b-0a07dd800907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:13.672148 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3baab7-a4b3-41d6-827b-0a07dd800907 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:13.672148 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3baab7-a4b3-41d6-827b-0a07dd800907 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:13.672148 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3baab7-a4b3-41d6-827b-0a07dd800907 None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:13.672864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3baab7-a4b3-41d6-827b-0a07dd800907 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:13.673051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3baab7-a4b3-41d6-827b-0a07dd800907 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:13.674401 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 328/654] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:13.674840 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3baab7-a4b3-41d6-827b-0a07dd800907 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:13.675677 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b602bf-be53-4656-9578-b533c005e5b5 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:13.701442 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 327/655] 10.222.0.50 () {56 vars in 1137 bytes} [Thu Sep 1 13:35:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:13.701442 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3baab7-a4b3-41d6-827b-0a07dd800907 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:13.768991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:13.815879 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b602bf-be53-4656-9578-b533c005e5b5 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:13.824286 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3baab7-a4b3-41d6-827b-0a07dd800907 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:13.845295 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:13.870920 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ead9c8-5497-4500-9c96-4a432f92be18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:13.872189 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ead9c8-5497-4500-9c96-4a432f92be18 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:13.873047 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ead9c8-5497-4500-9c96-4a432f92be18 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:13.873868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ead9c8-5497-4500-9c96-4a432f92be18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:13.876254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeaeb95-82bd-4906-a398-ca26bc545a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:13.876965 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaeb95-82bd-4906-a398-ca26bc545a15 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:13.877843 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaeb95-82bd-4906-a398-ca26bc545a15 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:13.879798 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaeb95-82bd-4906-a398-ca26bc545a15 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:13.881179 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeaeb95-82bd-4906-a398-ca26bc545a15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:13.881851 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeaeb95-82bd-4906-a398-ca26bc545a15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:13.884457 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeaeb95-82bd-4906-a398-ca26bc545a15 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:13.901359 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 328/656] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:13.902477 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeaeb95-82bd-4906-a398-ca26bc545a15 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:13.963914 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ead9c8-5497-4500-9c96-4a432f92be18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:13.965609 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ead9c8-5497-4500-9c96-4a432f92be18 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:14.025592 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeaeb95-82bd-4906-a398-ca26bc545a15 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:14.045471 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:14.066544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f949d9b-a3ba-4aef-8a0b-7ed7f306235b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:14.067234 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f949d9b-a3ba-4aef-8a0b-7ed7f306235b None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:14.067572 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f949d9b-a3ba-4aef-8a0b-7ed7f306235b None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:14.067960 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f949d9b-a3ba-4aef-8a0b-7ed7f306235b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:14.081453 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 329/657] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:35:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:35:14.082334 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ead9c8-5497-4500-9c96-4a432f92be18 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:14.102857 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:14.142760 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f949d9b-a3ba-4aef-8a0b-7ed7f306235b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:14.144555 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f949d9b-a3ba-4aef-8a0b-7ed7f306235b None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:14.193890 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ead9c8-5497-4500-9c96-4a432f92be18 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:14.231211 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3e9e4-e394-4062-af23-97afdbdeba05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:14.232142 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3e9e4-e394-4062-af23-97afdbdeba05 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:14.232421 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3e9e4-e394-4062-af23-97afdbdeba05 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:14.232823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3e9e4-e394-4062-af23-97afdbdeba05 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:14.240673 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3e9e4-e394-4062-af23-97afdbdeba05 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:14.242131 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3e9e4-e394-4062-af23-97afdbdeba05 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:14.250929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 329/658] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:35:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:35:14.252098 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f949d9b-a3ba-4aef-8a0b-7ed7f306235b None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:14.256374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-53c3e9e4-e394-4062-af23-97afdbdeba05 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 13:35:14.256374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:14.256374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:14.256374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:14.256374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:14.256374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:14.256374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:14.256374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:14.256374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:14.256374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:14.256374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:14.256374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:14.256374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:35:14.256374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:35:14.256374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:35:14.256374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:35:14.257295 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:14.257295 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:14.257295 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:35:14.257295 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:14.257295 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:35:14.257295 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:14.257295 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:14.257295 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:14.257295 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:14.257295 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:14.257295 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:14.257295 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:14.257295 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:14.257295 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:14.257295 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:14.257295 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:14.257295 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:14.257295 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:14.258841 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:14.258841 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:14.258841 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:35:14.258841 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:35:14.258841 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:35:14.258841 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:35:14.258841 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:35:14.258841 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:35:14.258841 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 13:35:14.258841 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:14.262269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 330/659] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 1 13:35:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:14.263121 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3e9e4-e394-4062-af23-97afdbdeba05 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:14.274350 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:14.345934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:14.364594 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f949d9b-a3ba-4aef-8a0b-7ed7f306235b None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:14.370122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3e9e4-e394-4062-af23-97afdbdeba05 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:14.410265 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afb28d-dc19-44d7-a61e-b31cce327b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:14.410487 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e2afa-e64e-477c-b603-d96b64653abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:14.410592 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afb28d-dc19-44d7-a61e-b31cce327b53 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:14.410679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e2afa-e64e-477c-b603-d96b64653abb None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:14.410763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afb28d-dc19-44d7-a61e-b31cce327b53 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:14.410868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e2afa-e64e-477c-b603-d96b64653abb None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:14.410953 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afb28d-dc19-44d7-a61e-b31cce327b53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:14.411033 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e2afa-e64e-477c-b603-d96b64653abb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:14.420496 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afb28d-dc19-44d7-a61e-b31cce327b53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:14.421730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e2afa-e64e-477c-b603-d96b64653abb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:14.422124 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afb28d-dc19-44d7-a61e-b31cce327b53 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:14.423555 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e2afa-e64e-477c-b603-d96b64653abb None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:14.437283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-a8afb28d-dc19-44d7-a61e-b31cce327b53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:14.437283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:14.437283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:14.437283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:14.437283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:14.437283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:14.437283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:14.437283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:14.437283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:14.437283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:14.437283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:14.437283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:14.437283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:14.437283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:14.437283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:14.437283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:14.438467 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:14.438467 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:14.438467 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:14.438467 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:14.438467 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:14.438467 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:14.438467 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:14.438467 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:14.438467 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:14.438467 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:14.438467 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:14.438467 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:14.438467 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:14.438467 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:14.438467 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:14.438467 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:14.438467 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:14.439581 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:14.439581 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:14.439581 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:14.443398 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 331/660] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:14.443398 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afb28d-dc19-44d7-a61e-b31cce327b53 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:14.444492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-5a2e2afa-e64e-477c-b603-d96b64653abb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:14.444492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:14.444492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:14.444492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:14.444492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:14.444492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:14.444492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:14.444492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:14.444492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:14.444492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:14.444492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:14.444492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:14.444492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:14.444492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:14.444492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:14.444492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:14.445906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:14.445906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:14.445906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:14.445906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:14.445906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:14.445906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:14.445906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:14.445906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:14.445906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:14.445906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:14.445906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:14.445906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:14.445906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:14.445906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:14.445906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:14.445906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:14.445906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:14.446754 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:14.446754 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:14.446754 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:14.446754 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 330/661] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:14.456399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e2afa-e64e-477c-b603-d96b64653abb None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:14.540565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:14.575342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afb28d-dc19-44d7-a61e-b31cce327b53 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:14.584818 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e2afa-e64e-477c-b603-d96b64653abb None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:14.607441 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:14.621592 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cd336-9707-47e4-9ee6-7cce6c7c774f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:14.623001 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cd336-9707-47e4-9ee6-7cce6c7c774f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:14.623452 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cd336-9707-47e4-9ee6-7cce6c7c774f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:14.624174 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cd336-9707-47e4-9ee6-7cce6c7c774f None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:14.625301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389cd336-9707-47e4-9ee6-7cce6c7c774f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:14.625864 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389cd336-9707-47e4-9ee6-7cce6c7c774f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:14.627873 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389cd336-9707-47e4-9ee6-7cce6c7c774f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:14.628098 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb39a93-ebfc-4c8f-aea8-50951770026d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:14.628798 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb39a93-ebfc-4c8f-aea8-50951770026d None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:14.629176 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb39a93-ebfc-4c8f-aea8-50951770026d None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:14.629545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb39a93-ebfc-4c8f-aea8-50951770026d None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:14.630326 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb39a93-ebfc-4c8f-aea8-50951770026d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:14.630723 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb39a93-ebfc-4c8f-aea8-50951770026d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:14.632252 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb39a93-ebfc-4c8f-aea8-50951770026d None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:14.651246 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 331/662] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:14.651246 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb39a93-ebfc-4c8f-aea8-50951770026d None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:14.657019 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 332/663] 10.222.0.50 () {56 vars in 1139 bytes} [Thu Sep 1 13:35:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:14.658045 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cd336-9707-47e4-9ee6-7cce6c7c774f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:14.773290 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb39a93-ebfc-4c8f-aea8-50951770026d None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:14.775063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cd336-9707-47e4-9ee6-7cce6c7c774f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:14.808682 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:14.811865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdce6e-bc6c-4112-9eab-d2cba62f0ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:14.812892 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdce6e-bc6c-4112-9eab-d2cba62f0ba3 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:14.813014 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdce6e-bc6c-4112-9eab-d2cba62f0ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:14.813379 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdce6e-bc6c-4112-9eab-d2cba62f0ba3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:14.818314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887f1eb-88e5-4b7f-bca8-9795757acc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:14.819092 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887f1eb-88e5-4b7f-bca8-9795757acc36 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:14.819539 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887f1eb-88e5-4b7f-bca8-9795757acc36 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:14.820222 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887f1eb-88e5-4b7f-bca8-9795757acc36 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:14.821573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887f1eb-88e5-4b7f-bca8-9795757acc36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:14.821701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffdce6e-bc6c-4112-9eab-d2cba62f0ba3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:14.822133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887f1eb-88e5-4b7f-bca8-9795757acc36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:14.823284 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffdce6e-bc6c-4112-9eab-d2cba62f0ba3 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:14.823883 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887f1eb-88e5-4b7f-bca8-9795757acc36 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:14.836984 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-7ffdce6e-bc6c-4112-9eab-d2cba62f0ba3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:14.836984 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:14.836984 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:14.836984 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:14.836984 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:14.836984 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:14.836984 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:14.836984 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:14.836984 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:14.836984 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:14.836984 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:14.836984 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:14.836984 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:35:14.836984 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:35:14.836984 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:35:14.837889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:35:14.837889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:14.837889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:14.837889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:14.837889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:14.837889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:14.837889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:14.837889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:14.837889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:14.837889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:14.837889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:14.837889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:14.837889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:14.837889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:14.837889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:14.837889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:14.837889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:14.838729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:35:14.838729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:35:14.838729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:35:14.838729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:35:14.838729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:35:14.838729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:35:14.838729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:14.838729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:14.844275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 333/664] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:14.844275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdce6e-bc6c-4112-9eab-d2cba62f0ba3 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:14.849888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 332/665] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:14.855242 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887f1eb-88e5-4b7f-bca8-9795757acc36 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:14.917809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:14.957519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887f1eb-88e5-4b7f-bca8-9795757acc36 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:14.971710 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdce6e-bc6c-4112-9eab-d2cba62f0ba3 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:14.993428 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a745c-4fa0-42a9-9450-b0099982bf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:14.994027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a745c-4fa0-42a9-9450-b0099982bf2a None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:14.994305 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a745c-4fa0-42a9-9450-b0099982bf2a None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:14.994572 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a745c-4fa0-42a9-9450-b0099982bf2a None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:14.995257 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a745c-4fa0-42a9-9450-b0099982bf2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:14.995689 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a745c-4fa0-42a9-9450-b0099982bf2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:14.997012 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a745c-4fa0-42a9-9450-b0099982bf2a None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:15.004921 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84003a-4afd-48a6-8c19-99470d96d966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:15.005516 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84003a-4afd-48a6-8c19-99470d96d966 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:15.005796 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84003a-4afd-48a6-8c19-99470d96d966 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:15.006071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84003a-4afd-48a6-8c19-99470d96d966 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:15.010358 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 333/666] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:35:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:15.011162 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a745c-4fa0-42a9-9450-b0099982bf2a None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:15.062404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:15.074664 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84003a-4afd-48a6-8c19-99470d96d966 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:15.076217 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84003a-4afd-48a6-8c19-99470d96d966 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:15.114311 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a745c-4fa0-42a9-9450-b0099982bf2a None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:15.121694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:15.147791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa021fe4-7090-4be7-8b1c-44499ad17443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:15.148438 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa021fe4-7090-4be7-8b1c-44499ad17443 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:15.149237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa021fe4-7090-4be7-8b1c-44499ad17443 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:15.149510 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa021fe4-7090-4be7-8b1c-44499ad17443 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:15.156598 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa021fe4-7090-4be7-8b1c-44499ad17443 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:15.158069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa021fe4-7090-4be7-8b1c-44499ad17443 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:15.169535 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-aa021fe4-7090-4be7-8b1c-44499ad17443 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:15.169535 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:15.169535 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:15.169535 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:15.169535 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:15.169535 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:15.169535 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:15.169535 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:15.169535 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:15.169535 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:15.169535 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:15.169535 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:15.169535 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:35:15.169535 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:35:15.169535 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:35:15.170405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:35:15.170405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:15.170405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:15.170405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:15.170405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:15.170405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:15.170405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:15.170405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:15.170405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:15.170405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:15.170405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:15.170405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:15.170405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:15.170405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:15.170405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:15.170405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:15.170405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:15.171253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:35:15.171253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:35:15.171253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:35:15.171253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:35:15.171253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:35:15.171253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:35:15.171253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:15.171253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:15.171253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 334/667] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:15.171769 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a98007-3bb4-4134-b903-b4471c6675b5 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:15.171984 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a98007-3bb4-4134-b903-b4471c6675b5 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:15.172287 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a98007-3bb4-4134-b903-b4471c6675b5 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:15.173467 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 335/668] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:15.174470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13c3fe-37b8-4991-a5af-1f625503ec04 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:15.174748 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13c3fe-37b8-4991-a5af-1f625503ec04 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:15.175020 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13c3fe-37b8-4991-a5af-1f625503ec04 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:15.176237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 336/669] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:15.176912 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13c3fe-37b8-4991-a5af-1f625503ec04 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:15.186253 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 334/670] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:35:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:35:15.187399 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84003a-4afd-48a6-8c19-99470d96d966 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:15.279316 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13c3fe-37b8-4991-a5af-1f625503ec04 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:15.287511 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84003a-4afd-48a6-8c19-99470d96d966 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:15.288356 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:15.313803 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f0a8e-ffee-4f9d-aa53-19175997bdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:15.314431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f0a8e-ffee-4f9d-aa53-19175997bdb1 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:15.314715 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f0a8e-ffee-4f9d-aa53-19175997bdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:15.314990 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f0a8e-ffee-4f9d-aa53-19175997bdb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:15.315746 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f0a8e-ffee-4f9d-aa53-19175997bdb1 None admin] RBAC: Adding query filter params (role.id=f8c77ddd17fd4bc7af83e8d8905fb404, scope.project.id=6283121e17814cd792df9d0edf81bf2d, user.id=1dc5b80f0e4c48189389d23507a9d2ec) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:15.316051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f0a8e-ffee-4f9d-aa53-19175997bdb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:15.317506 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f0a8e-ffee-4f9d-aa53-19175997bdb1 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:15.322124 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74fc50-622a-4195-9cb3-abc216266599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:15.322725 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74fc50-622a-4195-9cb3-abc216266599 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:15.323001 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74fc50-622a-4195-9cb3-abc216266599 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:15.323266 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74fc50-622a-4195-9cb3-abc216266599 None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:15.323982 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74fc50-622a-4195-9cb3-abc216266599 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:15.324282 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74fc50-622a-4195-9cb3-abc216266599 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:15.325182 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 337/671] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:35:15 2022] GET /identity/v3/role_assignments?user.id=1dc5b80f0e4c48189389d23507a9d2ec&scope.project.id=6283121e17814cd792df9d0edf81bf2d&role.id=f8c77ddd17fd4bc7af83e8d8905fb404 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:15.325728 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74fc50-622a-4195-9cb3-abc216266599 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:15.326116 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52374bb8-433f-4458-980d-c742ed90a316 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:15.326400 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52374bb8-433f-4458-980d-c742ed90a316 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:15.326669 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52374bb8-433f-4458-980d-c742ed90a316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:15.349872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 335/672] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:35:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:15.350092 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-52374bb8-433f-4458-980d-c742ed90a316 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:15.350175 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaeb364-ad7a-4904-8908-24dbe0b50096 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:15.350175 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaeb364-ad7a-4904-8908-24dbe0b50096 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:15.350175 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaeb364-ad7a-4904-8908-24dbe0b50096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:15.350413 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-52374bb8-433f-4458-980d-c742ed90a316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:15.363678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:15.370873 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-fcaeb364-ad7a-4904-8908-24dbe0b50096 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:15.372196 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-fcaeb364-ad7a-4904-8908-24dbe0b50096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:15.426996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 338/673] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:35:15.436469 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52374bb8-433f-4458-980d-c742ed90a316 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:15.463867 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 336/674] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:35:15.464928 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaeb364-ad7a-4904-8908-24dbe0b50096 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:15.574102 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52374bb8-433f-4458-980d-c742ed90a316 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:15.576583 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:15.587955 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaeb364-ad7a-4904-8908-24dbe0b50096 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:15.613696 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af924a2-fb87-4a17-962e-79c69b8ccf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:15.614483 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af924a2-fb87-4a17-962e-79c69b8ccf62 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:15.614837 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af924a2-fb87-4a17-962e-79c69b8ccf62 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:15.615159 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af924a2-fb87-4a17-962e-79c69b8ccf62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:15.628207 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af924a2-fb87-4a17-962e-79c69b8ccf62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:15.629697 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af924a2-fb87-4a17-962e-79c69b8ccf62 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:15.636577 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6558811-ba2c-4b9e-8b9c-f719487a93ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:15.637428 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6558811-ba2c-4b9e-8b9c-f719487a93ce None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:15.637908 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6558811-ba2c-4b9e-8b9c-f719487a93ce None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:15.638801 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6558811-ba2c-4b9e-8b9c-f719487a93ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:15.639747 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6558811-ba2c-4b9e-8b9c-f719487a93ce None admin] RBAC: Adding query filter params (role.id=f8c77ddd17fd4bc7af83e8d8905fb404, scope.project.id=6283121e17814cd792df9d0edf81bf2d, user.id=fc11fe25135d4bf1b1a06b8619e4a2e0) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:15.640626 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6558811-ba2c-4b9e-8b9c-f719487a93ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:15.642533 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6558811-ba2c-4b9e-8b9c-f719487a93ce None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:15.645881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:15.647317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-6af924a2-fb87-4a17-962e-79c69b8ccf62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:15.647317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:15.647317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:15.647317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:15.647317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:15.647317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:15.647317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:15.647317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:15.647317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:15.647317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:15.647317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:15.647317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:15.647317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:15.647317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:15.647317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:15.647317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:15.648331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:15.648331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:15.648331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:15.648331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:15.648331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:15.648331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:15.648331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:15.648331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:15.648331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:15.648331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:15.648331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:15.648331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:15.648331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:15.648331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:15.648331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:15.648331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:15.648331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:15.649230 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:15.649230 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:15.649230 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:15.649885 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 339/675] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:15.653278 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 337/676] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:35:15 2022] GET /identity/v3/role_assignments?user.id=fc11fe25135d4bf1b1a06b8619e4a2e0&scope.project.id=6283121e17814cd792df9d0edf81bf2d&role.id=f8c77ddd17fd4bc7af83e8d8905fb404 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:15.662625 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af924a2-fb87-4a17-962e-79c69b8ccf62 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:15.721790 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6558811-ba2c-4b9e-8b9c-f719487a93ce None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:15.794516 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af924a2-fb87-4a17-962e-79c69b8ccf62 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:15.853647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfc45f-9b3f-4728-85e2-ee34ad3904db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:15.855085 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfc45f-9b3f-4728-85e2-ee34ad3904db None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:15.855085 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfc45f-9b3f-4728-85e2-ee34ad3904db None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:15.855085 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfc45f-9b3f-4728-85e2-ee34ad3904db None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:15.855626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebfc45f-9b3f-4728-85e2-ee34ad3904db None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:15.855924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebfc45f-9b3f-4728-85e2-ee34ad3904db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:15.856288 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6558811-ba2c-4b9e-8b9c-f719487a93ce None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:15.857592 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebfc45f-9b3f-4728-85e2-ee34ad3904db None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:15.878450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 340/677] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:15.879308 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfc45f-9b3f-4728-85e2-ee34ad3904db None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:15.896865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:15.897570 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7141b5-bc6d-42da-a07f-85a67d7d7853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:15.898433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7141b5-bc6d-42da-a07f-85a67d7d7853 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:15.899375 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7141b5-bc6d-42da-a07f-85a67d7d7853 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:15.899672 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7141b5-bc6d-42da-a07f-85a67d7d7853 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:15.911413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7141b5-bc6d-42da-a07f-85a67d7d7853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:35:15.917771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-3e7141b5-bc6d-42da-a07f-85a67d7d7853 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:35:15.917771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:15.917771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:15.917771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:15.917771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:15.917771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:15.917771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:15.917771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:15.917771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:15.917771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:15.917771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:15.917771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:15.917771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:35:15.917771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:35:15.917771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:35:15.917771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:35:15.918707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:35:15.918707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:35:15.918707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:35:15.918707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:35:15.918707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:15.918707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:15.918707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:15.918707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:15.918707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:15.918707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:15.918707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:15.918707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:15.918707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:15.918707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:15.918707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:15.918707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:15.920167 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:15.920167 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:15.920167 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:15.920167 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:15.920167 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:35:15.920167 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:35:15.920167 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:35:15.920167 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:35:15.920167 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:35:15.920167 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:35:15.920167 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:35:15.920167 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:15.920167 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 338/678] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 1 13:35:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:35:15.920891 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7141b5-bc6d-42da-a07f-85a67d7d7853 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:15.996377 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:16.019788 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfc45f-9b3f-4728-85e2-ee34ad3904db None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:16.044912 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7141b5-bc6d-42da-a07f-85a67d7d7853 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:16.067784 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b991470-76a6-4ff5-ae2e-ed81ec8f917f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:16.068481 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b991470-76a6-4ff5-ae2e-ed81ec8f917f None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:16.069011 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b991470-76a6-4ff5-ae2e-ed81ec8f917f None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:16.069284 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b991470-76a6-4ff5-ae2e-ed81ec8f917f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:16.082682 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8063a70-6300-4b77-a925-d5041c464574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:16.083398 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b991470-76a6-4ff5-ae2e-ed81ec8f917f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:35:16.083913 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8063a70-6300-4b77-a925-d5041c464574 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:16.084419 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8063a70-6300-4b77-a925-d5041c464574 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:16.084923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8063a70-6300-4b77-a925-d5041c464574 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:16.089632 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-1b991470-76a6-4ff5-ae2e-ed81ec8f917f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:35:16.089632 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:16.089632 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:16.089632 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:16.089632 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:16.089632 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:16.089632 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:16.089632 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:16.089632 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:16.089632 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:16.089632 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:16.089632 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:16.089632 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:35:16.089632 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:35:16.089632 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:35:16.089632 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:35:16.090531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:35:16.090531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:35:16.090531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:35:16.090531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:35:16.090531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:16.090531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:16.090531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:16.090531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:16.090531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:16.090531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:16.090531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:16.090531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:16.090531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:16.090531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:16.090531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:16.090531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:16.091992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:16.091992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:16.091992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:16.091992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:16.091992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:35:16.091992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:35:16.091992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:35:16.091992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:35:16.091992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:35:16.091992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:35:16.091992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:35:16.091992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:16.091992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 341/679] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:35:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:16.091992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b991470-76a6-4ff5-ae2e-ed81ec8f917f None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:16.103389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8063a70-6300-4b77-a925-d5041c464574 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:16.103389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8063a70-6300-4b77-a925-d5041c464574 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:16.119389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-d8063a70-6300-4b77-a925-d5041c464574 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:16.119389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:16.119389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:16.119389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:16.119389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:16.119389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:16.119389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:16.119389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:16.119389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:16.119389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:16.119389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:16.119389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:16.119389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:35:16.119389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:35:16.119389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:35:16.120307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:35:16.120307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:16.120307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:16.120307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:16.120307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:16.120307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:16.120307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:16.120307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:16.120307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:16.120307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:16.120307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:16.120307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:16.120307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:16.120307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:16.120307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:16.120307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:16.120307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:16.121668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:35:16.121668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:35:16.121668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:35:16.121668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:35:16.121668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:35:16.121668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:35:16.121668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:16.121668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:16.121668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 339/680] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:16.123208 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8063a70-6300-4b77-a925-d5041c464574 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:16.186282 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:16.219044 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b991470-76a6-4ff5-ae2e-ed81ec8f917f None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:16.246161 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8063a70-6300-4b77-a925-d5041c464574 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:16.257352 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493cd34-c190-4a75-9f6d-e48acfab1ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:16.258543 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493cd34-c190-4a75-9f6d-e48acfab1ccf None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:16.258826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493cd34-c190-4a75-9f6d-e48acfab1ccf None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:16.259097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493cd34-c190-4a75-9f6d-e48acfab1ccf None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:16.259800 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f493cd34-c190-4a75-9f6d-e48acfab1ccf None admin] RBAC: Adding query filter params (name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:16.260101 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f493cd34-c190-4a75-9f6d-e48acfab1ccf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:16.261584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f493cd34-c190-4a75-9f6d-e48acfab1ccf None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:16.268355 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:16.271452 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 342/681] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 1 13:35:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:16.272061 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493cd34-c190-4a75-9f6d-e48acfab1ccf None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:16.289747 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef9e0a-8e16-4e68-bc94-f7e7db3a5a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:16.290834 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef9e0a-8e16-4e68-bc94-f7e7db3a5a12 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:16.291116 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef9e0a-8e16-4e68-bc94-f7e7db3a5a12 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:16.291443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef9e0a-8e16-4e68-bc94-f7e7db3a5a12 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:16.292865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef9e0a-8e16-4e68-bc94-f7e7db3a5a12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:16.293190 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef9e0a-8e16-4e68-bc94-f7e7db3a5a12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:16.295429 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef9e0a-8e16-4e68-bc94-f7e7db3a5a12 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:16.309931 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 340/682] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:35:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:16.311305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef9e0a-8e16-4e68-bc94-f7e7db3a5a12 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:16.398038 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493cd34-c190-4a75-9f6d-e48acfab1ccf None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:16.421791 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef9e0a-8e16-4e68-bc94-f7e7db3a5a12 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:16.432629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93197ede-9b2d-4290-a885-e14b75930f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:16.433037 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93197ede-9b2d-4290-a885-e14b75930f38 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:16.433316 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93197ede-9b2d-4290-a885-e14b75930f38 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:16.433589 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93197ede-9b2d-4290-a885-e14b75930f38 None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:16.434272 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93197ede-9b2d-4290-a885-e14b75930f38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:16.434574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93197ede-9b2d-4290-a885-e14b75930f38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:16.436059 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93197ede-9b2d-4290-a885-e14b75930f38 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:16.438687 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:16.449856 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 343/683] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:35:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:16.450976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93197ede-9b2d-4290-a885-e14b75930f38 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:16.467792 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f31e4-f8de-4daa-8016-3d78c9241f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:16.468811 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f31e4-f8de-4daa-8016-3d78c9241f3f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:16.469314 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f31e4-f8de-4daa-8016-3d78c9241f3f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:16.469794 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f31e4-f8de-4daa-8016-3d78c9241f3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:16.481774 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f31e4-f8de-4daa-8016-3d78c9241f3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:16.484421 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f31e4-f8de-4daa-8016-3d78c9241f3f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:16.500894 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-fc1f31e4-f8de-4daa-8016-3d78c9241f3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:16.500894 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:16.500894 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:16.500894 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:16.500894 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:16.500894 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:16.500894 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:16.500894 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:16.500894 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:16.500894 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:16.500894 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:16.500894 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:16.500894 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:16.500894 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:16.500894 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:16.500894 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:16.501875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:16.501875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:16.501875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:16.501875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:16.501875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:16.501875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:16.501875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:16.501875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:16.501875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:16.501875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:16.501875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:16.501875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:16.501875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:16.501875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:16.501875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:16.501875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:16.501875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:16.502750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:16.502750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:16.502750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:16.504973 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 341/684] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:16.506072 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f31e4-f8de-4daa-8016-3d78c9241f3f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:16.555997 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:16.572565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93197ede-9b2d-4290-a885-e14b75930f38 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:16.618646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe24af6-9def-40e4-ae9e-dd88bc6561f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:16.619901 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe24af6-9def-40e4-ae9e-dd88bc6561f5 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:16.620710 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe24af6-9def-40e4-ae9e-dd88bc6561f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:16.621211 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe24af6-9def-40e4-ae9e-dd88bc6561f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:16.635329 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe24af6-9def-40e4-ae9e-dd88bc6561f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:16.636766 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f31e4-f8de-4daa-8016-3d78c9241f3f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:16.637653 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe24af6-9def-40e4-ae9e-dd88bc6561f5 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:16.660262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-3fe24af6-9def-40e4-ae9e-dd88bc6561f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:16.660262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:16.660262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:16.660262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:16.660262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:16.660262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:16.660262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:16.660262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:16.660262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:16.660262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:16.660262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:16.660262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:16.660262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:16.660262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:16.660262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:16.660262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:16.661231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:16.661231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:16.661231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:16.661231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:16.661231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:16.661231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:16.661231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:16.661231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:16.661231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:16.661231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:16.661231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:16.661231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:16.661231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:16.661231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:16.661231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:16.661231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:16.661231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:16.662092 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:16.662092 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:16.662092 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:16.664821 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 344/685] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:16.666262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe24af6-9def-40e4-ae9e-dd88bc6561f5 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:16.677656 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31972e37-b3d2-47b9-8879-aa2113d2096d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:16.678433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31972e37-b3d2-47b9-8879-aa2113d2096d None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:16.678841 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31972e37-b3d2-47b9-8879-aa2113d2096d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:16.680263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31972e37-b3d2-47b9-8879-aa2113d2096d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:16.681134 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31972e37-b3d2-47b9-8879-aa2113d2096d None admin] RBAC: Adding query filter params (role.id=f8c77ddd17fd4bc7af83e8d8905fb404, scope.project.id=6283121e17814cd792df9d0edf81bf2d, user.id=72f0d372f6c34d1a9a990222d6b98948) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:16.681562 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31972e37-b3d2-47b9-8879-aa2113d2096d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:16.683706 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31972e37-b3d2-47b9-8879-aa2113d2096d None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:16.699393 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 342/686] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:35:16 2022] GET /identity/v3/role_assignments?user.id=72f0d372f6c34d1a9a990222d6b98948&scope.project.id=6283121e17814cd792df9d0edf81bf2d&role.id=f8c77ddd17fd4bc7af83e8d8905fb404 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:16.699393 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31972e37-b3d2-47b9-8879-aa2113d2096d None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:16.779750 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:16.885467 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe24af6-9def-40e4-ae9e-dd88bc6561f5 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:16.892630 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:16.896329 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31972e37-b3d2-47b9-8879-aa2113d2096d None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:16.949859 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136fc7a-689c-47a8-91ab-254a0d72028f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:16.950361 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136fc7a-689c-47a8-91ab-254a0d72028f None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:16.950648 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136fc7a-689c-47a8-91ab-254a0d72028f None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:16.950921 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136fc7a-689c-47a8-91ab-254a0d72028f None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:16.952120 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136fc7a-689c-47a8-91ab-254a0d72028f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:16.952120 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136fc7a-689c-47a8-91ab-254a0d72028f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:16.954942 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136fc7a-689c-47a8-91ab-254a0d72028f None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:16.961949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bcf4c7-1c54-4267-a9bc-bc7f82f572db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:16.962919 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcf4c7-1c54-4267-a9bc-bc7f82f572db None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:16.963438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcf4c7-1c54-4267-a9bc-bc7f82f572db None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:16.963934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcf4c7-1c54-4267-a9bc-bc7f82f572db None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:16.964809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bcf4c7-1c54-4267-a9bc-bc7f82f572db None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:16.965400 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bcf4c7-1c54-4267-a9bc-bc7f82f572db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:16.967103 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bcf4c7-1c54-4267-a9bc-bc7f82f572db None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:16.967738 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 345/687] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:16.977344 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136fc7a-689c-47a8-91ab-254a0d72028f None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:16.983961 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 343/688] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:16.992479 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bcf4c7-1c54-4267-a9bc-bc7f82f572db None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:17.112187 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136fc7a-689c-47a8-91ab-254a0d72028f None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:17.135955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:17.152633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3f28e-d890-4e10-8073-f6f43033a8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:17.153272 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3f28e-d890-4e10-8073-f6f43033a8c4 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:17.153554 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3f28e-d890-4e10-8073-f6f43033a8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:17.153899 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3f28e-d890-4e10-8073-f6f43033a8c4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:17.169099 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3f28e-d890-4e10-8073-f6f43033a8c4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:17.170709 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3f28e-d890-4e10-8073-f6f43033a8c4 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:17.180556 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bcf4c7-1c54-4267-a9bc-bc7f82f572db None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:17.203925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-29e3f28e-d890-4e10-8073-f6f43033a8c4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 13:35:17.203925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:17.203925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:17.203925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:17.203925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:17.203925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:17.203925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:17.203925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:17.203925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:17.203925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:17.203925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:17.203925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:17.203925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:35:17.203925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:35:17.203925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:35:17.203925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:35:17.205215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:17.205215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:17.205215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:35:17.205215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:17.205215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:35:17.205215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:17.205215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:17.205215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:17.205215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:17.205215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:17.205215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:17.205215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:17.205215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:17.205215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:17.205215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:17.205215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:17.205215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:17.205215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:17.206114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:17.206114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:17.206114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:35:17.206114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:35:17.206114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:35:17.206114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:35:17.206114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:35:17.206114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:35:17.206114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 13:35:17.206114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:17.206617 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 346/689] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:35:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:17.216886 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3f28e-d890-4e10-8073-f6f43033a8c4 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:17.238766 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1fd1f-dc7d-4b4e-81f3-b8a65f9a68c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:17.239739 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1fd1f-dc7d-4b4e-81f3-b8a65f9a68c0 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:17.240429 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1fd1f-dc7d-4b4e-81f3-b8a65f9a68c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:17.240879 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1fd1f-dc7d-4b4e-81f3-b8a65f9a68c0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:17.260467 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1fd1f-dc7d-4b4e-81f3-b8a65f9a68c0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:17.262265 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1fd1f-dc7d-4b4e-81f3-b8a65f9a68c0 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:17.283701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-96b1fd1f-dc7d-4b4e-81f3-b8a65f9a68c0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:35:17.283701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:17.283701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:17.283701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:17.283701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:17.283701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:17.283701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:17.283701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:17.283701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:17.283701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:17.283701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:17.283701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:17.283701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:35:17.283701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:35:17.283701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:35:17.283701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:35:17.284666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:17.284666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:17.284666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:35:17.284666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:17.284666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:35:17.284666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:17.284666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:17.284666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:17.284666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:17.284666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:17.284666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:17.284666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:17.284666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:17.284666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:17.284666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:17.284666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:17.284666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:17.284666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:17.285605 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:17.285605 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:17.285605 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:35:17.285605 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:35:17.285605 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:35:17.285605 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:35:17.285605 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:35:17.285605 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:35:17.285605 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:35:17.285605 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:17.288105 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 344/690] 10.222.0.50 () {56 vars in 1093 bytes} [Thu Sep 1 13:35:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:17.294277 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1fd1f-dc7d-4b4e-81f3-b8a65f9a68c0 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:17.337984 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:17.417045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3f28e-d890-4e10-8073-f6f43033a8c4 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:17.478452 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8b2dc-5a3f-4a6e-842a-74cec5335b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:17.480043 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8b2dc-5a3f-4a6e-842a-74cec5335b63 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:17.480660 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8b2dc-5a3f-4a6e-842a-74cec5335b63 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:17.482212 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8b2dc-5a3f-4a6e-842a-74cec5335b63 None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:17.483774 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8b2dc-5a3f-4a6e-842a-74cec5335b63 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:17.484742 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8b2dc-5a3f-4a6e-842a-74cec5335b63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:17.486514 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8b2dc-5a3f-4a6e-842a-74cec5335b63 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:17.499404 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1fd1f-dc7d-4b4e-81f3-b8a65f9a68c0 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:17.521494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 347/691] 10.222.0.50 () {56 vars in 1135 bytes} [Thu Sep 1 13:35:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:17.529360 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8b2dc-5a3f-4a6e-842a-74cec5335b63 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:17.567546 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:17.575581 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b20e8a-21e5-4e1f-a81e-bfe27e85e379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:17.577225 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b20e8a-21e5-4e1f-a81e-bfe27e85e379 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:17.578472 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b20e8a-21e5-4e1f-a81e-bfe27e85e379 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:17.578895 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b20e8a-21e5-4e1f-a81e-bfe27e85e379 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:17.580901 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b20e8a-21e5-4e1f-a81e-bfe27e85e379 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:17.581377 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b20e8a-21e5-4e1f-a81e-bfe27e85e379 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:17.584984 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b20e8a-21e5-4e1f-a81e-bfe27e85e379 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:17.610543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 345/692] 10.222.0.50 () {56 vars in 1133 bytes} [Thu Sep 1 13:35:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:17.610543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa5878-0547-4da1-9600-1fb82e036137 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:17.610543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa5878-0547-4da1-9600-1fb82e036137 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:17.610543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa5878-0547-4da1-9600-1fb82e036137 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:17.613926 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 346/693] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:17.614795 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa5878-0547-4da1-9600-1fb82e036137 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:17.668413 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8b2dc-5a3f-4a6e-842a-74cec5335b63 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:17.717353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:17.719940 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab91cb-864e-41f4-be16-517aa616d272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:17.721088 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab91cb-864e-41f4-be16-517aa616d272 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:17.721511 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab91cb-864e-41f4-be16-517aa616d272 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:17.721922 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab91cb-864e-41f4-be16-517aa616d272 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:17.753031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa5878-0547-4da1-9600-1fb82e036137 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:17.798796 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab91cb-864e-41f4-be16-517aa616d272 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:17.800573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab91cb-864e-41f4-be16-517aa616d272 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:17.803123 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58442df1-8c2d-496c-8368-729894e27ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:17.805323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58442df1-8c2d-496c-8368-729894e27ee2 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:17.805760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58442df1-8c2d-496c-8368-729894e27ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:17.806198 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58442df1-8c2d-496c-8368-729894e27ee2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:17.831584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:17.902455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58442df1-8c2d-496c-8368-729894e27ee2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:17.904081 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58442df1-8c2d-496c-8368-729894e27ee2 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:17.994972 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:18.025546 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 347/694] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:35:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:35:18.025546 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264f639-50d0-40a9-9b33-f5008d073597 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:18.025546 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264f639-50d0-40a9-9b33-f5008d073597 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:18.025546 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264f639-50d0-40a9-9b33-f5008d073597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:18.042986 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-0264f639-50d0-40a9-9b33-f5008d073597 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:18.044219 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-0264f639-50d0-40a9-9b33-f5008d073597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:18.047629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 348/695] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:35:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:35:18.049304 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d185a-3ea8-450d-880b-853d998ea074 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:18.049789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d185a-3ea8-450d-880b-853d998ea074 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:18.050277 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d185a-3ea8-450d-880b-853d998ea074 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:18.051873 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 349/696] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:18.052751 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d185a-3ea8-450d-880b-853d998ea074 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:18.124998 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 348/697] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:35:18.126340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264f639-50d0-40a9-9b33-f5008d073597 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:18.172258 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d185a-3ea8-450d-880b-853d998ea074 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:18.201015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:18.211715 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7266c71-8d1d-4942-b3e6-daadb8e4fb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:18.218681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7266c71-8d1d-4942-b3e6-daadb8e4fb20 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:18.218681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7266c71-8d1d-4942-b3e6-daadb8e4fb20 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:18.218681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7266c71-8d1d-4942-b3e6-daadb8e4fb20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:18.228404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7266c71-8d1d-4942-b3e6-daadb8e4fb20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:18.230627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7266c71-8d1d-4942-b3e6-daadb8e4fb20 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:18.237262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264f639-50d0-40a9-9b33-f5008d073597 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:18.247088 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:18.252525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-d7266c71-8d1d-4942-b3e6-daadb8e4fb20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:18.252525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:18.252525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:18.252525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:18.252525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:18.252525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:18.252525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:18.252525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:18.252525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:18.252525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:18.252525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:18.252525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:18.252525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:18.252525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:18.252525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:18.252525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:18.253495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:18.253495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:18.253495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:18.253495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:18.253495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:18.253495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:18.253495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:18.253495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:18.253495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:18.253495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:18.253495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:18.253495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:18.253495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:18.253495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:18.253495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:18.253495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:18.253495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:18.254362 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:18.254362 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:18.254362 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:18.256907 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 350/698] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:18.264694 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b70bb-b8e0-46d4-99c2-cbfcdc616287 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:18.264694 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b70bb-b8e0-46d4-99c2-cbfcdc616287 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:18.264694 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b70bb-b8e0-46d4-99c2-cbfcdc616287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:18.279340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a299f-ecb2-4186-a6f9-007ebab7e2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:18.280130 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a299f-ecb2-4186-a6f9-007ebab7e2f9 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:18.280561 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a299f-ecb2-4186-a6f9-007ebab7e2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:18.280958 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a299f-ecb2-4186-a6f9-007ebab7e2f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:18.283390 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-499b70bb-b8e0-46d4-99c2-cbfcdc616287 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:18.285100 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-499b70bb-b8e0-46d4-99c2-cbfcdc616287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:18.293763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a299f-ecb2-4186-a6f9-007ebab7e2f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:18.295449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a299f-ecb2-4186-a6f9-007ebab7e2f9 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:18.312104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-003a299f-ecb2-4186-a6f9-007ebab7e2f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:18.312104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:18.312104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:18.312104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:18.312104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:18.312104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:18.312104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:18.312104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:18.312104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:18.312104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:18.312104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:18.312104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:18.312104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:18.312104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:18.312104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:18.312104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:18.313323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:18.313323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:18.313323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:18.313323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:18.313323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:18.313323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:18.313323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:18.313323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:18.313323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:18.313323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:18.313323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:18.313323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:18.313323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:18.313323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:18.313323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:18.313323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:18.313323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:18.314392 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:18.314392 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:18.314392 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:18.320686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 349/699] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:18.321959 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a299f-ecb2-4186-a6f9-007ebab7e2f9 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:18.382369 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 351/700] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:35:18.384740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b70bb-b8e0-46d4-99c2-cbfcdc616287 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:18.453875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a299f-ecb2-4186-a6f9-007ebab7e2f9 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:18.498857 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839f15d-540b-42bf-961e-089195224990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:18.499980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839f15d-540b-42bf-961e-089195224990 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:18.500639 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839f15d-540b-42bf-961e-089195224990 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:18.501065 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839f15d-540b-42bf-961e-089195224990 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:18.502275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839f15d-540b-42bf-961e-089195224990 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:18.502993 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839f15d-540b-42bf-961e-089195224990 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:18.505203 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839f15d-540b-42bf-961e-089195224990 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:18.508447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b70bb-b8e0-46d4-99c2-cbfcdc616287 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:18.520305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 350/701] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:18.521414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839f15d-540b-42bf-961e-089195224990 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:18.522500 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:18.542040 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:18.556258 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33093850-f6a0-48e2-827e-39d078226a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:18.557616 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33093850-f6a0-48e2-827e-39d078226a0d None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:18.558057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33093850-f6a0-48e2-827e-39d078226a0d None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:18.558563 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33093850-f6a0-48e2-827e-39d078226a0d None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:18.559601 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33093850-f6a0-48e2-827e-39d078226a0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:18.560052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33093850-f6a0-48e2-827e-39d078226a0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:18.562518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33093850-f6a0-48e2-827e-39d078226a0d None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:18.577524 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 352/702] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:18.578584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33093850-f6a0-48e2-827e-39d078226a0d None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:18.653715 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839f15d-540b-42bf-961e-089195224990 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:18.697561 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20949827-9667-4e25-b3cc-2d6215c1ad83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:18.698297 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20949827-9667-4e25-b3cc-2d6215c1ad83 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:18.698578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20949827-9667-4e25-b3cc-2d6215c1ad83 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:18.698852 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20949827-9667-4e25-b3cc-2d6215c1ad83 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:18.699464 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20949827-9667-4e25-b3cc-2d6215c1ad83 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:18.699910 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33093850-f6a0-48e2-827e-39d078226a0d None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:18.700843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20949827-9667-4e25-b3cc-2d6215c1ad83 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:18.712842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-20949827-9667-4e25-b3cc-2d6215c1ad83 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 13:35:18.712842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:18.712842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:35:18.712842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:35:18.712842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:35:18.712842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:35:18.712842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:35:18.712842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:18.712842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 13:35:18.712842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:18.712842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:35:18.712842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:18.712842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:18.712842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:18.712842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:18.712842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:18.712842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:18.713923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:18.713923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:18.713923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:18.713923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:18.713923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:18.713923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:18.713923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:35:18.713923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:35:18.713923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:35:18.713923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:35:18.713923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:18.713923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:18.713923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:18.713923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:18.713923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:18.713923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:18.714857 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:18.714857 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:18.714857 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:18.714857 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:18.714857 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:18.714857 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:18.714857 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:18.714857 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:18.714857 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:18.714857 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:18.714857 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:35:18.714857 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:18.714857 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 13:35:18.714857 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:18.714857 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 351/703] 10.222.0.50 () {56 vars in 1129 bytes} [Thu Sep 1 13:35:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:18.715694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20949827-9667-4e25-b3cc-2d6215c1ad83 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:18.743700 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b8e43-6eea-4cf6-acf0-ea5fe18ff3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:18.744405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b8e43-6eea-4cf6-acf0-ea5fe18ff3b5 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:18.744688 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b8e43-6eea-4cf6-acf0-ea5fe18ff3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:18.744956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b8e43-6eea-4cf6-acf0-ea5fe18ff3b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:18.752423 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b8e43-6eea-4cf6-acf0-ea5fe18ff3b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:18.753923 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b8e43-6eea-4cf6-acf0-ea5fe18ff3b5 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:18.766051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-8f3b8e43-6eea-4cf6-acf0-ea5fe18ff3b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:18.766051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:18.766051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:18.766051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:18.766051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:18.766051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:18.766051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:18.766051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:18.766051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:18.766051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:18.766051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:18.766051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:18.766051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:35:18.766051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:35:18.766051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:35:18.766991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:35:18.766991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:18.766991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:18.766991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:18.766991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:18.766991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:18.766991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:18.766991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:18.766991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:18.766991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:18.766991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:18.766991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:18.766991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:18.766991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:18.766991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:18.766991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:18.766991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:18.767891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:35:18.767891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:35:18.767891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:35:18.767891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:35:18.767891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:35:18.767891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:35:18.767891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:18.767891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:18.767891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 353/704] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:18.768371 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b8e43-6eea-4cf6-acf0-ea5fe18ff3b5 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:18.797371 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:18.814761 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:18.832555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20949827-9667-4e25-b3cc-2d6215c1ad83 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:18.871623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b8e43-6eea-4cf6-acf0-ea5fe18ff3b5 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:18.872864 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943bea4-9499-4f64-b69e-fca9cd242a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:18.873489 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943bea4-9499-4f64-b69e-fca9cd242a17 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:18.873775 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943bea4-9499-4f64-b69e-fca9cd242a17 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:18.874047 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943bea4-9499-4f64-b69e-fca9cd242a17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:18.880788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943bea4-9499-4f64-b69e-fca9cd242a17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:18.882351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943bea4-9499-4f64-b69e-fca9cd242a17 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:18.895449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-2943bea4-9499-4f64-b69e-fca9cd242a17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:18.895449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:18.895449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:18.895449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:18.895449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:18.895449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:18.895449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:18.895449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:18.895449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:18.895449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:18.895449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:18.895449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:18.895449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:35:18.895449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:35:18.895449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:35:18.896382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:35:18.896382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:18.896382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:18.896382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:18.896382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:18.896382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:18.896382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:18.896382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:18.896382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:18.896382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:18.896382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:18.896382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:18.896382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:18.896382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:18.896382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:18.896382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:18.896382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:18.897262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:35:18.897262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:35:18.897262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:35:18.897262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:35:18.897262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:35:18.897262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:35:18.897262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:18.897262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:18.897262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 352/705] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:18.897741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943bea4-9499-4f64-b69e-fca9cd242a17 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:18.910453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27381f-3364-45b2-a6e4-ff7eafb415ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:18.911085 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27381f-3364-45b2-a6e4-ff7eafb415ae None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:18.911387 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27381f-3364-45b2-a6e4-ff7eafb415ae None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:18.911671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27381f-3364-45b2-a6e4-ff7eafb415ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:18.922811 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27381f-3364-45b2-a6e4-ff7eafb415ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:18.924332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27381f-3364-45b2-a6e4-ff7eafb415ae None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:18.940197 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-6b27381f-3364-45b2-a6e4-ff7eafb415ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:18.940197 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:18.940197 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:18.940197 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:18.940197 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:18.940197 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:18.940197 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:18.940197 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:18.940197 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:18.940197 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:18.940197 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:18.940197 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:18.940197 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:18.940197 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:18.940197 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:18.940197 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:18.941232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:18.941232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:18.941232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:18.941232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:18.941232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:18.941232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:18.941232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:18.941232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:18.941232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:18.941232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:18.941232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:18.941232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:18.941232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:18.941232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:18.941232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:18.941232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:18.941232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:18.942084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:18.942084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:18.942084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:18.942084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 354/706] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:18.942311 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27381f-3364-45b2-a6e4-ff7eafb415ae None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:19.003955 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943bea4-9499-4f64-b69e-fca9cd242a17 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:19.025579 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:19.041274 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b1669-130d-4a9a-a47f-b324019da6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:19.042158 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b1669-130d-4a9a-a47f-b324019da6d4 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:19.042538 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b1669-130d-4a9a-a47f-b324019da6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:19.042902 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b1669-130d-4a9a-a47f-b324019da6d4 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:19.043876 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b1669-130d-4a9a-a47f-b324019da6d4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:19.044329 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b1669-130d-4a9a-a47f-b324019da6d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:19.044671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27381f-3364-45b2-a6e4-ff7eafb415ae None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:19.045848 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b1669-130d-4a9a-a47f-b324019da6d4 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:19.060255 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 353/707] 10.222.0.50 () {56 vars in 1124 bytes} [Thu Sep 1 13:35:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:19.060255 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021979a5-d075-49a0-8831-9c3998135ac8 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:19.060255 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021979a5-d075-49a0-8831-9c3998135ac8 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:19.060255 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021979a5-d075-49a0-8831-9c3998135ac8 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:19.060255 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 354/708] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:19.060255 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021979a5-d075-49a0-8831-9c3998135ac8 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:19.069716 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:19.080598 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6899ccf-2504-4993-bc40-5b6bd3b3c182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:19.085298 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6899ccf-2504-4993-bc40-5b6bd3b3c182 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:19.085298 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6899ccf-2504-4993-bc40-5b6bd3b3c182 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:19.085298 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6899ccf-2504-4993-bc40-5b6bd3b3c182 None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:19.085298 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6899ccf-2504-4993-bc40-5b6bd3b3c182 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:19.085298 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6899ccf-2504-4993-bc40-5b6bd3b3c182 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:19.085298 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6899ccf-2504-4993-bc40-5b6bd3b3c182 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:19.095862 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 355/709] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:35:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:19.096700 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6899ccf-2504-4993-bc40-5b6bd3b3c182 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:19.172203 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021979a5-d075-49a0-8831-9c3998135ac8 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:19.200485 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6899ccf-2504-4993-bc40-5b6bd3b3c182 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:19.205520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c8b70-ce8d-469a-8b6b-7c491ae31204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:19.206130 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c8b70-ce8d-469a-8b6b-7c491ae31204 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:19.206411 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c8b70-ce8d-469a-8b6b-7c491ae31204 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:19.206684 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c8b70-ce8d-469a-8b6b-7c491ae31204 None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:19.207400 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c8b70-ce8d-469a-8b6b-7c491ae31204 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:19.207713 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c8b70-ce8d-469a-8b6b-7c491ae31204 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:19.209176 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c8b70-ce8d-469a-8b6b-7c491ae31204 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:19.221877 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 355/710] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:35:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:19.223098 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60725d6-9c97-4f52-8a01-f76329677635 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:19.223402 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60725d6-9c97-4f52-8a01-f76329677635 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:19.223686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60725d6-9c97-4f52-8a01-f76329677635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:19.236175 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73914bf1-b500-4f8b-bd11-d237dedff364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:19.236806 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73914bf1-b500-4f8b-bd11-d237dedff364 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:19.237064 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73914bf1-b500-4f8b-bd11-d237dedff364 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:19.237331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73914bf1-b500-4f8b-bd11-d237dedff364 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:19.237969 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73914bf1-b500-4f8b-bd11-d237dedff364 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:19.238269 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73914bf1-b500-4f8b-bd11-d237dedff364 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:19.239651 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73914bf1-b500-4f8b-bd11-d237dedff364 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:19.242588 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-c60725d6-9c97-4f52-8a01-f76329677635 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:19.243817 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c60725d6-9c97-4f52-8a01-f76329677635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:19.249150 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:19.252484 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 356/711] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:19.256328 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73914bf1-b500-4f8b-bd11-d237dedff364 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:19.304783 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:19.311838 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 356/712] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:35:19.312672 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60725d6-9c97-4f52-8a01-f76329677635 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:19.361177 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73914bf1-b500-4f8b-bd11-d237dedff364 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:19.402373 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0064b-ee4c-4c3c-9442-3aee16deef33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:19.403537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0064b-ee4c-4c3c-9442-3aee16deef33 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:19.404378 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0064b-ee4c-4c3c-9442-3aee16deef33 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:19.405130 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0064b-ee4c-4c3c-9442-3aee16deef33 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:19.406338 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0064b-ee4c-4c3c-9442-3aee16deef33 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:19.407112 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0064b-ee4c-4c3c-9442-3aee16deef33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:19.408722 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0064b-ee4c-4c3c-9442-3aee16deef33 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:19.417900 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 357/713] 10.222.0.50 () {56 vars in 1124 bytes} [Thu Sep 1 13:35:19 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:19.419142 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0064b-ee4c-4c3c-9442-3aee16deef33 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:19.422274 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60725d6-9c97-4f52-8a01-f76329677635 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:19.460512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0eb0c1-6d53-4e83-bb25-3ced83e86605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:19.461961 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0eb0c1-6d53-4e83-bb25-3ced83e86605 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:19.462249 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0eb0c1-6d53-4e83-bb25-3ced83e86605 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:19.462527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0eb0c1-6d53-4e83-bb25-3ced83e86605 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:19.463339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0eb0c1-6d53-4e83-bb25-3ced83e86605 None admin] RBAC: Adding query filter params (role.id=98ffd3c114804da292d7cb33721e9085, scope.project.id=6283121e17814cd792df9d0edf81bf2d, user.id=2d231136bcd44d9a97efe6c257f936ed) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:19.463689 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0eb0c1-6d53-4e83-bb25-3ced83e86605 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:19.465222 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0eb0c1-6d53-4e83-bb25-3ced83e86605 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:19.471716 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 357/714] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:35:19 2022] GET /identity/v3/role_assignments?user.id=2d231136bcd44d9a97efe6c257f936ed&scope.project.id=6283121e17814cd792df9d0edf81bf2d&role.id=98ffd3c114804da292d7cb33721e9085 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:19.472722 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0eb0c1-6d53-4e83-bb25-3ced83e86605 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:19.515083 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:19.560343 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0064b-ee4c-4c3c-9442-3aee16deef33 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:19.562018 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:19.608809 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29f649-b302-4b95-b831-a3ac80369fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:19.610570 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29f649-b302-4b95-b831-a3ac80369fde None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:19.611266 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29f649-b302-4b95-b831-a3ac80369fde None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:19.611791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29f649-b302-4b95-b831-a3ac80369fde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:19.612792 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29f649-b302-4b95-b831-a3ac80369fde None admin] RBAC: Adding query filter params (role.id=f8c77ddd17fd4bc7af83e8d8905fb404, scope.project.id=6283121e17814cd792df9d0edf81bf2d, user.id=85bbede0f8674384bcc3028ea77eb724) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:19.613348 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29f649-b302-4b95-b831-a3ac80369fde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:19.616117 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29f649-b302-4b95-b831-a3ac80369fde None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:19.623288 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0eb0c1-6d53-4e83-bb25-3ced83e86605 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:19.625459 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 358/715] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:35:19 2022] GET /identity/v3/role_assignments?user.id=85bbede0f8674384bcc3028ea77eb724&scope.project.id=6283121e17814cd792df9d0edf81bf2d&role.id=f8c77ddd17fd4bc7af83e8d8905fb404 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:19.647840 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29f649-b302-4b95-b831-a3ac80369fde None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:19.685030 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67609b6a-cbc0-4988-85bc-e2a1c1803b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:19.685673 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67609b6a-cbc0-4988-85bc-e2a1c1803b7b None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:19.685987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67609b6a-cbc0-4988-85bc-e2a1c1803b7b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:19.686456 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67609b6a-cbc0-4988-85bc-e2a1c1803b7b None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:19.687143 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67609b6a-cbc0-4988-85bc-e2a1c1803b7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:19.689784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67609b6a-cbc0-4988-85bc-e2a1c1803b7b None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:19.783341 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29f649-b302-4b95-b831-a3ac80369fde None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:19.791186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 358/716] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 1 13:35:19 2022] POST /identity/v3/users => generated 254 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:35:19.817241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:19.826447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf0cc7-d3bf-43f8-b331-9c1c95a51df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:19.827104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf0cc7-d3bf-43f8-b331-9c1c95a51df3 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:19.827461 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf0cc7-d3bf-43f8-b331-9c1c95a51df3 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:19.827741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf0cc7-d3bf-43f8-b331-9c1c95a51df3 None admin] PATH_INFO: `/v3/services/network` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:19.828341 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf0cc7-d3bf-43f8-b331-9c1c95a51df3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:19.829757 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf0cc7-d3bf-43f8-b331-9c1c95a51df3 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:19.843664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-dbaf0cc7-d3bf-43f8-b331-9c1c95a51df3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 13:35:19.843664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:19.843664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:35:19.843664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:35:19.843664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:35:19.843664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:35:19.843664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:35:19.843664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:19.843664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 13:35:19.843664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:19.843664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:35:19.843664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:19.843664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:19.843664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:19.843664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:19.843664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:19.843664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:19.844710 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:19.844710 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:19.844710 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:19.844710 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:19.844710 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:19.844710 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:19.844710 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:35:19.844710 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:35:19.844710 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:35:19.844710 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:35:19.844710 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:19.844710 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:19.844710 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:19.844710 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:19.844710 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:19.844710 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:19.845521 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:19.845521 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:19.845521 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:19.845521 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:19.845521 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:19.845521 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:19.845521 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:19.845521 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:19.845521 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:19.845521 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:19.845521 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:35:19.845521 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:19.845521 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 13:35:19.845521 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:19.845521 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 359/717] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:19 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:19.851015 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67609b6a-cbc0-4988-85bc-e2a1c1803b7b None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:19.971076 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67609b6a-cbc0-4988-85bc-e2a1c1803b7b None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:19.989144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:20.008970 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008325f0-352b-4d45-9e90-a114112327cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:20.009599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008325f0-352b-4d45-9e90-a114112327cf None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:20.009864 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008325f0-352b-4d45-9e90-a114112327cf None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:20.010135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008325f0-352b-4d45-9e90-a114112327cf None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:20.010830 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008325f0-352b-4d45-9e90-a114112327cf None admin] RBAC: Adding query filter params (name=network) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:20.011131 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008325f0-352b-4d45-9e90-a114112327cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:20.012590 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008325f0-352b-4d45-9e90-a114112327cf None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:20.017551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 359/718] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Sep 1 13:35:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:20.023733 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf0cc7-d3bf-43f8-b331-9c1c95a51df3 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:20.140540 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf0cc7-d3bf-43f8-b331-9c1c95a51df3 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:20.180324 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696a519-757f-41b8-adc4-2759e32d0a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:20.181014 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696a519-757f-41b8-adc4-2759e32d0a2d None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:20.181327 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696a519-757f-41b8-adc4-2759e32d0a2d None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:20.181633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696a519-757f-41b8-adc4-2759e32d0a2d None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:20.182361 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696a519-757f-41b8-adc4-2759e32d0a2d None admin] RBAC: Adding query filter params (type=network) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:20.182687 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696a519-757f-41b8-adc4-2759e32d0a2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:20.184293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696a519-757f-41b8-adc4-2759e32d0a2d None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:20.190420 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 360/719] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Sep 1 13:35:20 2022] GET /identity/v3/services?type=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:21.583044 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79207ba-6421-4799-a9de-b7049680900d None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:21.583618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79207ba-6421-4799-a9de-b7049680900d None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:21.583618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79207ba-6421-4799-a9de-b7049680900d None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:21.585309 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 360/720] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:21.590450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52494c9b-abd6-4ca6-96c7-0f1c522b8fec None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:21.590974 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52494c9b-abd6-4ca6-96c7-0f1c522b8fec None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:21.590974 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52494c9b-abd6-4ca6-96c7-0f1c522b8fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:21.614249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-52494c9b-abd6-4ca6-96c7-0f1c522b8fec None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:21.615516 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-52494c9b-abd6-4ca6-96c7-0f1c522b8fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:21.700534 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:21.717751 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 361/721] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:35:22.055952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79207ba-6421-4799-a9de-b7049680900d None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:22.196752 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79207ba-6421-4799-a9de-b7049680900d None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:22.246995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab3272-3cf1-451c-adc4-2e07f69123c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:22.247643 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab3272-3cf1-451c-adc4-2e07f69123c9 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:22.247929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab3272-3cf1-451c-adc4-2e07f69123c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:22.248205 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab3272-3cf1-451c-adc4-2e07f69123c9 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:22.248870 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab3272-3cf1-451c-adc4-2e07f69123c9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:22.250282 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab3272-3cf1-451c-adc4-2e07f69123c9 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:22.255891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd08a71-6293-4703-bb0a-9095d378131c None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:22.256169 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd08a71-6293-4703-bb0a-9095d378131c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:22.256439 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd08a71-6293-4703-bb0a-9095d378131c None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:22.258589 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 362/722] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:22.264022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c069588-7c75-4ee1-9f39-955a0fc025da None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:22.268108 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c069588-7c75-4ee1-9f39-955a0fc025da None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:22.268108 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c069588-7c75-4ee1-9f39-955a0fc025da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:22.287774 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-6c069588-7c75-4ee1-9f39-955a0fc025da None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:22.289159 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-6c069588-7c75-4ee1-9f39-955a0fc025da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:22.354548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 361/723] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Sep 1 13:35:22 2022] POST /identity/v3/services => generated 251 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:35:22.388284 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2c509-19c3-4903-8c52-da13aa446a7b None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:22.388939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2c509-19c3-4903-8c52-da13aa446a7b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:22.389548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2c509-19c3-4903-8c52-da13aa446a7b None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:22.391457 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 362/724] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:35:22.405101 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40a1cf-365f-4e31-9d59-e7bdebc21ba8 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:22.405458 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40a1cf-365f-4e31-9d59-e7bdebc21ba8 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:22.405647 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40a1cf-365f-4e31-9d59-e7bdebc21ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:22.419271 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 363/725] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:22 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:35:22.429197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-5f40a1cf-365f-4e31-9d59-e7bdebc21ba8 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:22.430420 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-5f40a1cf-365f-4e31-9d59-e7bdebc21ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:22.472214 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:22.509331 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 363/726] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:22 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:35:22.538732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff71834-c040-4b29-bf10-660f4d65d177 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:22.539011 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff71834-c040-4b29-bf10-660f4d65d177 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:22.539464 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff71834-c040-4b29-bf10-660f4d65d177 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:22.541043 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 364/727] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:22.542375 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667493a-1543-44a6-b617-db81f0f804c4 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:22.542723 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667493a-1543-44a6-b617-db81f0f804c4 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:22.543030 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667493a-1543-44a6-b617-db81f0f804c4 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:22.545940 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 364/728] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:22.546552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d712396-d562-4c03-aa8f-f2759c84823a None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:22.546851 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d712396-d562-4c03-aa8f-f2759c84823a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:22.547194 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d712396-d562-4c03-aa8f-f2759c84823a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:22.552511 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cacaa8-8c43-4d49-a8db-cb29a566c638 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:22.553297 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cacaa8-8c43-4d49-a8db-cb29a566c638 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:22.553835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cacaa8-8c43-4d49-a8db-cb29a566c638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:22.576840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-01cacaa8-8c43-4d49-a8db-cb29a566c638 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:22.578424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-01cacaa8-8c43-4d49-a8db-cb29a566c638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:22.580490 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-1d712396-d562-4c03-aa8f-f2759c84823a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:22.581826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-1d712396-d562-4c03-aa8f-f2759c84823a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:22.670799 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 365/729] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:22 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:35:22.678892 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 365/730] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:22 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:35:22.762456 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cacaa8-8c43-4d49-a8db-cb29a566c638 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:22.817984 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d712396-d562-4c03-aa8f-f2759c84823a None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:22.880653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cacaa8-8c43-4d49-a8db-cb29a566c638 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:22.899989 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:22.939732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:22.943387 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13081e3c-019a-4ea3-b80e-f2e1b3724fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:22.944046 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13081e3c-019a-4ea3-b80e-f2e1b3724fab None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:22.944328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13081e3c-019a-4ea3-b80e-f2e1b3724fab None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:22.944601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13081e3c-019a-4ea3-b80e-f2e1b3724fab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:22.967553 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13081e3c-019a-4ea3-b80e-f2e1b3724fab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:35:22.972660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-13081e3c-019a-4ea3-b80e-f2e1b3724fab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:35:22.972660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:22.972660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:22.972660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:22.972660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:22.972660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:22.972660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:22.972660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:22.972660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:22.972660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:22.972660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:22.972660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:22.972660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:35:22.972660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:35:22.972660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:35:22.972660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:35:22.973678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:35:22.973678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:35:22.973678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:35:22.973678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:35:22.973678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:22.973678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:22.973678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:22.973678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:22.973678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:22.973678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:22.973678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:22.973678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:22.973678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:22.973678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:22.973678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:22.973678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:22.974503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:22.974503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:22.974503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:22.974503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:22.974503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:35:22.974503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:35:22.974503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:35:22.974503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:35:22.974503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:35:22.974503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:35:22.974503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:35:22.974503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:22.974503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 366/731] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:35:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:22.975170 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13081e3c-019a-4ea3-b80e-f2e1b3724fab None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:23.026617 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d712396-d562-4c03-aa8f-f2759c84823a None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:23.067797 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf81849-8157-42f5-aaba-efaaaa8865a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:23.068662 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf81849-8157-42f5-aaba-efaaaa8865a4 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:23.068835 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf81849-8157-42f5-aaba-efaaaa8865a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:23.068974 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf81849-8157-42f5-aaba-efaaaa8865a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:23.082567 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf81849-8157-42f5-aaba-efaaaa8865a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:35:23.087645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-6bf81849-8157-42f5-aaba-efaaaa8865a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:35:23.087645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:23.087645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:23.087645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:23.087645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:23.087645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:23.087645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:23.087645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:23.087645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:23.087645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:23.087645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:23.087645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:23.087645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:35:23.087645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:35:23.087645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:35:23.087645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:35:23.088637 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:35:23.088637 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:35:23.088637 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:35:23.088637 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:35:23.088637 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:23.088637 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:23.088637 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:23.088637 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:23.088637 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:23.088637 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:23.088637 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:23.088637 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:23.088637 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:23.088637 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:23.088637 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:23.088637 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:23.089530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:23.089530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:23.089530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:23.089530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:23.089530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:35:23.089530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:35:23.089530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:35:23.089530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:35:23.089530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:35:23.089530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:35:23.089530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:35:23.089530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:23.089530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 366/732] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 1 13:35:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:23.090194 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf81849-8157-42f5-aaba-efaaaa8865a4 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:23.109063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13081e3c-019a-4ea3-b80e-f2e1b3724fab None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:23.159022 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718c6a0-52a6-4920-895c-4e423bd0d6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:23.159700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718c6a0-52a6-4920-895c-4e423bd0d6b9 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:23.159980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718c6a0-52a6-4920-895c-4e423bd0d6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:23.160248 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718c6a0-52a6-4920-895c-4e423bd0d6b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:23.173094 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718c6a0-52a6-4920-895c-4e423bd0d6b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:35:23.177929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-d718c6a0-52a6-4920-895c-4e423bd0d6b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:35:23.177929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:23.177929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:23.177929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:23.177929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:23.177929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:23.177929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:23.177929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:23.177929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:23.177929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:23.177929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:23.177929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:23.177929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:35:23.177929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:35:23.177929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:35:23.177929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:35:23.178860 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:35:23.178860 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:35:23.178860 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:35:23.178860 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:35:23.178860 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:23.178860 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:23.178860 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:23.178860 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:23.178860 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:23.178860 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:23.178860 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:23.178860 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:23.178860 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:23.178860 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:23.178860 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:23.178860 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:23.180279 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:23.180279 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:23.180279 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:23.180279 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:23.180279 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:35:23.180279 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:35:23.180279 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:35:23.180279 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:35:23.180279 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:35:23.180279 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:35:23.180279 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:35:23.180279 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:23.180279 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 367/733] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:35:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:23.180985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718c6a0-52a6-4920-895c-4e423bd0d6b9 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:23.209274 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:23.216910 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf81849-8157-42f5-aaba-efaaaa8865a4 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:23.223530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:23.260626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a70bbf-0e32-4e3b-824f-c2b9dfeb3e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:23.261235 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a70bbf-0e32-4e3b-824f-c2b9dfeb3e7f None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:23.261512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a70bbf-0e32-4e3b-824f-c2b9dfeb3e7f None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:23.261785 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a70bbf-0e32-4e3b-824f-c2b9dfeb3e7f None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:23.262435 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a70bbf-0e32-4e3b-824f-c2b9dfeb3e7f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:23.263882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a70bbf-0e32-4e3b-824f-c2b9dfeb3e7f None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:23.301152 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718c6a0-52a6-4920-895c-4e423bd0d6b9 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:23.344523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 367/734] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Sep 1 13:35:23 2022] POST /identity/v3/services => generated 240 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:35:23.345607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a70bbf-0e32-4e3b-824f-c2b9dfeb3e7f None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:23.364717 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9a18b-00ca-46f4-92b1-6472ac8285cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:23.366261 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9a18b-00ca-46f4-92b1-6472ac8285cb None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:23.367054 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9a18b-00ca-46f4-92b1-6472ac8285cb None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:23.368959 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9a18b-00ca-46f4-92b1-6472ac8285cb None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:23.370726 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9a18b-00ca-46f4-92b1-6472ac8285cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:23.371660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9a18b-00ca-46f4-92b1-6472ac8285cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:23.375715 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9a18b-00ca-46f4-92b1-6472ac8285cb None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:23.390955 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 368/735] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:35:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:23.392727 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9a18b-00ca-46f4-92b1-6472ac8285cb None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:23.514753 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a70bbf-0e32-4e3b-824f-c2b9dfeb3e7f None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:23.516664 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:23.549981 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9a18b-00ca-46f4-92b1-6472ac8285cb None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:23.580714 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9012578-2825-4df0-bae3-a06c34682c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:23.581743 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9012578-2825-4df0-bae3-a06c34682c31 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:23.582110 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9012578-2825-4df0-bae3-a06c34682c31 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:23.582355 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9012578-2825-4df0-bae3-a06c34682c31 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:23.583021 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9012578-2825-4df0-bae3-a06c34682c31 None admin] RBAC: Adding query filter params (name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:23.583270 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9012578-2825-4df0-bae3-a06c34682c31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:23.585194 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9012578-2825-4df0-bae3-a06c34682c31 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:23.598004 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dbdd80-d58d-4e94-b320-7c82ae6edf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:23.598706 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbdd80-d58d-4e94-b320-7c82ae6edf59 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:23.598998 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbdd80-d58d-4e94-b320-7c82ae6edf59 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:23.599317 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dbdd80-d58d-4e94-b320-7c82ae6edf59 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:23.600024 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dbdd80-d58d-4e94-b320-7c82ae6edf59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:23.600328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dbdd80-d58d-4e94-b320-7c82ae6edf59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:23.602341 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dbdd80-d58d-4e94-b320-7c82ae6edf59 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:23.603502 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 368/736] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 1 13:35:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:23.606974 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9012578-2825-4df0-bae3-a06c34682c31 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:23.618960 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 369/737] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:35:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:23.624618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dbdd80-d58d-4e94-b320-7c82ae6edf59 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:23.645173 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:23.746544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9012578-2825-4df0-bae3-a06c34682c31 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:23.765386 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dbdd80-d58d-4e94-b320-7c82ae6edf59 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:23.794461 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb535667-6b23-4dd0-a429-7b1a0ee1f5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:23.795092 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb535667-6b23-4dd0-a429-7b1a0ee1f5a6 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:23.795396 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb535667-6b23-4dd0-a429-7b1a0ee1f5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:23.795669 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb535667-6b23-4dd0-a429-7b1a0ee1f5a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:23.808550 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb535667-6b23-4dd0-a429-7b1a0ee1f5a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:23.810253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb535667-6b23-4dd0-a429-7b1a0ee1f5a6 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:23.819578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3d5d1-0870-4658-ada6-859cf38446bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:23.821400 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3d5d1-0870-4658-ada6-859cf38446bc None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:23.822180 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3d5d1-0870-4658-ada6-859cf38446bc None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:23.822854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3d5d1-0870-4658-ada6-859cf38446bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:23.826993 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-cb535667-6b23-4dd0-a429-7b1a0ee1f5a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:23.826993 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:23.826993 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:23.826993 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:23.826993 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:23.826993 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:23.826993 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:23.826993 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:23.826993 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:23.826993 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:23.826993 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:23.826993 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:23.826993 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:23.826993 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:23.826993 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:23.826993 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:23.829094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:23.829094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:23.829094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:23.829094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:23.829094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:23.829094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:23.829094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:23.829094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:23.829094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:23.829094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:23.829094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:23.829094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:23.829094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:23.829094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:23.829094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:23.829094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:23.829094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:23.831197 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:23.831197 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:23.831197 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:23.831197 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 369/738] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:23.831197 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb535667-6b23-4dd0-a429-7b1a0ee1f5a6 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:23.852487 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:23.857357 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d3d5d1-0870-4658-ada6-859cf38446bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:23.860472 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d3d5d1-0870-4658-ada6-859cf38446bc None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:23.888930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-e6d3d5d1-0870-4658-ada6-859cf38446bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:23.888930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:23.888930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:23.888930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:23.888930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:23.888930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:23.888930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:23.888930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:23.888930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:23.888930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:23.888930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:23.888930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:23.888930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:23.888930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:23.888930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:23.888930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:23.890683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:23.890683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:23.890683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:23.890683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:23.890683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:23.890683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:23.890683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:23.890683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:23.890683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:23.890683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:23.890683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:23.890683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:23.890683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:23.890683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:23.890683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:23.890683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:23.890683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:23.892396 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:23.892396 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:23.892396 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:23.903263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 370/739] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:23.905060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3d5d1-0870-4658-ada6-859cf38446bc None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:23.927199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:23.950995 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb535667-6b23-4dd0-a429-7b1a0ee1f5a6 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:23.987263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fe11f-7b83-4239-9d6b-9c5e92d93fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:23.988107 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fe11f-7b83-4239-9d6b-9c5e92d93fbf None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:23.988282 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fe11f-7b83-4239-9d6b-9c5e92d93fbf None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:23.988466 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fe11f-7b83-4239-9d6b-9c5e92d93fbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:23.999454 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fe11f-7b83-4239-9d6b-9c5e92d93fbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:24.001000 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fe11f-7b83-4239-9d6b-9c5e92d93fbf None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:24.015929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-5d4fe11f-7b83-4239-9d6b-9c5e92d93fbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:24.015929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:24.015929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:24.015929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:24.015929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:24.015929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:24.015929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:24.015929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:24.015929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:24.015929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:24.015929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:24.015929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:24.015929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:24.015929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:24.015929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:24.015929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:24.017904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:24.017904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:24.017904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:24.017904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:24.017904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:24.017904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:24.017904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:24.017904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:24.017904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:24.017904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:24.017904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:24.017904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:24.017904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:24.017904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:24.017904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:24.017904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:24.017904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:24.019615 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:24.019615 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:24.019615 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:24.019615 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 370/740] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:24.019615 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fe11f-7b83-4239-9d6b-9c5e92d93fbf None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:24.070896 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3d5d1-0870-4658-ada6-859cf38446bc None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:24.110843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d394ed-f454-4f27-8cc4-638f2b04ef88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:24.111381 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d394ed-f454-4f27-8cc4-638f2b04ef88 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:24.111749 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d394ed-f454-4f27-8cc4-638f2b04ef88 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:24.111950 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d394ed-f454-4f27-8cc4-638f2b04ef88 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:24.112594 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d394ed-f454-4f27-8cc4-638f2b04ef88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:24.112896 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d394ed-f454-4f27-8cc4-638f2b04ef88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:24.114293 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d394ed-f454-4f27-8cc4-638f2b04ef88 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:24.131764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 371/741] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:24.131764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d394ed-f454-4f27-8cc4-638f2b04ef88 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:24.182955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fe11f-7b83-4239-9d6b-9c5e92d93fbf None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:24.187332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:24.214132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:24.223968 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd0d35-e291-45a4-ba09-8d3cdac0a8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:24.224899 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd0d35-e291-45a4-ba09-8d3cdac0a8a0 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:24.225349 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd0d35-e291-45a4-ba09-8d3cdac0a8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:24.225789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd0d35-e291-45a4-ba09-8d3cdac0a8a0 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:24.226672 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd0d35-e291-45a4-ba09-8d3cdac0a8a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:24.227656 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd0d35-e291-45a4-ba09-8d3cdac0a8a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:24.228976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd0d35-e291-45a4-ba09-8d3cdac0a8a0 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:24.236896 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d394ed-f454-4f27-8cc4-638f2b04ef88 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:24.247261 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 371/742] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:24.249281 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd0d35-e291-45a4-ba09-8d3cdac0a8a0 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:24.272626 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc5b75-2e70-4311-ae70-4af1dd15e560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:24.273075 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc5b75-2e70-4311-ae70-4af1dd15e560 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:24.273355 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc5b75-2e70-4311-ae70-4af1dd15e560 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:24.273626 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc5b75-2e70-4311-ae70-4af1dd15e560 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:24.274261 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc5b75-2e70-4311-ae70-4af1dd15e560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:24.274562 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc5b75-2e70-4311-ae70-4af1dd15e560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:24.275974 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc5b75-2e70-4311-ae70-4af1dd15e560 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:24.288548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 372/743] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:24.289502 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc5b75-2e70-4311-ae70-4af1dd15e560 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:24.365311 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd0d35-e291-45a4-ba09-8d3cdac0a8a0 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:24.391448 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc5b75-2e70-4311-ae70-4af1dd15e560 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:24.404989 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:24.408196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba52d8-ee78-41a6-8401-39fe8238c02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:24.409125 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba52d8-ee78-41a6-8401-39fe8238c02f None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:24.409609 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba52d8-ee78-41a6-8401-39fe8238c02f None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:24.410107 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba52d8-ee78-41a6-8401-39fe8238c02f None admin] PATH_INFO: `/v3/users/nova` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:24.418594 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba52d8-ee78-41a6-8401-39fe8238c02f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:24.420517 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba52d8-ee78-41a6-8401-39fe8238c02f None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:24.426432 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648484f-fa6b-40af-8fe5-666829ab5356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:24.427056 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648484f-fa6b-40af-8fe5-666829ab5356 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:24.427329 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648484f-fa6b-40af-8fe5-666829ab5356 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:24.427627 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648484f-fa6b-40af-8fe5-666829ab5356 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:24.435159 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-4eba52d8-ee78-41a6-8401-39fe8238c02f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:35:24.435159 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:24.435159 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:24.435159 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:24.435159 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:24.435159 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:24.435159 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:24.435159 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:24.435159 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:24.435159 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:24.435159 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:24.435159 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:24.435159 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:35:24.435159 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:35:24.435159 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:35:24.435159 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:35:24.436127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:24.436127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:24.436127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:35:24.436127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:24.436127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:35:24.436127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:24.436127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:24.436127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:24.436127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:24.436127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:24.436127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:24.436127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:24.436127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:24.436127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:24.436127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:24.436127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:24.436127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:24.436127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:24.437019 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:24.437019 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:24.437019 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:35:24.437019 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:35:24.437019 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:35:24.437019 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:35:24.437019 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:35:24.437019 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:35:24.437019 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:35:24.437019 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:24.437531 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648484f-fa6b-40af-8fe5-666829ab5356 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:24.437531 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648484f-fa6b-40af-8fe5-666829ab5356 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:24.445464 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 372/744] 10.222.0.50 () {56 vars in 1093 bytes} [Thu Sep 1 13:35:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:24.446657 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba52d8-ee78-41a6-8401-39fe8238c02f None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:24.457865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-9648484f-fa6b-40af-8fe5-666829ab5356 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 13:35:24.457865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:24.457865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:24.457865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:24.457865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:24.457865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:24.457865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:24.457865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:24.457865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:24.457865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:24.457865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:24.457865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:24.457865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:35:24.457865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:35:24.457865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:35:24.457865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:35:24.459071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:24.459071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:24.459071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:35:24.459071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:24.459071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:35:24.459071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:24.459071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:24.459071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:24.459071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:24.459071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:24.459071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:24.459071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:24.459071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:24.459071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:24.459071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:24.459071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:24.459071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:24.459071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:24.460366 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:24.460366 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:24.460366 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:35:24.460366 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:35:24.460366 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:35:24.460366 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:35:24.460366 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:35:24.460366 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:35:24.460366 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 13:35:24.460366 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:24.469048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 373/745] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Sep 1 13:35:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:24.469048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648484f-fa6b-40af-8fe5-666829ab5356 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:24.522948 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:24.614224 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648484f-fa6b-40af-8fe5-666829ab5356 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:24.614738 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba52d8-ee78-41a6-8401-39fe8238c02f None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:24.651602 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9faa1-f3fc-49b4-be65-bf084b30e177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:24.652294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9faa1-f3fc-49b4-be65-bf084b30e177 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:24.652679 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9faa1-f3fc-49b4-be65-bf084b30e177 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:24.653059 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9faa1-f3fc-49b4-be65-bf084b30e177 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:24.653903 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9faa1-f3fc-49b4-be65-bf084b30e177 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:24.654305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9faa1-f3fc-49b4-be65-bf084b30e177 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:24.655013 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a99f9-f853-456e-ba99-3bcbbfaa623e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:24.655846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a99f9-f853-456e-ba99-3bcbbfaa623e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:24.656468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9faa1-f3fc-49b4-be65-bf084b30e177 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:24.656845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a99f9-f853-456e-ba99-3bcbbfaa623e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:24.657280 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a99f9-f853-456e-ba99-3bcbbfaa623e None admin] PATH_INFO: `/v3/users/swift` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:24.667745 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a99f9-f853-456e-ba99-3bcbbfaa623e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:24.670002 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a99f9-f853-456e-ba99-3bcbbfaa623e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:24.684799 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 374/746] 10.222.0.50 () {56 vars in 1133 bytes} [Thu Sep 1 13:35:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:24.684799 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9faa1-f3fc-49b4-be65-bf084b30e177 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:24.687949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-b16a99f9-f853-456e-ba99-3bcbbfaa623e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 13:35:24.687949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:24.687949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:24.687949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:24.687949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:24.687949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:24.687949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:24.687949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:24.687949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:24.687949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:24.687949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:24.687949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:24.687949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:35:24.687949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:35:24.687949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:35:24.687949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:35:24.688947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:24.688947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:24.688947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:35:24.688947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:24.688947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:35:24.688947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:24.688947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:24.688947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:24.688947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:24.688947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:24.688947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:24.688947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:24.688947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:24.688947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:24.688947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:24.688947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:24.688947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:24.688947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:24.689865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:24.689865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:24.689865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:35:24.689865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:35:24.689865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:35:24.689865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:35:24.689865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:35:24.689865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:35:24.689865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 13:35:24.689865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:24.689865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 373/747] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:35:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:24.690889 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20fd31-8a6d-498a-869d-4e961a08df5f None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:24.690889 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20fd31-8a6d-498a-869d-4e961a08df5f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:24.691119 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20fd31-8a6d-498a-869d-4e961a08df5f None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:24.692607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 374/748] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:24.693606 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20fd31-8a6d-498a-869d-4e961a08df5f None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:24.731967 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:24.816592 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9faa1-f3fc-49b4-be65-bf084b30e177 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:24.854704 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20fd31-8a6d-498a-869d-4e961a08df5f None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:24.861539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879cff6-8c1e-4a75-bf8b-5ae9bd9da36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:24.862165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879cff6-8c1e-4a75-bf8b-5ae9bd9da36a None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:24.862446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879cff6-8c1e-4a75-bf8b-5ae9bd9da36a None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:24.863022 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879cff6-8c1e-4a75-bf8b-5ae9bd9da36a None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:24.867402 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879cff6-8c1e-4a75-bf8b-5ae9bd9da36a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:24.867402 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879cff6-8c1e-4a75-bf8b-5ae9bd9da36a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:24.867646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:24.867724 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879cff6-8c1e-4a75-bf8b-5ae9bd9da36a None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:24.884888 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 375/749] 10.222.0.50 () {56 vars in 1149 bytes} [Thu Sep 1 13:35:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:24.885859 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879cff6-8c1e-4a75-bf8b-5ae9bd9da36a None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:24.902668 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340ac3c-40f6-49b2-8429-a10a33921f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:24.903792 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340ac3c-40f6-49b2-8429-a10a33921f3a None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:24.904291 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340ac3c-40f6-49b2-8429-a10a33921f3a None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:24.904786 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340ac3c-40f6-49b2-8429-a10a33921f3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:24.916744 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340ac3c-40f6-49b2-8429-a10a33921f3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:24.918645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340ac3c-40f6-49b2-8429-a10a33921f3a None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:24.936544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-8340ac3c-40f6-49b2-8429-a10a33921f3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:24.936544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:24.936544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:24.936544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:24.936544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:24.936544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:24.936544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:24.936544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:24.936544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:24.936544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:24.936544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:24.936544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:24.936544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:24.936544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:24.936544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:24.936544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:24.937552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:24.937552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:24.937552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:24.937552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:24.937552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:24.937552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:24.937552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:24.937552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:24.937552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:24.937552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:24.937552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:24.937552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:24.937552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:24.937552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:24.937552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:24.937552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:24.937552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:24.938419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:24.938419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:24.938419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:24.938419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 375/750] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:24.939593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ad7e0-905a-4a0c-bce6-1ad22d4fe22a None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:24.939957 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ad7e0-905a-4a0c-bce6-1ad22d4fe22a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:24.940298 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ad7e0-905a-4a0c-bce6-1ad22d4fe22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:24.967742 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-5c4ad7e0-905a-4a0c-bce6-1ad22d4fe22a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:24.968978 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-5c4ad7e0-905a-4a0c-bce6-1ad22d4fe22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:25.011222 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:25.031870 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879cff6-8c1e-4a75-bf8b-5ae9bd9da36a None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:25.074242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095cc90-343b-4880-9ac9-7bedd57aeb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:25.074867 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095cc90-343b-4880-9ac9-7bedd57aeb56 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:25.075138 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095cc90-343b-4880-9ac9-7bedd57aeb56 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:25.075498 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095cc90-343b-4880-9ac9-7bedd57aeb56 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:25.076190 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095cc90-343b-4880-9ac9-7bedd57aeb56 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:25.076500 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095cc90-343b-4880-9ac9-7bedd57aeb56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:25.077985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095cc90-343b-4880-9ac9-7bedd57aeb56 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:25.091794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 376/751] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:35:25.092945 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ad7e0-905a-4a0c-bce6-1ad22d4fe22a None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:25.102011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 376/752] 10.222.0.50 () {56 vars in 1135 bytes} [Thu Sep 1 13:35:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:25.102011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095cc90-343b-4880-9ac9-7bedd57aeb56 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:25.222342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095cc90-343b-4880-9ac9-7bedd57aeb56 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:25.228282 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:25.241770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ad7e0-905a-4a0c-bce6-1ad22d4fe22a None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:25.263634 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11666d17-0a5d-47fe-ae9b-f49dc2ca70fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:25.264471 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11666d17-0a5d-47fe-ae9b-f49dc2ca70fe None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:25.264877 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11666d17-0a5d-47fe-ae9b-f49dc2ca70fe None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:25.265234 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11666d17-0a5d-47fe-ae9b-f49dc2ca70fe None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:25.266243 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11666d17-0a5d-47fe-ae9b-f49dc2ca70fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:25.266414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11666d17-0a5d-47fe-ae9b-f49dc2ca70fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:25.268207 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11666d17-0a5d-47fe-ae9b-f49dc2ca70fe None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:25.288255 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 377/753] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:25.288693 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbb76e-4666-4ed8-97b5-e3e95a436ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:25.289516 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11666d17-0a5d-47fe-ae9b-f49dc2ca70fe None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:25.289652 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbb76e-4666-4ed8-97b5-e3e95a436ef5 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:25.290068 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbb76e-4666-4ed8-97b5-e3e95a436ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:25.290482 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbb76e-4666-4ed8-97b5-e3e95a436ef5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:25.302760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:25.384809 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbb76e-4666-4ed8-97b5-e3e95a436ef5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:25.386555 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbb76e-4666-4ed8-97b5-e3e95a436ef5 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:25.408353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11666d17-0a5d-47fe-ae9b-f49dc2ca70fe None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:25.442355 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57cac1-50a3-4dda-9161-41386c6b8791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:25.442961 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57cac1-50a3-4dda-9161-41386c6b8791 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:25.443243 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57cac1-50a3-4dda-9161-41386c6b8791 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:25.443552 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57cac1-50a3-4dda-9161-41386c6b8791 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:25.477908 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:25.487964 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 377/754] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:35:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:35:25.488802 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbb76e-4666-4ed8-97b5-e3e95a436ef5 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:25.516740 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57cac1-50a3-4dda-9161-41386c6b8791 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:25.518208 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57cac1-50a3-4dda-9161-41386c6b8791 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:25.526683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:25.590526 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbb76e-4666-4ed8-97b5-e3e95a436ef5 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:25.624848 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5b4e2-a3d8-4bd7-9125-014d3f69802f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:25.625405 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 378/755] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:35:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:35:25.625512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5b4e2-a3d8-4bd7-9125-014d3f69802f None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:25.625740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5b4e2-a3d8-4bd7-9125-014d3f69802f None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:25.626010 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5b4e2-a3d8-4bd7-9125-014d3f69802f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:25.626266 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57cac1-50a3-4dda-9161-41386c6b8791 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:25.633554 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5b4e2-a3d8-4bd7-9125-014d3f69802f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:25.634998 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5b4e2-a3d8-4bd7-9125-014d3f69802f None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:25.646278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-ffb5b4e2-a3d8-4bd7-9125-014d3f69802f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:25.646278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:25.646278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:25.646278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:25.646278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:25.646278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:25.646278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:25.646278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:25.646278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:25.646278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:25.646278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:25.646278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:25.646278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:35:25.646278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:35:25.646278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:35:25.647171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:35:25.647171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:25.647171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:25.647171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:25.647171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:25.647171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:25.647171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:25.647171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:25.647171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:25.647171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:25.647171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:25.647171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:25.647171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:25.647171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:25.647171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:25.647171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:25.647171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:25.648102 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:35:25.648102 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:35:25.648102 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:35:25.648102 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:35:25.648102 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:35:25.648102 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:35:25.648102 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:25.648102 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:25.648102 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 378/756] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:25.648917 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7935386-da8a-45b4-87fe-5275869bb91f None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:25.648917 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7935386-da8a-45b4-87fe-5275869bb91f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:25.649092 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7935386-da8a-45b4-87fe-5275869bb91f None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:25.650481 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 379/757] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:25.651001 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7935386-da8a-45b4-87fe-5275869bb91f None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:25.704926 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:25.731172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57cac1-50a3-4dda-9161-41386c6b8791 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:25.739101 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:25.755970 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7935386-da8a-45b4-87fe-5275869bb91f None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:25.766179 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd70c5-00cd-46d2-af3f-58fa13b5004b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:25.766812 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd70c5-00cd-46d2-af3f-58fa13b5004b None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:25.767090 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd70c5-00cd-46d2-af3f-58fa13b5004b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:25.767446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd70c5-00cd-46d2-af3f-58fa13b5004b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:25.768034 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd70c5-00cd-46d2-af3f-58fa13b5004b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:25.769407 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd70c5-00cd-46d2-af3f-58fa13b5004b None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:25.778604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-8fcd70c5-00cd-46d2-af3f-58fa13b5004b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 13:35:25.778604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:25.778604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:35:25.778604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:35:25.778604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:35:25.778604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:35:25.778604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:35:25.778604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:25.778604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 13:35:25.778604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:25.778604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:35:25.778604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:25.778604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:25.778604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:25.778604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:25.778604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:25.778604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:25.779763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:25.779763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:25.779763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:25.779763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:25.779763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:25.779763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:25.779763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:35:25.779763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:35:25.779763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:35:25.779763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:35:25.779763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:25.779763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:25.779763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:25.779763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:25.779763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:25.779763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:25.780598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:25.780598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:25.780598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:25.780598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:25.780598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:25.780598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:25.780598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:25.780598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:25.780598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:25.780598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:25.780598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:35:25.780598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:25.780598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 13:35:25.780598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:25.780598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 379/758] 10.222.0.50 () {56 vars in 1129 bytes} [Thu Sep 1 13:35:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:25.781363 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd70c5-00cd-46d2-af3f-58fa13b5004b None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:25.793320 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc34c4f-0a95-4f30-ad57-78743eb9e084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:25.793951 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc34c4f-0a95-4f30-ad57-78743eb9e084 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:25.794232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc34c4f-0a95-4f30-ad57-78743eb9e084 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:25.794505 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc34c4f-0a95-4f30-ad57-78743eb9e084 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:25.805798 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc34c4f-0a95-4f30-ad57-78743eb9e084 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:25.807258 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc34c4f-0a95-4f30-ad57-78743eb9e084 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:25.822892 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-2cc34c4f-0a95-4f30-ad57-78743eb9e084 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:25.822892 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:25.822892 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:25.822892 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:25.822892 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:25.822892 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:25.822892 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:25.822892 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:25.822892 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:25.822892 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:25.822892 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:25.822892 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:25.822892 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:25.822892 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:25.822892 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:25.822892 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:25.824022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:25.824022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:25.824022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:25.824022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:25.824022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:25.824022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:25.824022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:25.824022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:25.824022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:25.824022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:25.824022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:25.824022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:25.824022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:25.824022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:25.824022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:25.824022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:25.824022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:25.824882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:25.824882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:25.824882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:25.824882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 380/759] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:25.825139 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc34c4f-0a95-4f30-ad57-78743eb9e084 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:25.887084 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd70c5-00cd-46d2-af3f-58fa13b5004b None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:25.920970 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea7a08-401c-49f4-8a4d-646b710739bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:25.921590 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea7a08-401c-49f4-8a4d-646b710739bd None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:25.921868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea7a08-401c-49f4-8a4d-646b710739bd None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:25.922141 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea7a08-401c-49f4-8a4d-646b710739bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:25.932525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc34c4f-0a95-4f30-ad57-78743eb9e084 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:25.933128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea7a08-401c-49f4-8a4d-646b710739bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:25.934043 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:25.934661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea7a08-401c-49f4-8a4d-646b710739bd None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:25.949374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-4bea7a08-401c-49f4-8a4d-646b710739bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:25.949374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:25.949374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:25.949374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:25.949374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:25.949374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:25.949374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:25.949374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:25.949374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:25.949374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:25.949374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:25.949374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:25.949374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:25.949374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:25.949374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:25.949374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:25.950426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:25.950426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:25.950426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:25.950426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:25.950426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:25.950426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:25.950426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:25.950426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:25.950426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:25.950426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:25.950426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:25.950426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:25.950426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:25.950426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:25.950426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:25.950426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:25.950426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:25.951292 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:25.951292 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:25.951292 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:25.951292 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 380/760] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:25.951983 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dd74d-a055-4432-a1bf-732c8552e083 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:25.951983 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dd74d-a055-4432-a1bf-732c8552e083 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:25.952227 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dd74d-a055-4432-a1bf-732c8552e083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:25.968604 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf47ac1-bcb2-4a88-947a-6ad96eca4e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:25.969220 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf47ac1-bcb2-4a88-947a-6ad96eca4e40 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:25.969500 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf47ac1-bcb2-4a88-947a-6ad96eca4e40 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:25.969770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf47ac1-bcb2-4a88-947a-6ad96eca4e40 None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:25.969869 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-d01dd74d-a055-4432-a1bf-732c8552e083 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:25.970455 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf47ac1-bcb2-4a88-947a-6ad96eca4e40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:25.970824 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf47ac1-bcb2-4a88-947a-6ad96eca4e40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:25.970965 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-d01dd74d-a055-4432-a1bf-732c8552e083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:25.972312 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf47ac1-bcb2-4a88-947a-6ad96eca4e40 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:25.988451 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:25.990707 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 381/761] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:35:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:25.992170 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf47ac1-bcb2-4a88-947a-6ad96eca4e40 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:26.048086 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 381/762] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:35:26.048086 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01dd74d-a055-4432-a1bf-732c8552e083 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:26.093364 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf47ac1-bcb2-4a88-947a-6ad96eca4e40 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:26.130245 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefec08-8338-4a30-a06c-6720e43dd3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:26.130854 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefec08-8338-4a30-a06c-6720e43dd3fd None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:26.131137 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefec08-8338-4a30-a06c-6720e43dd3fd None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:26.131431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefec08-8338-4a30-a06c-6720e43dd3fd None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:26.132096 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefec08-8338-4a30-a06c-6720e43dd3fd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:26.132398 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefec08-8338-4a30-a06c-6720e43dd3fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:26.133770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefec08-8338-4a30-a06c-6720e43dd3fd None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:26.138334 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 382/763] 10.222.0.50 () {56 vars in 1124 bytes} [Thu Sep 1 13:35:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:26.139124 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefec08-8338-4a30-a06c-6720e43dd3fd None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:26.160551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01dd74d-a055-4432-a1bf-732c8552e083 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:26.195546 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc0615-d814-472f-9bad-a4bcdd8365dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:26.196161 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc0615-d814-472f-9bad-a4bcdd8365dd None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:26.196444 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc0615-d814-472f-9bad-a4bcdd8365dd None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:26.196730 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc0615-d814-472f-9bad-a4bcdd8365dd None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:26.197381 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc0615-d814-472f-9bad-a4bcdd8365dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:26.197685 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc0615-d814-472f-9bad-a4bcdd8365dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:26.199071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc0615-d814-472f-9bad-a4bcdd8365dd None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:26.210468 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:26.210657 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 382/764] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:26.211328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc0615-d814-472f-9bad-a4bcdd8365dd None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:26.230154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:26.292530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefec08-8338-4a30-a06c-6720e43dd3fd None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:26.324940 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc0615-d814-472f-9bad-a4bcdd8365dd None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:26.329991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30241bf7-3e28-48d7-97e2-7bd69eff5e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:26.330588 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30241bf7-3e28-48d7-97e2-7bd69eff5e03 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:26.330863 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30241bf7-3e28-48d7-97e2-7bd69eff5e03 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:26.331131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30241bf7-3e28-48d7-97e2-7bd69eff5e03 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:26.331804 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30241bf7-3e28-48d7-97e2-7bd69eff5e03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:26.332106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30241bf7-3e28-48d7-97e2-7bd69eff5e03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:26.333467 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30241bf7-3e28-48d7-97e2-7bd69eff5e03 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:26.344910 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 383/765] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:26.345715 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30241bf7-3e28-48d7-97e2-7bd69eff5e03 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:26.364620 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037c9e9-a009-48fc-8147-1dfc19bfee10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:26.365310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037c9e9-a009-48fc-8147-1dfc19bfee10 None admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:26.365595 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037c9e9-a009-48fc-8147-1dfc19bfee10 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:26.365871 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037c9e9-a009-48fc-8147-1dfc19bfee10 None admin] PATH_INFO: `/v3/projects/6283121e17814cd792df9d0edf81bf2d/users/2d231136bcd44d9a97efe6c257f936ed/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:26.368240 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037c9e9-a009-48fc-8147-1dfc19bfee10 None admin] RBAC: Authorizing `identity:create_grant(project_id=6283121e17814cd792df9d0edf81bf2d, user_id=2d231136bcd44d9a97efe6c257f936ed, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:26.369686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037c9e9-a009-48fc-8147-1dfc19bfee10 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:26.429600 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:26.440185 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 383/766] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 1 13:35:26 2022] PUT /identity/v3/projects/6283121e17814cd792df9d0edf81bf2d/users/2d231136bcd44d9a97efe6c257f936ed/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:35:26.451548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037c9e9-a009-48fc-8147-1dfc19bfee10 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:26.451671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30241bf7-3e28-48d7-97e2-7bd69eff5e03 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:26.489624 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e93c6-b463-4060-94d4-16584d66ff9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:26.490325 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e93c6-b463-4060-94d4-16584d66ff9c None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:26.490610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e93c6-b463-4060-94d4-16584d66ff9c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:26.490894 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e93c6-b463-4060-94d4-16584d66ff9c None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:26.491607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e93c6-b463-4060-94d4-16584d66ff9c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:26.491922 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e93c6-b463-4060-94d4-16584d66ff9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:26.493394 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e93c6-b463-4060-94d4-16584d66ff9c None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:26.503701 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 384/767] 10.222.0.50 () {56 vars in 1124 bytes} [Thu Sep 1 13:35:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:26.503701 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e93c6-b463-4060-94d4-16584d66ff9c None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:26.546275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:26.579020 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037c9e9-a009-48fc-8147-1dfc19bfee10 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:26.619833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e93c6-b463-4060-94d4-16584d66ff9c None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:26.622208 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31899f-d675-44b0-a545-6a536c4c1eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:26.623760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31899f-d675-44b0-a545-6a536c4c1eb8 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:26.624042 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31899f-d675-44b0-a545-6a536c4c1eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:26.624318 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31899f-d675-44b0-a545-6a536c4c1eb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:26.633113 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31899f-d675-44b0-a545-6a536c4c1eb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:26.635211 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31899f-d675-44b0-a545-6a536c4c1eb8 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:26.651238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-bb31899f-d675-44b0-a545-6a536c4c1eb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:26.651238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:26.651238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:26.651238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:26.651238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:26.651238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:26.651238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:26.651238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:26.651238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:26.651238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:26.651238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:26.651238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:26.651238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:35:26.651238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:35:26.651238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:35:26.652221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:35:26.652221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:26.652221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:26.652221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:26.652221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:26.652221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:26.652221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:26.652221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:26.652221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:26.652221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:26.652221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:26.652221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:26.652221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:26.652221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:26.652221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:26.652221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:26.652221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:26.653569 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:35:26.653569 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:35:26.653569 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:35:26.653569 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:35:26.653569 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:35:26.653569 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:35:26.653569 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:26.653569 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:26.653569 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 384/768] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:26.653569 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31899f-d675-44b0-a545-6a536c4c1eb8 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:26.660307 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a16df-8bb8-4e3f-9fc5-b3177a126792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:26.661217 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a16df-8bb8-4e3f-9fc5-b3177a126792 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:26.661721 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a16df-8bb8-4e3f-9fc5-b3177a126792 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:26.662178 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a16df-8bb8-4e3f-9fc5-b3177a126792 None admin] PATH_INFO: `/v3/services/network` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:26.664015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a16df-8bb8-4e3f-9fc5-b3177a126792 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:26.666041 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a16df-8bb8-4e3f-9fc5-b3177a126792 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:26.677927 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-415a16df-8bb8-4e3f-9fc5-b3177a126792 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 13:35:26.677927 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:26.677927 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:35:26.677927 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:35:26.677927 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:35:26.677927 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:35:26.677927 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:35:26.677927 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:26.677927 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 13:35:26.677927 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:26.677927 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:35:26.677927 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:26.677927 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:26.677927 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:26.677927 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:26.677927 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:26.677927 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:26.679003 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:26.679003 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:26.679003 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:26.679003 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:26.679003 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:26.679003 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:26.679003 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:35:26.679003 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:35:26.679003 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:35:26.679003 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:35:26.679003 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:26.679003 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:26.679003 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:26.679003 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:26.679003 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:26.679003 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:26.679903 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:26.679903 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:26.679903 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:26.679903 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:26.679903 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:26.679903 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:26.679903 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:26.679903 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:26.679903 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:26.679903 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:26.679903 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:35:26.679903 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:26.679903 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 13:35:26.679903 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:26.685850 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 385/769] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:26 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:26.685850 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a16df-8bb8-4e3f-9fc5-b3177a126792 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:26.701282 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:26.788500 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31899f-d675-44b0-a545-6a536c4c1eb8 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:26.800138 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a16df-8bb8-4e3f-9fc5-b3177a126792 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:26.837097 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:26.838930 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c66b6-0f3c-4e31-ae74-c33813d95cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:26.839575 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c66b6-0f3c-4e31-ae74-c33813d95cc4 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:26.839948 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c66b6-0f3c-4e31-ae74-c33813d95cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:26.840221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c66b6-0f3c-4e31-ae74-c33813d95cc4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:26.840933 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c66b6-0f3c-4e31-ae74-c33813d95cc4 None admin] RBAC: Adding query filter params (interface=public, service_id=d8693053b89e447dbaa3db79b5992a03, region_id=RegionOne) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:26.841233 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c66b6-0f3c-4e31-ae74-c33813d95cc4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:26.842709 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c66b6-0f3c-4e31-ae74-c33813d95cc4 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:26.846968 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ec0a1-d28c-4729-9e70-a620c2a5cfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:26.847644 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ec0a1-d28c-4729-9e70-a620c2a5cfb4 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:26.847923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ec0a1-d28c-4729-9e70-a620c2a5cfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:26.849385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ec0a1-d28c-4729-9e70-a620c2a5cfb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:26.851108 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 386/770] 10.222.0.50 () {56 vars in 1251 bytes} [Thu Sep 1 13:35:26 2022] GET /identity/v3/endpoints?service_id=d8693053b89e447dbaa3db79b5992a03&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:26.852114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c66b6-0f3c-4e31-ae74-c33813d95cc4 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:26.855700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ec0a1-d28c-4729-9e70-a620c2a5cfb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:26.857458 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ec0a1-d28c-4729-9e70-a620c2a5cfb4 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:26.869413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-fb9ec0a1-d28c-4729-9e70-a620c2a5cfb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:26.869413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:26.869413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:26.869413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:26.869413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:26.869413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:26.869413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:26.869413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:26.869413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:26.869413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:26.869413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:26.869413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:26.869413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:35:26.869413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:35:26.869413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:35:26.870454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:35:26.870454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:26.870454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:26.870454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:26.870454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:26.870454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:26.870454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:26.870454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:26.870454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:26.870454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:26.870454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:26.870454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:26.870454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:26.870454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:26.870454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:26.870454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:26.870454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:26.871541 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:35:26.871541 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:35:26.871541 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:35:26.871541 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:35:26.871541 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:35:26.871541 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:35:26.871541 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:26.871541 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:26.875845 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 385/771] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:26.876734 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ec0a1-d28c-4729-9e70-a620c2a5cfb4 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:26.948291 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:26.971150 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c66b6-0f3c-4e31-ae74-c33813d95cc4 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:26.984893 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ec0a1-d28c-4729-9e70-a620c2a5cfb4 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:27.016550 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab158d-6626-4157-b4ac-63008f6c951d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:27.017290 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab158d-6626-4157-b4ac-63008f6c951d None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:27.017580 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab158d-6626-4157-b4ac-63008f6c951d None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:27.017851 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab158d-6626-4157-b4ac-63008f6c951d None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:27.018533 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab158d-6626-4157-b4ac-63008f6c951d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:27.018837 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab158d-6626-4157-b4ac-63008f6c951d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:27.020284 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab158d-6626-4157-b4ac-63008f6c951d None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:27.021135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e751b-6f3f-4c5b-ac2c-f8a8a15ba44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:27.021909 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e751b-6f3f-4c5b-ac2c-f8a8a15ba44f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:27.022200 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e751b-6f3f-4c5b-ac2c-f8a8a15ba44f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:27.022474 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e751b-6f3f-4c5b-ac2c-f8a8a15ba44f None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:27.024083 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e751b-6f3f-4c5b-ac2c-f8a8a15ba44f None admin] RBAC: Adding query filter params (name=network) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:27.024558 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e751b-6f3f-4c5b-ac2c-f8a8a15ba44f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:27.025935 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e751b-6f3f-4c5b-ac2c-f8a8a15ba44f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:27.030613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 386/772] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Sep 1 13:35:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:27.031494 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e751b-6f3f-4c5b-ac2c-f8a8a15ba44f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:27.042477 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 387/773] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:35:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:27.042477 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab158d-6626-4157-b4ac-63008f6c951d None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:27.100939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:27.145486 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e751b-6f3f-4c5b-ac2c-f8a8a15ba44f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:27.150453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab158d-6626-4157-b4ac-63008f6c951d None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:27.183052 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24561263-5009-4c54-b4ac-ba2cda7912d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:27.183755 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24561263-5009-4c54-b4ac-ba2cda7912d0 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:27.184037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24561263-5009-4c54-b4ac-ba2cda7912d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:27.184368 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24561263-5009-4c54-b4ac-ba2cda7912d0 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:27.184975 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24561263-5009-4c54-b4ac-ba2cda7912d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:27.186360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24561263-5009-4c54-b4ac-ba2cda7912d0 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:27.186641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0687d5-7fca-4147-b6ab-cfa021ad4d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:27.187321 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0687d5-7fca-4147-b6ab-cfa021ad4d75 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:27.187547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0687d5-7fca-4147-b6ab-cfa021ad4d75 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:27.187820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0687d5-7fca-4147-b6ab-cfa021ad4d75 None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:27.188564 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0687d5-7fca-4147-b6ab-cfa021ad4d75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:27.188809 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0687d5-7fca-4147-b6ab-cfa021ad4d75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:27.190231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0687d5-7fca-4147-b6ab-cfa021ad4d75 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:27.204380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 387/774] 10.222.0.50 () {56 vars in 1087 bytes} [Thu Sep 1 13:35:27 2022] GET /identity/v3/services => generated 772 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:27.204380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24561263-5009-4c54-b4ac-ba2cda7912d0 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:27.204680 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:27.215851 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 388/775] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:35:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:27.216856 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0687d5-7fca-4147-b6ab-cfa021ad4d75 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:27.334052 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24561263-5009-4c54-b4ac-ba2cda7912d0 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:27.335724 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0687d5-7fca-4147-b6ab-cfa021ad4d75 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:27.359168 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:27.375512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c036c1-d914-40f6-b6b5-a205a9d39f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:27.393290 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c036c1-d914-40f6-b6b5-a205a9d39f09 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:27.393290 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c036c1-d914-40f6-b6b5-a205a9d39f09 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:27.393513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275771b-ed4c-45f7-a1c6-024ab9bc6cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:27.393608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c036c1-d914-40f6-b6b5-a205a9d39f09 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:27.393679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275771b-ed4c-45f7-a1c6-024ab9bc6cef None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:27.393764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c036c1-d914-40f6-b6b5-a205a9d39f09 None admin] RBAC: Adding query filter params (type=network) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:27.393836 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275771b-ed4c-45f7-a1c6-024ab9bc6cef None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:27.393903 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c036c1-d914-40f6-b6b5-a205a9d39f09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:27.393980 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275771b-ed4c-45f7-a1c6-024ab9bc6cef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:27.393980 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275771b-ed4c-45f7-a1c6-024ab9bc6cef None admin] RBAC: Adding query filter params (role.id=f8c77ddd17fd4bc7af83e8d8905fb404, scope.project.id=6283121e17814cd792df9d0edf81bf2d, user.id=6f01578bf21244a5ac357e54979ffc0d) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:27.393980 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275771b-ed4c-45f7-a1c6-024ab9bc6cef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:27.394174 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c036c1-d914-40f6-b6b5-a205a9d39f09 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:27.394241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275771b-ed4c-45f7-a1c6-024ab9bc6cef None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:27.394306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 388/776] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Sep 1 13:35:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:27.394306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c036c1-d914-40f6-b6b5-a205a9d39f09 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:27.394461 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 389/777] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:35:27 2022] GET /identity/v3/role_assignments?user.id=6f01578bf21244a5ac357e54979ffc0d&scope.project.id=6283121e17814cd792df9d0edf81bf2d&role.id=f8c77ddd17fd4bc7af83e8d8905fb404 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:27.394461 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275771b-ed4c-45f7-a1c6-024ab9bc6cef None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:27.488121 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:27.551226 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c036c1-d914-40f6-b6b5-a205a9d39f09 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:27.565743 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275771b-ed4c-45f7-a1c6-024ab9bc6cef None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:27.624774 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58940a90-b606-4b68-8f27-9a40b446e80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:27.625304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58940a90-b606-4b68-8f27-9a40b446e80e None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:27.625580 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58940a90-b606-4b68-8f27-9a40b446e80e None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:27.625851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58940a90-b606-4b68-8f27-9a40b446e80e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:27.626578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58940a90-b606-4b68-8f27-9a40b446e80e None admin] RBAC: Adding query filter params (role.id=98ffd3c114804da292d7cb33721e9085, scope.project.id=6283121e17814cd792df9d0edf81bf2d, user.id=85bbede0f8674384bcc3028ea77eb724) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:27.626884 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58940a90-b606-4b68-8f27-9a40b446e80e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:27.628346 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58940a90-b606-4b68-8f27-9a40b446e80e None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:27.638528 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ee8c7-4617-4df1-8383-3707318cc400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:27.639140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ee8c7-4617-4df1-8383-3707318cc400 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:27.639450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ee8c7-4617-4df1-8383-3707318cc400 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:27.639720 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ee8c7-4617-4df1-8383-3707318cc400 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:27.640422 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ee8c7-4617-4df1-8383-3707318cc400 None admin] RBAC: Adding query filter params (interface=public, service_id=6403c800445c45e08e66a13038c0bb30, region_id=RegionOne) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:27.644204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ee8c7-4617-4df1-8383-3707318cc400 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:27.645524 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 389/778] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:35:27 2022] GET /identity/v3/role_assignments?user.id=85bbede0f8674384bcc3028ea77eb724&scope.project.id=6283121e17814cd792df9d0edf81bf2d&role.id=98ffd3c114804da292d7cb33721e9085 => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:27.645971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ee8c7-4617-4df1-8383-3707318cc400 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:27.652984 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 390/779] 10.222.0.50 () {56 vars in 1251 bytes} [Thu Sep 1 13:35:27 2022] GET /identity/v3/endpoints?service_id=6403c800445c45e08e66a13038c0bb30&interface=public®ion_id=RegionOne => generated 194 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:27.658690 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58940a90-b606-4b68-8f27-9a40b446e80e None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:27.714913 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:27.774019 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58940a90-b606-4b68-8f27-9a40b446e80e None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:27.812788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bd58f-a5cb-4716-b85f-9752221921bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:27.813410 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bd58f-a5cb-4716-b85f-9752221921bb None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:27.813689 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bd58f-a5cb-4716-b85f-9752221921bb None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:27.813959 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bd58f-a5cb-4716-b85f-9752221921bb None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:27.814572 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bd58f-a5cb-4716-b85f-9752221921bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:27.816006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bd58f-a5cb-4716-b85f-9752221921bb None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:27.822915 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 390/780] 10.222.0.50 () {56 vars in 1087 bytes} [Thu Sep 1 13:35:27 2022] GET /identity/v3/services => generated 772 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:28.483767 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006c684-ffc9-4a22-b2f3-6d7e468f1720 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:28.484471 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006c684-ffc9-4a22-b2f3-6d7e468f1720 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:28.484471 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006c684-ffc9-4a22-b2f3-6d7e468f1720 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:28.485940 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 391/781] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:28.492449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c32cd-f551-4f67-ba30-2b42db8ab0d4 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:28.493105 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c32cd-f551-4f67-ba30-2b42db8ab0d4 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:28.493105 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c32cd-f551-4f67-ba30-2b42db8ab0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:28.513042 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-b22c32cd-f551-4f67-ba30-2b42db8ab0d4 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:28.514235 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b22c32cd-f551-4f67-ba30-2b42db8ab0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:28.702654 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 391/782] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:35:28.999715 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006c684-ffc9-4a22-b2f3-6d7e468f1720 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:29.144685 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006c684-ffc9-4a22-b2f3-6d7e468f1720 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:29.180701 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:29.191112 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11948b-97fd-4220-a7d7-514051a13011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:29.191771 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11948b-97fd-4220-a7d7-514051a13011 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:29.193860 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11948b-97fd-4220-a7d7-514051a13011 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:29.193860 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11948b-97fd-4220-a7d7-514051a13011 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:29.208231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11948b-97fd-4220-a7d7-514051a13011 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:35:29.213220 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-cf11948b-97fd-4220-a7d7-514051a13011 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:35:29.213220 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:29.213220 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:29.213220 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:29.213220 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:29.213220 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:29.213220 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:29.213220 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:29.213220 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:29.213220 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:29.213220 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:29.213220 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:29.213220 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:35:29.213220 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:35:29.213220 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:35:29.213220 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:35:29.214157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:35:29.214157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:35:29.214157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:35:29.214157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:35:29.214157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:29.214157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:29.214157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:29.214157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:29.214157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:29.214157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:29.214157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:29.214157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:29.214157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:29.214157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:29.214157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:29.214157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:29.215416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:29.215416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:29.215416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:29.215416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:29.215416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:35:29.215416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:35:29.215416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:35:29.215416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:35:29.215416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:35:29.215416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:35:29.215416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:35:29.215416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:29.215416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 392/783] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:35:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:29.220453 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c32cd-f551-4f67-ba30-2b42db8ab0d4 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:29.287729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:29.367283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c32cd-f551-4f67-ba30-2b42db8ab0d4 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:29.413723 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72488414-506c-429d-89b1-ec2ec9c68108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:29.414685 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72488414-506c-429d-89b1-ec2ec9c68108 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:29.415170 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72488414-506c-429d-89b1-ec2ec9c68108 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:29.415663 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72488414-506c-429d-89b1-ec2ec9c68108 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:29.416590 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72488414-506c-429d-89b1-ec2ec9c68108 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:29.417116 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72488414-506c-429d-89b1-ec2ec9c68108 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:29.418717 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72488414-506c-429d-89b1-ec2ec9c68108 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:29.430723 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 392/784] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:35:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:29.436416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11948b-97fd-4220-a7d7-514051a13011 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:29.584205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11948b-97fd-4220-a7d7-514051a13011 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:29.633651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3fb0e-c414-47a5-8ecc-01031327b510 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:29.634184 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3fb0e-c414-47a5-8ecc-01031327b510 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:29.634184 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3fb0e-c414-47a5-8ecc-01031327b510 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:29.635840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 393/785] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:29.639584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838fa0d-58c6-4f78-b6cf-2c62440fe567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:29.640223 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838fa0d-58c6-4f78-b6cf-2c62440fe567 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:29.640502 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838fa0d-58c6-4f78-b6cf-2c62440fe567 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:29.640778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838fa0d-58c6-4f78-b6cf-2c62440fe567 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:29.641593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f5213-5d25-46be-8355-02a73d6da070 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:29.641879 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f5213-5d25-46be-8355-02a73d6da070 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:29.642151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f5213-5d25-46be-8355-02a73d6da070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:29.659164 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838fa0d-58c6-4f78-b6cf-2c62440fe567 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:29.660660 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838fa0d-58c6-4f78-b6cf-2c62440fe567 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:29.661461 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-2e6f5213-5d25-46be-8355-02a73d6da070 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:29.662640 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-2e6f5213-5d25-46be-8355-02a73d6da070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:29.688813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-f838fa0d-58c6-4f78-b6cf-2c62440fe567 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:29.688813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:29.688813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:29.688813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:29.688813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:29.688813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:29.688813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:29.688813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:29.688813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:29.688813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:29.688813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:29.688813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:29.688813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:29.688813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:29.688813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:29.688813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:29.689755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:29.689755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:29.689755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:29.689755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:29.689755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:29.689755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:29.689755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:29.689755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:29.689755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:29.689755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:29.689755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:29.689755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:29.689755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:29.689755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:29.689755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:29.689755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:29.689755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:29.692191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:29.692191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:29.692191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:29.692191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 393/786] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:29.697452 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838fa0d-58c6-4f78-b6cf-2c62440fe567 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:29.739497 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 394/787] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:35:29.773096 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:29.791057 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba77ae-9ed7-47e1-bdb9-88d95e59bec3 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:29.791347 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba77ae-9ed7-47e1-bdb9-88d95e59bec3 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:29.792237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba77ae-9ed7-47e1-bdb9-88d95e59bec3 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:29.794081 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 395/788] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:35:29.801234 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59a7d9-8624-4242-a0c3-2c06524888b5 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:29.801234 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59a7d9-8624-4242-a0c3-2c06524888b5 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:29.801234 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59a7d9-8624-4242-a0c3-2c06524888b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:29.828672 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-4d59a7d9-8624-4242-a0c3-2c06524888b5 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:29.834173 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-4d59a7d9-8624-4242-a0c3-2c06524888b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:29.878322 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:29.885966 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838fa0d-58c6-4f78-b6cf-2c62440fe567 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:30.070352 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 396/789] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:35:30.070507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d40787-b3a8-4832-9e1f-65021d799779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:30.070507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d40787-b3a8-4832-9e1f-65021d799779 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:30.070507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d40787-b3a8-4832-9e1f-65021d799779 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:30.070507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d40787-b3a8-4832-9e1f-65021d799779 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:30.070836 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d40787-b3a8-4832-9e1f-65021d799779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:30.070836 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d40787-b3a8-4832-9e1f-65021d799779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:30.070836 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d40787-b3a8-4832-9e1f-65021d799779 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:30.070836 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 394/790] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:35:30.071117 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59a7d9-8624-4242-a0c3-2c06524888b5 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:30.105121 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59a7d9-8624-4242-a0c3-2c06524888b5 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:30.146543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb12c8-0319-4218-95cb-6f965ac0e74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:30.147613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb12c8-0319-4218-95cb-6f965ac0e74c None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:30.148036 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb12c8-0319-4218-95cb-6f965ac0e74c None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:30.148501 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb12c8-0319-4218-95cb-6f965ac0e74c None admin] PATH_INFO: `/v3/users/nova` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:30.155626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41a359-7dee-499e-9275-b758c0aea554 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:30.155626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41a359-7dee-499e-9275-b758c0aea554 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:30.155626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41a359-7dee-499e-9275-b758c0aea554 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:30.155626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 395/791] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:30.158155 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb12c8-0319-4218-95cb-6f965ac0e74c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:30.159777 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb12c8-0319-4218-95cb-6f965ac0e74c None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:30.161410 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05c0ae-774e-4a56-bc75-56081c87a69d None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:30.161692 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05c0ae-774e-4a56-bc75-56081c87a69d None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:30.161969 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05c0ae-774e-4a56-bc75-56081c87a69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:30.172706 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-0ffb12c8-0319-4218-95cb-6f965ac0e74c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:35:30.172706 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:30.172706 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:30.172706 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:30.172706 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:30.172706 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:30.172706 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:30.172706 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:30.172706 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:30.172706 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:30.172706 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:30.172706 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:30.172706 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:35:30.172706 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:35:30.172706 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:35:30.172706 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:35:30.173858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:30.173858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:30.173858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:35:30.173858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:30.173858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:35:30.173858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:30.173858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:30.173858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:30.173858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:30.173858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:30.173858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:30.173858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:30.173858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:30.173858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:30.173858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:30.173858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:30.173858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:30.173858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:30.174982 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:30.174982 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:30.174982 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:35:30.174982 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:35:30.174982 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:35:30.174982 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:35:30.174982 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:35:30.174982 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:35:30.174982 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:35:30.174982 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:30.177889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 397/792] 10.222.0.50 () {56 vars in 1093 bytes} [Thu Sep 1 13:35:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:30.179522 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb12c8-0319-4218-95cb-6f965ac0e74c None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:30.195841 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-dc05c0ae-774e-4a56-bc75-56081c87a69d None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:30.197035 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-dc05c0ae-774e-4a56-bc75-56081c87a69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:30.208110 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:30.277659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 396/793] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:35:30.278745 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05c0ae-774e-4a56-bc75-56081c87a69d None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:30.302223 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb12c8-0319-4218-95cb-6f965ac0e74c None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:30.311459 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:30.353214 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049975e-89c6-4e19-a625-f1942fc39989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:30.354816 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049975e-89c6-4e19-a625-f1942fc39989 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:30.355616 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049975e-89c6-4e19-a625-f1942fc39989 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:30.356119 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049975e-89c6-4e19-a625-f1942fc39989 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:30.357166 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049975e-89c6-4e19-a625-f1942fc39989 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:30.359046 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049975e-89c6-4e19-a625-f1942fc39989 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:30.375016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-b049975e-89c6-4e19-a625-f1942fc39989 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 13:35:30.375016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:30.375016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:35:30.375016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:35:30.375016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:35:30.375016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:35:30.375016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:35:30.375016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:30.375016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 13:35:30.375016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:30.375016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:35:30.375016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:30.375016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:30.375016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:30.375016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:30.375016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:30.375016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:30.376320 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:30.376320 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:30.376320 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:30.376320 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:30.376320 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:30.376320 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:30.376320 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:35:30.376320 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:35:30.376320 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:35:30.376320 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:35:30.376320 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:30.376320 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:30.376320 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:30.376320 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:30.376320 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:30.376320 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:30.377333 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:30.377333 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:30.377333 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:30.377333 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:30.377333 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:30.377333 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:30.377333 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:30.377333 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:30.377333 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:30.377333 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:30.377333 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:35:30.377333 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:30.377333 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 13:35:30.377333 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:30.384912 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 398/794] 10.222.0.50 () {56 vars in 1129 bytes} [Thu Sep 1 13:35:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:30.384912 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049975e-89c6-4e19-a625-f1942fc39989 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:30.412133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05c0ae-774e-4a56-bc75-56081c87a69d None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:30.461164 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce03c8c-4ea8-4409-9d26-8100d171f58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:30.463152 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce03c8c-4ea8-4409-9d26-8100d171f58a None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:30.463650 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce03c8c-4ea8-4409-9d26-8100d171f58a None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:30.464119 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce03c8c-4ea8-4409-9d26-8100d171f58a None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:30.464861 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce03c8c-4ea8-4409-9d26-8100d171f58a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:30.465168 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce03c8c-4ea8-4409-9d26-8100d171f58a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:30.466624 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce03c8c-4ea8-4409-9d26-8100d171f58a None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:30.483008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:30.491839 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 397/795] 10.222.0.50 () {56 vars in 1133 bytes} [Thu Sep 1 13:35:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:30.491839 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce03c8c-4ea8-4409-9d26-8100d171f58a None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:30.505886 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049975e-89c6-4e19-a625-f1942fc39989 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:30.543826 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc656ae-9599-437b-8f7f-30f7e68cedae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:30.544219 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc656ae-9599-437b-8f7f-30f7e68cedae None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:30.544493 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc656ae-9599-437b-8f7f-30f7e68cedae None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:30.544759 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc656ae-9599-437b-8f7f-30f7e68cedae None admin] PATH_INFO: `/v3/roles/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:30.555651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc656ae-9599-437b-8f7f-30f7e68cedae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:35:30.560330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-acc656ae-9599-437b-8f7f-30f7e68cedae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:35:30.560330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:30.560330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:30.560330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:30.560330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:30.560330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:30.560330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:30.560330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:30.560330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:30.560330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:30.560330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:30.560330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:30.560330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:35:30.560330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:35:30.560330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:35:30.560330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:35:30.561417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:35:30.561417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:35:30.561417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:35:30.561417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:35:30.561417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:30.561417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:30.561417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:30.561417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:30.561417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:30.561417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:30.561417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:30.561417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:30.561417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:30.561417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:30.561417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:30.561417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:30.562259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:30.562259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:30.562259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:30.562259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:30.562259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:35:30.562259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:35:30.562259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:35:30.562259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:35:30.562259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:35:30.562259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:35:30.562259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:35:30.562259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:30.562259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 399/796] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 1 13:35:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:30.562939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978351a3-dec8-4c12-b63e-25a086680f91 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:30.563231 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978351a3-dec8-4c12-b63e-25a086680f91 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:30.563460 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978351a3-dec8-4c12-b63e-25a086680f91 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:30.564663 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 400/797] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:30.565348 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978351a3-dec8-4c12-b63e-25a086680f91 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:30.584615 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:30.599420 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce03c8c-4ea8-4409-9d26-8100d171f58a None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:30.637547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d61d8-8890-48e5-bba6-16e00793346d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:30.638098 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d61d8-8890-48e5-bba6-16e00793346d None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:30.638376 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d61d8-8890-48e5-bba6-16e00793346d None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:30.638647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d61d8-8890-48e5-bba6-16e00793346d None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:30.639269 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d61d8-8890-48e5-bba6-16e00793346d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:30.639600 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d61d8-8890-48e5-bba6-16e00793346d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:30.640953 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d61d8-8890-48e5-bba6-16e00793346d None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:30.645333 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 398/798] 10.222.0.50 () {56 vars in 1124 bytes} [Thu Sep 1 13:35:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:30.646115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d61d8-8890-48e5-bba6-16e00793346d None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:30.671478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978351a3-dec8-4c12-b63e-25a086680f91 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:30.705221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32b2b3-94e7-421b-9119-18d29c93eea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:30.705821 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32b2b3-94e7-421b-9119-18d29c93eea4 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:30.706106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32b2b3-94e7-421b-9119-18d29c93eea4 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:30.706384 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32b2b3-94e7-421b-9119-18d29c93eea4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:30.723992 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:30.746755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d61d8-8890-48e5-bba6-16e00793346d None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:30.775331 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e32b2b3-94e7-421b-9119-18d29c93eea4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:30.776814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e32b2b3-94e7-421b-9119-18d29c93eea4 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:30.779613 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eac269-a18c-4739-a9d3-193b6b1fa6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:30.780242 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eac269-a18c-4739-a9d3-193b6b1fa6f4 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:30.780523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eac269-a18c-4739-a9d3-193b6b1fa6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:30.780800 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eac269-a18c-4739-a9d3-193b6b1fa6f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:30.791292 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eac269-a18c-4739-a9d3-193b6b1fa6f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:35:30.796571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-56eac269-a18c-4739-a9d3-193b6b1fa6f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:35:30.796571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:30.796571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:30.796571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:30.796571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:30.796571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:30.796571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:30.796571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:30.796571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:30.796571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:30.796571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:30.796571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:30.796571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:35:30.796571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:35:30.796571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:35:30.796571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:35:30.797673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:35:30.797673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:35:30.797673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:35:30.797673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:35:30.797673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:30.797673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:30.797673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:30.797673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:30.797673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:30.797673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:30.797673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:30.797673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:30.797673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:30.797673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:30.797673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:30.797673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:30.798573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:30.798573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:30.798573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:30.798573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:30.798573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:35:30.798573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:35:30.798573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:35:30.798573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:35:30.798573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:35:30.798573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:35:30.798573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:35:30.798573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:30.798573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 399/799] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:35:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:30.798573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eac269-a18c-4739-a9d3-193b6b1fa6f4 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:30.811217 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:30.883237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 401/800] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:35:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:35:30.884615 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f7103-127a-457e-b174-d3a1b499a8b5 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:30.884935 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f7103-127a-457e-b174-d3a1b499a8b5 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:30.885212 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f7103-127a-457e-b174-d3a1b499a8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:30.902171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eac269-a18c-4739-a9d3-193b6b1fa6f4 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:30.903532 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-534f7103-127a-457e-b174-d3a1b499a8b5 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:30.904712 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-534f7103-127a-457e-b174-d3a1b499a8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:30.935995 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba542c70-ce28-4bda-9817-c0b4d5b5e362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:30.936595 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba542c70-ce28-4bda-9817-c0b4d5b5e362 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:30.936875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba542c70-ce28-4bda-9817-c0b4d5b5e362 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:30.937148 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba542c70-ce28-4bda-9817-c0b4d5b5e362 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:30.937808 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba542c70-ce28-4bda-9817-c0b4d5b5e362 None admin] RBAC: Adding query filter params (name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:30.938111 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba542c70-ce28-4bda-9817-c0b4d5b5e362 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:30.939508 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba542c70-ce28-4bda-9817-c0b4d5b5e362 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:30.947676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 400/801] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 1 13:35:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:30.948483 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba542c70-ce28-4bda-9817-c0b4d5b5e362 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:30.952813 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:30.971743 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 402/802] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:35:30.972823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f7103-127a-457e-b174-d3a1b499a8b5 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:31.022963 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:31.054847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba542c70-ce28-4bda-9817-c0b4d5b5e362 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:31.082458 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f7103-127a-457e-b174-d3a1b499a8b5 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:31.091161 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe122e7-73db-4873-8a4c-af02fc69f74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:31.091988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe122e7-73db-4873-8a4c-af02fc69f74c None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:31.092272 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe122e7-73db-4873-8a4c-af02fc69f74c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:31.092548 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe122e7-73db-4873-8a4c-af02fc69f74c None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:31.093184 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe122e7-73db-4873-8a4c-af02fc69f74c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:31.093486 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe122e7-73db-4873-8a4c-af02fc69f74c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:31.094859 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe122e7-73db-4873-8a4c-af02fc69f74c None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:31.100042 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 401/803] 10.222.0.50 () {56 vars in 1124 bytes} [Thu Sep 1 13:35:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:31.101434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe122e7-73db-4873-8a4c-af02fc69f74c None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:31.125869 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105470e-6dcd-4c8c-bab6-289fcd4635cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:31.126538 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105470e-6dcd-4c8c-bab6-289fcd4635cc None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:31.126935 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105470e-6dcd-4c8c-bab6-289fcd4635cc None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:31.127211 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105470e-6dcd-4c8c-bab6-289fcd4635cc None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:31.127968 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105470e-6dcd-4c8c-bab6-289fcd4635cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:31.128275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105470e-6dcd-4c8c-bab6-289fcd4635cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:31.129749 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105470e-6dcd-4c8c-bab6-289fcd4635cc None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:31.143578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 403/804] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:35:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:31.143578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105470e-6dcd-4c8c-bab6-289fcd4635cc None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:31.186341 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:31.213085 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe122e7-73db-4873-8a4c-af02fc69f74c None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:31.248771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105470e-6dcd-4c8c-bab6-289fcd4635cc None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:31.249645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064b995-728d-48a1-9d7c-01ccea2eb345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:31.250285 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064b995-728d-48a1-9d7c-01ccea2eb345 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:31.250567 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064b995-728d-48a1-9d7c-01ccea2eb345 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:31.250841 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064b995-728d-48a1-9d7c-01ccea2eb345 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:31.253677 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:31.262733 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9064b995-728d-48a1-9d7c-01ccea2eb345 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:31.269261 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9064b995-728d-48a1-9d7c-01ccea2eb345 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:31.278821 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-9064b995-728d-48a1-9d7c-01ccea2eb345 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:31.278821 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:31.278821 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:31.278821 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:31.278821 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:31.278821 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:31.278821 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:31.278821 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:31.278821 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:31.278821 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:31.278821 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:31.278821 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:31.278821 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:31.278821 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:31.278821 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:31.278821 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:31.279778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:31.279778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:31.279778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:31.279778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:31.279778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:31.279778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:31.279778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:31.279778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:31.279778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:31.279778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:31.279778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:31.279778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:31.279778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:31.279778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:31.279778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:31.279778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:31.279778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:31.280644 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:31.280644 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:31.280644 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:31.281147 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 402/805] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:31.282089 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064b995-728d-48a1-9d7c-01ccea2eb345 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:31.283864 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768581c-21af-400d-8aa2-dcb18bef68fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:31.284526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768581c-21af-400d-8aa2-dcb18bef68fb None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:31.285813 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768581c-21af-400d-8aa2-dcb18bef68fb None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:31.286094 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768581c-21af-400d-8aa2-dcb18bef68fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:31.296965 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1768581c-21af-400d-8aa2-dcb18bef68fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:31.298400 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1768581c-21af-400d-8aa2-dcb18bef68fb None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:31.312122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-1768581c-21af-400d-8aa2-dcb18bef68fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:31.312122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:31.312122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:31.312122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:31.312122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:31.312122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:31.312122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:31.312122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:31.312122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:31.312122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:31.312122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:31.312122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:31.312122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:31.312122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:31.312122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:31.312122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:31.313308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:31.313308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:31.313308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:31.313308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:31.313308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:31.313308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:31.313308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:31.313308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:31.313308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:31.313308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:31.313308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:31.313308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:31.313308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:31.313308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:31.313308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:31.313308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:31.313308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:31.314418 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:31.314418 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:31.314418 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:31.314418 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 404/806] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:31.314418 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768581c-21af-400d-8aa2-dcb18bef68fb None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:31.385988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064b995-728d-48a1-9d7c-01ccea2eb345 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:31.409036 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:31.417929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768581c-21af-400d-8aa2-dcb18bef68fb None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:31.420000 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492b877-d52e-455c-906a-55b49ea917d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:31.420631 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492b877-d52e-455c-906a-55b49ea917d8 None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:31.420910 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492b877-d52e-455c-906a-55b49ea917d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:31.421178 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492b877-d52e-455c-906a-55b49ea917d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:31.421834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492b877-d52e-455c-906a-55b49ea917d8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:31.423186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492b877-d52e-455c-906a-55b49ea917d8 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:31.452665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a78d21-7b46-4652-8b03-7df197604049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:31.453210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a78d21-7b46-4652-8b03-7df197604049 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:31.453486 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a78d21-7b46-4652-8b03-7df197604049 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:31.453751 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a78d21-7b46-4652-8b03-7df197604049 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:31.464265 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a78d21-7b46-4652-8b03-7df197604049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:31.465774 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a78d21-7b46-4652-8b03-7df197604049 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:31.480033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-44a78d21-7b46-4652-8b03-7df197604049 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:31.480033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:31.480033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:31.480033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:31.480033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:31.480033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:31.480033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:31.480033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:31.480033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:31.480033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:31.480033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:31.480033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:31.480033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:31.480033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:31.480033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:31.480033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:31.481840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:31.481840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:31.481840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:31.481840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:31.481840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:31.481840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:31.481840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:31.481840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:31.481840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:31.481840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:31.481840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:31.481840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:31.481840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:31.481840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:31.481840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:31.481840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:31.481840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:31.482819 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:31.482819 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:31.482819 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:31.482819 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 405/807] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:31.482819 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a78d21-7b46-4652-8b03-7df197604049 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:31.520106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 403/808] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:35:31 2022] POST /identity/v3/endpoints => generated 346 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:35:31.521049 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492b877-d52e-455c-906a-55b49ea917d8 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:31.583673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:31.594447 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a78d21-7b46-4652-8b03-7df197604049 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:31.640915 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1374ac0-062b-4007-86ba-6e3246d96827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:31.641578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1374ac0-062b-4007-86ba-6e3246d96827 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:31.641846 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1374ac0-062b-4007-86ba-6e3246d96827 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:31.642101 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1374ac0-062b-4007-86ba-6e3246d96827 None admin] PATH_INFO: `/v3/services/network` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:31.642692 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1374ac0-062b-4007-86ba-6e3246d96827 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:31.644128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1374ac0-062b-4007-86ba-6e3246d96827 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:31.647194 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492b877-d52e-455c-906a-55b49ea917d8 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:31.654526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-b1374ac0-062b-4007-86ba-6e3246d96827 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 13:35:31.654526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:31.654526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:35:31.654526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:35:31.654526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:35:31.654526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:35:31.654526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:35:31.654526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:31.654526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 13:35:31.654526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:31.654526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:35:31.654526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:31.654526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:31.654526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:31.654526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:31.654526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:31.654526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:31.656308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:31.656308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:31.656308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:31.656308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:31.656308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:31.656308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:31.656308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:35:31.656308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:35:31.656308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:35:31.656308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:35:31.656308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:31.656308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:31.656308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:31.656308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:31.656308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:31.656308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:31.657408 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:31.657408 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:31.657408 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:31.657408 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:31.657408 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:31.657408 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:31.657408 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:31.657408 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:31.657408 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:31.657408 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:31.657408 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:35:31.657408 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:31.657408 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 13:35:31.657408 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:31.657408 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 406/809] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:31 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:31.658309 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1374ac0-062b-4007-86ba-6e3246d96827 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:31.670653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:31.695813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb64993-7b0d-410d-8b09-91b04c4d7321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:31.696435 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb64993-7b0d-410d-8b09-91b04c4d7321 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:31.696716 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb64993-7b0d-410d-8b09-91b04c4d7321 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:31.696991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb64993-7b0d-410d-8b09-91b04c4d7321 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:31.697925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb64993-7b0d-410d-8b09-91b04c4d7321 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:31.697925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb64993-7b0d-410d-8b09-91b04c4d7321 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:31.699374 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb64993-7b0d-410d-8b09-91b04c4d7321 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:31.714383 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 404/810] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:31.720092 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb64993-7b0d-410d-8b09-91b04c4d7321 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:31.787445 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1374ac0-062b-4007-86ba-6e3246d96827 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:31.824483 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6231c61-ffa6-49b6-8833-ae0ff0e177c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:31.825087 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb64993-7b0d-410d-8b09-91b04c4d7321 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:31.825205 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6231c61-ffa6-49b6-8833-ae0ff0e177c4 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:31.825362 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6231c61-ffa6-49b6-8833-ae0ff0e177c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:31.825630 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6231c61-ffa6-49b6-8833-ae0ff0e177c4 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:31.826269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6231c61-ffa6-49b6-8833-ae0ff0e177c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:31.826753 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6231c61-ffa6-49b6-8833-ae0ff0e177c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:31.827511 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:31.829011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6231c61-ffa6-49b6-8833-ae0ff0e177c4 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:31.851571 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 407/811] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:31.851571 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6231c61-ffa6-49b6-8833-ae0ff0e177c4 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:31.874281 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b10f37-87ed-465b-8c85-793d26bae38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:31.875001 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b10f37-87ed-465b-8c85-793d26bae38a None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:31.875353 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b10f37-87ed-465b-8c85-793d26bae38a None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:31.875745 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b10f37-87ed-465b-8c85-793d26bae38a None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:31.876462 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b10f37-87ed-465b-8c85-793d26bae38a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:31.876835 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b10f37-87ed-465b-8c85-793d26bae38a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:31.878213 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b10f37-87ed-465b-8c85-793d26bae38a None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:31.890495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 405/812] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:31.891319 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b10f37-87ed-465b-8c85-793d26bae38a None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:31.921160 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:31.961245 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6231c61-ffa6-49b6-8833-ae0ff0e177c4 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:31.996875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db5d2f-9f0f-4630-9374-c760a4010811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:31.997323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db5d2f-9f0f-4630-9374-c760a4010811 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:31.997633 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db5d2f-9f0f-4630-9374-c760a4010811 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:31.997906 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db5d2f-9f0f-4630-9374-c760a4010811 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:31.998545 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db5d2f-9f0f-4630-9374-c760a4010811 None admin] RBAC: Adding query filter params (name=network) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:31.998847 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db5d2f-9f0f-4630-9374-c760a4010811 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:31.999902 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b10f37-87ed-465b-8c85-793d26bae38a None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:32.000269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db5d2f-9f0f-4630-9374-c760a4010811 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:32.006058 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 408/813] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Sep 1 13:35:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:32.007936 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db5d2f-9f0f-4630-9374-c760a4010811 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:32.039724 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29e030-1f94-4502-8494-986962ee58f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:32.040362 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29e030-1f94-4502-8494-986962ee58f8 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:32.040634 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29e030-1f94-4502-8494-986962ee58f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:32.040896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29e030-1f94-4502-8494-986962ee58f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:32.047843 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29e030-1f94-4502-8494-986962ee58f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:32.049291 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29e030-1f94-4502-8494-986962ee58f8 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:32.060761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-ce29e030-1f94-4502-8494-986962ee58f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:32.060761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:32.060761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:32.060761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:32.060761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:32.060761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:32.060761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:32.060761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:32.060761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:32.060761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:32.060761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:32.060761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:32.060761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:35:32.060761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:35:32.060761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:35:32.061659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:35:32.061659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:32.061659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:32.061659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:32.061659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:32.061659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:32.061659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:32.061659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:32.061659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:32.061659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:32.061659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:32.061659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:32.061659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:32.061659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:32.061659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:32.061659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:32.061659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:32.067569 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:35:32.067569 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:35:32.067569 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:35:32.067569 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:35:32.067569 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:35:32.067569 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:35:32.067569 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:32.067569 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:32.067569 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 406/814] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:32.067569 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29e030-1f94-4502-8494-986962ee58f8 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:32.093157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:32.120756 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db5d2f-9f0f-4630-9374-c760a4010811 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:32.150728 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:32.160112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39d352-292e-4a0f-a91a-21f0d185ef87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:32.160757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39d352-292e-4a0f-a91a-21f0d185ef87 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:32.161035 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39d352-292e-4a0f-a91a-21f0d185ef87 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:32.161306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39d352-292e-4a0f-a91a-21f0d185ef87 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:32.168413 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29e030-1f94-4502-8494-986962ee58f8 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:32.168913 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39d352-292e-4a0f-a91a-21f0d185ef87 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:32.170321 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39d352-292e-4a0f-a91a-21f0d185ef87 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:32.182665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-ef39d352-292e-4a0f-a91a-21f0d185ef87 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 13:35:32.182665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:32.182665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:32.182665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:32.182665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:32.182665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:32.182665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:32.182665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:32.182665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:32.182665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:32.182665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:32.182665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:32.182665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:35:32.182665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:35:32.182665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:35:32.182665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:35:32.183721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:32.183721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:32.183721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:35:32.183721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:32.183721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:35:32.183721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:32.183721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:32.183721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:32.183721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:32.183721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:32.183721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:32.183721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:32.183721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:32.183721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:32.183721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:32.183721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:32.183721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:32.183721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:32.184637 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:32.184637 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:32.184637 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:35:32.184637 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:35:32.184637 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:35:32.184637 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:35:32.184637 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:35:32.184637 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:35:32.184637 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 13:35:32.184637 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:32.184637 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 409/815] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Sep 1 13:35:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:32.184637 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39d352-292e-4a0f-a91a-21f0d185ef87 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:32.212926 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305e402-3b4d-4671-a2ff-bc133d50e349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:32.213559 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305e402-3b4d-4671-a2ff-bc133d50e349 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:32.213845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305e402-3b4d-4671-a2ff-bc133d50e349 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:32.214107 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305e402-3b4d-4671-a2ff-bc133d50e349 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:32.221820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305e402-3b4d-4671-a2ff-bc133d50e349 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:32.223260 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305e402-3b4d-4671-a2ff-bc133d50e349 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:32.235544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-9305e402-3b4d-4671-a2ff-bc133d50e349 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 13:35:32.235544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:32.235544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:32.235544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:32.235544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:32.235544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:32.235544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:32.235544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:32.235544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:32.235544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:32.235544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:32.235544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:32.235544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:35:32.235544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:35:32.235544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:35:32.235544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:35:32.236695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:32.236695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:32.236695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:35:32.236695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:32.236695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:35:32.236695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:32.236695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:32.236695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:32.236695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:32.236695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:32.236695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:32.236695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:32.236695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:32.236695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:32.236695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:32.236695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:32.236695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:32.236695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:32.237639 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:32.237639 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:32.237639 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:35:32.237639 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:35:32.237639 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:35:32.237639 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:35:32.237639 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:35:32.237639 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:35:32.237639 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 13:35:32.237639 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:32.237639 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 407/816] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:35:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:32.237639 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305e402-3b4d-4671-a2ff-bc133d50e349 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:32.305150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39d352-292e-4a0f-a91a-21f0d185ef87 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:32.332347 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:32.345305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea1aae-6a2d-461a-bb05-1f8ea6eac263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:32.346366 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea1aae-6a2d-461a-bb05-1f8ea6eac263 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:32.346848 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea1aae-6a2d-461a-bb05-1f8ea6eac263 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:32.347275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea1aae-6a2d-461a-bb05-1f8ea6eac263 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:32.348081 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea1aae-6a2d-461a-bb05-1f8ea6eac263 None admin] RBAC: Adding query filter params (type=network) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:32.348536 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea1aae-6a2d-461a-bb05-1f8ea6eac263 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:32.348761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305e402-3b4d-4671-a2ff-bc133d50e349 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:32.350243 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea1aae-6a2d-461a-bb05-1f8ea6eac263 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:32.360440 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 410/817] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Sep 1 13:35:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:32.361169 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea1aae-6a2d-461a-bb05-1f8ea6eac263 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:32.385924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc88944-4797-4063-9126-7fabed77e682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:32.386532 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc88944-4797-4063-9126-7fabed77e682 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:32.386812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc88944-4797-4063-9126-7fabed77e682 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:32.387107 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc88944-4797-4063-9126-7fabed77e682 None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:32.388080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc88944-4797-4063-9126-7fabed77e682 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:32.388204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc88944-4797-4063-9126-7fabed77e682 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:32.389549 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc88944-4797-4063-9126-7fabed77e682 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:32.402263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 408/818] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:35:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:32.403238 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc88944-4797-4063-9126-7fabed77e682 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:32.427104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:32.479000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea1aae-6a2d-461a-bb05-1f8ea6eac263 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:32.516581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc88944-4797-4063-9126-7fabed77e682 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:32.519045 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493836e3-c680-47bf-ab87-70347b6bea42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:32.519702 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493836e3-c680-47bf-ab87-70347b6bea42 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:32.519986 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493836e3-c680-47bf-ab87-70347b6bea42 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:32.520262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493836e3-c680-47bf-ab87-70347b6bea42 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:32.520995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493836e3-c680-47bf-ab87-70347b6bea42 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:32.521304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493836e3-c680-47bf-ab87-70347b6bea42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:32.522787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493836e3-c680-47bf-ab87-70347b6bea42 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:32.547031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 411/819] 10.222.0.50 () {56 vars in 1149 bytes} [Thu Sep 1 13:35:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:32.547031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493836e3-c680-47bf-ab87-70347b6bea42 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:32.557865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c72f07-928b-44cc-89a2-6db79dcf3325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:32.558412 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c72f07-928b-44cc-89a2-6db79dcf3325 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:32.558694 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c72f07-928b-44cc-89a2-6db79dcf3325 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:32.558966 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c72f07-928b-44cc-89a2-6db79dcf3325 None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:32.559726 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c72f07-928b-44cc-89a2-6db79dcf3325 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:32.560053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c72f07-928b-44cc-89a2-6db79dcf3325 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:32.561446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c72f07-928b-44cc-89a2-6db79dcf3325 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:32.580102 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 409/820] 10.222.0.50 () {56 vars in 1135 bytes} [Thu Sep 1 13:35:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:32.580933 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c72f07-928b-44cc-89a2-6db79dcf3325 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:32.583506 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:32.659511 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493836e3-c680-47bf-ab87-70347b6bea42 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:32.676886 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:32.695677 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c72f07-928b-44cc-89a2-6db79dcf3325 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:32.704167 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c9a94-ade1-430d-ac48-847afeba2820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:32.704969 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c9a94-ade1-430d-ac48-847afeba2820 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:32.705426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c9a94-ade1-430d-ac48-847afeba2820 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:32.705878 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c9a94-ade1-430d-ac48-847afeba2820 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:32.706595 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c9a94-ade1-430d-ac48-847afeba2820 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:32.708321 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c9a94-ade1-430d-ac48-847afeba2820 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:32.733206 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4719a54-4317-4e06-ae9c-ca3d05389c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:32.733823 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4719a54-4317-4e06-ae9c-ca3d05389c6b None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:32.734238 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4719a54-4317-4e06-ae9c-ca3d05389c6b None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:32.734510 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4719a54-4317-4e06-ae9c-ca3d05389c6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:32.735233 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4719a54-4317-4e06-ae9c-ca3d05389c6b None admin] RBAC: Adding query filter params (role.id=98ffd3c114804da292d7cb33721e9085, scope.project.id=6283121e17814cd792df9d0edf81bf2d, user.id=2d231136bcd44d9a97efe6c257f936ed) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:32.735567 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4719a54-4317-4e06-ae9c-ca3d05389c6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:32.737016 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4719a54-4317-4e06-ae9c-ca3d05389c6b None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:32.744831 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 410/821] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:35:32 2022] GET /identity/v3/role_assignments?user.id=2d231136bcd44d9a97efe6c257f936ed&scope.project.id=6283121e17814cd792df9d0edf81bf2d&role.id=98ffd3c114804da292d7cb33721e9085 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:32.745604 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4719a54-4317-4e06-ae9c-ca3d05389c6b None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:32.797276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 412/822] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:35:32 2022] POST /identity/v3/endpoints => generated 337 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:35:32.798796 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c9a94-ade1-430d-ac48-847afeba2820 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:32.823026 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:32.879283 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4719a54-4317-4e06-ae9c-ca3d05389c6b None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:32.945848 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c9a94-ade1-430d-ac48-847afeba2820 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:32.957548 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36588d02-ec31-44c5-83e9-33dc7406beb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:32.959293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36588d02-ec31-44c5-83e9-33dc7406beb3 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:32.959885 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36588d02-ec31-44c5-83e9-33dc7406beb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:32.960370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36588d02-ec31-44c5-83e9-33dc7406beb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:32.975050 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36588d02-ec31-44c5-83e9-33dc7406beb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:32.978613 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36588d02-ec31-44c5-83e9-33dc7406beb3 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:33.003015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-36588d02-ec31-44c5-83e9-33dc7406beb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:33.003015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:33.003015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:33.003015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:33.003015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:33.003015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:33.003015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:33.003015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:33.003015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:33.003015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:33.003015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:33.003015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:33.003015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:33.003015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:33.003015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:33.003015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:33.004231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:33.004231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:33.004231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:33.004231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:33.004231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:33.004231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:33.004231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:33.004231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:33.004231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:33.004231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:33.004231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:33.004231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:33.004231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:33.004231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:33.004231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:33.004231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:33.004231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:33.005094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:33.005094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:33.005094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:33.005094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 411/823] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:33.010790 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902795ba-83a6-49e0-872b-c40e60aedabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:33.011769 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902795ba-83a6-49e0-872b-c40e60aedabc None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:33.012020 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36588d02-ec31-44c5-83e9-33dc7406beb3 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:33.012449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902795ba-83a6-49e0-872b-c40e60aedabc None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:33.012901 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902795ba-83a6-49e0-872b-c40e60aedabc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:33.028742 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902795ba-83a6-49e0-872b-c40e60aedabc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:33.031093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902795ba-83a6-49e0-872b-c40e60aedabc None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:33.049665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-902795ba-83a6-49e0-872b-c40e60aedabc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:33.049665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:33.049665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:33.049665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:33.049665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:33.049665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:33.049665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:33.049665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:33.049665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:33.049665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:33.049665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:33.049665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:33.049665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:33.049665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:33.049665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:33.049665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:33.050646 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:33.050646 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:33.050646 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:33.050646 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:33.050646 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:33.050646 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:33.050646 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:33.050646 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:33.050646 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:33.050646 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:33.050646 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:33.050646 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:33.050646 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:33.050646 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:33.050646 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:33.050646 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:33.050646 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:33.051559 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:33.051559 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:33.051559 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:33.053199 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 413/824] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:33.059916 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902795ba-83a6-49e0-872b-c40e60aedabc None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:33.080344 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:33.150017 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36588d02-ec31-44c5-83e9-33dc7406beb3 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:33.171691 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:33.192695 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902795ba-83a6-49e0-872b-c40e60aedabc None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:33.197929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822cb5ec-1e65-4490-864f-40567f5e7c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:33.198628 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cb5ec-1e65-4490-864f-40567f5e7c6e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:33.198917 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cb5ec-1e65-4490-864f-40567f5e7c6e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:33.199194 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cb5ec-1e65-4490-864f-40567f5e7c6e None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:33.199886 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822cb5ec-1e65-4490-864f-40567f5e7c6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:33.200200 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822cb5ec-1e65-4490-864f-40567f5e7c6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:33.201579 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822cb5ec-1e65-4490-864f-40567f5e7c6e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:33.219457 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 412/825] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:35:33.224337 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822cb5ec-1e65-4490-864f-40567f5e7c6e None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:33.235907 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d506e6-b84f-4c29-843d-8f31490ca2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:33.236738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d506e6-b84f-4c29-843d-8f31490ca2a6 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:33.237110 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d506e6-b84f-4c29-843d-8f31490ca2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:33.237565 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d506e6-b84f-4c29-843d-8f31490ca2a6 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:33.238317 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d506e6-b84f-4c29-843d-8f31490ca2a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:33.238713 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d506e6-b84f-4c29-843d-8f31490ca2a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:33.240374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d506e6-b84f-4c29-843d-8f31490ca2a6 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:33.254904 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 414/826] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:35:33.260915 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d506e6-b84f-4c29-843d-8f31490ca2a6 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:33.347399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822cb5ec-1e65-4490-864f-40567f5e7c6e None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:33.353758 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:33.380961 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d506e6-b84f-4c29-843d-8f31490ca2a6 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:33.385996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169b42e-e6dd-4c46-b730-cac5d037386e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:33.386972 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169b42e-e6dd-4c46-b730-cac5d037386e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:33.387496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169b42e-e6dd-4c46-b730-cac5d037386e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:33.387978 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169b42e-e6dd-4c46-b730-cac5d037386e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:33.395572 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169b42e-e6dd-4c46-b730-cac5d037386e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:33.397382 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169b42e-e6dd-4c46-b730-cac5d037386e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:33.409455 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-6169b42e-e6dd-4c46-b730-cac5d037386e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:33.409455 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:33.409455 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:33.409455 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:33.409455 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:33.409455 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:33.409455 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:33.409455 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:33.409455 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:33.409455 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:33.409455 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:33.409455 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:33.409455 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:35:33.409455 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:35:33.409455 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:35:33.410389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:35:33.410389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:33.410389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:33.410389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:33.410389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:33.410389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:33.410389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:33.410389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:33.410389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:33.410389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:33.410389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:33.410389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:33.410389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:33.410389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:33.410389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:33.410389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:33.410389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:33.411311 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:35:33.411311 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:35:33.411311 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:35:33.411311 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:35:33.411311 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:35:33.411311 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:35:33.411311 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:33.411311 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:33.413766 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 413/827] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:35:33.420075 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5c498-1649-424a-b14f-eef3d90a1fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:33.420503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169b42e-e6dd-4c46-b730-cac5d037386e None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:33.420710 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5c498-1649-424a-b14f-eef3d90a1fd9 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:33.420996 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5c498-1649-424a-b14f-eef3d90a1fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:33.421273 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5c498-1649-424a-b14f-eef3d90a1fd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:33.429080 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5c498-1649-424a-b14f-eef3d90a1fd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:33.430579 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5c498-1649-424a-b14f-eef3d90a1fd9 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:33.442593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-06d5c498-1649-424a-b14f-eef3d90a1fd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:33.442593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:33.442593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:33.442593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:33.442593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:33.442593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:33.442593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:33.442593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:33.442593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:33.442593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:33.442593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:33.442593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:33.442593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:35:33.442593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:35:33.442593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:35:33.443578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:35:33.443578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:33.443578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:33.443578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:33.443578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:33.443578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:33.443578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:33.443578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:33.443578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:33.443578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:33.443578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:33.443578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:33.443578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:33.443578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:33.443578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:33.443578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:33.443578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:33.445016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:35:33.445016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:35:33.445016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:35:33.445016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:35:33.445016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:35:33.445016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:35:33.445016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:33.445016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:33.449108 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 415/828] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:35:33.450453 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5c498-1649-424a-b14f-eef3d90a1fd9 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:33.491909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:33.542734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169b42e-e6dd-4c46-b730-cac5d037386e None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:33.562850 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5c498-1649-424a-b14f-eef3d90a1fd9 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:33.580873 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17902b56-92b4-484d-9d03-400c8ae62487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:33.581407 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17902b56-92b4-484d-9d03-400c8ae62487 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:33.581681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17902b56-92b4-484d-9d03-400c8ae62487 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:33.581947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17902b56-92b4-484d-9d03-400c8ae62487 None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:33.582625 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17902b56-92b4-484d-9d03-400c8ae62487 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:33.582927 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17902b56-92b4-484d-9d03-400c8ae62487 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:33.584433 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17902b56-92b4-484d-9d03-400c8ae62487 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:33.601906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 414/829] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:35:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:35:33.601906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbb361-26ec-40e2-82e2-5bf3aacfdfc9 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:33.601906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbb361-26ec-40e2-82e2-5bf3aacfdfc9 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:33.601906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbb361-26ec-40e2-82e2-5bf3aacfdfc9 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:33.601906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 415/830] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:33.604254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbb361-26ec-40e2-82e2-5bf3aacfdfc9 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:33.605397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbc70e-9068-4549-a925-eaf7194c9105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:33.606082 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbc70e-9068-4549-a925-eaf7194c9105 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:33.606683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbc70e-9068-4549-a925-eaf7194c9105 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:33.607017 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbc70e-9068-4549-a925-eaf7194c9105 None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:33.607819 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdbc70e-9068-4549-a925-eaf7194c9105 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:33.608206 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdbc70e-9068-4549-a925-eaf7194c9105 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:33.609738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdbc70e-9068-4549-a925-eaf7194c9105 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:33.611646 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:33.623549 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 416/831] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:35:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:35:33.624892 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c93fbc-a160-4e3d-bab3-1e02c40c4310 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:33.625177 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c93fbc-a160-4e3d-bab3-1e02c40c4310 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:33.628360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c93fbc-a160-4e3d-bab3-1e02c40c4310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:33.644011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-81c93fbc-a160-4e3d-bab3-1e02c40c4310 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:33.645414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-81c93fbc-a160-4e3d-bab3-1e02c40c4310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:33.715228 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:33.720836 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbb361-26ec-40e2-82e2-5bf3aacfdfc9 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:33.735457 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 417/832] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:35:33.735457 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c93fbc-a160-4e3d-bab3-1e02c40c4310 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:33.763258 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685e81f-69c1-4811-9006-b748a348268a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:33.764119 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685e81f-69c1-4811-9006-b748a348268a None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:33.764469 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685e81f-69c1-4811-9006-b748a348268a None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:33.764849 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685e81f-69c1-4811-9006-b748a348268a None admin] PATH_INFO: `/v3/projects/6283121e17814cd792df9d0edf81bf2d/users/6f01578bf21244a5ac357e54979ffc0d/roles/f8c77ddd17fd4bc7af83e8d8905fb404` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:33.781209 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685e81f-69c1-4811-9006-b748a348268a None admin] RBAC: Authorizing `identity:create_grant(project_id=6283121e17814cd792df9d0edf81bf2d, user_id=6f01578bf21244a5ac357e54979ffc0d, role_id=f8c77ddd17fd4bc7af83e8d8905fb404)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:33.782977 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685e81f-69c1-4811-9006-b748a348268a None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:33.853307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c93fbc-a160-4e3d-bab3-1e02c40c4310 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:33.879618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:33.883473 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 416/833] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 1 13:35:33 2022] PUT /identity/v3/projects/6283121e17814cd792df9d0edf81bf2d/users/6f01578bf21244a5ac357e54979ffc0d/roles/f8c77ddd17fd4bc7af83e8d8905fb404 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:35:33.896302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcee228-867f-47d8-8225-cf605240b269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:33.898008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcee228-867f-47d8-8225-cf605240b269 None admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:33.898502 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcee228-867f-47d8-8225-cf605240b269 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:33.899020 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcee228-867f-47d8-8225-cf605240b269 None admin] PATH_INFO: `/v3/projects/6283121e17814cd792df9d0edf81bf2d/users/85bbede0f8674384bcc3028ea77eb724/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:33.901521 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcee228-867f-47d8-8225-cf605240b269 None admin] RBAC: Authorizing `identity:create_grant(project_id=6283121e17814cd792df9d0edf81bf2d, user_id=85bbede0f8674384bcc3028ea77eb724, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:33.903600 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcee228-867f-47d8-8225-cf605240b269 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:33.982044 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 418/834] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 1 13:35:33 2022] PUT /identity/v3/projects/6283121e17814cd792df9d0edf81bf2d/users/85bbede0f8674384bcc3028ea77eb724/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:35:34.016674 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685e81f-69c1-4811-9006-b748a348268a None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:34.137830 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685e81f-69c1-4811-9006-b748a348268a None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:34.177523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588a2af-27e5-43cf-9156-a65d4b24ea3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:34.178158 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588a2af-27e5-43cf-9156-a65d4b24ea3f None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:34.178491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588a2af-27e5-43cf-9156-a65d4b24ea3f None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:34.178733 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588a2af-27e5-43cf-9156-a65d4b24ea3f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:34.179315 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588a2af-27e5-43cf-9156-a65d4b24ea3f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:34.180699 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588a2af-27e5-43cf-9156-a65d4b24ea3f None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:34.199766 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-4588a2af-27e5-43cf-9156-a65d4b24ea3f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 13:35:34.199766 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:34.199766 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:35:34.199766 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:35:34.199766 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:35:34.199766 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:35:34.199766 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:35:34.199766 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:34.199766 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 13:35:34.199766 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:34.199766 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:35:34.199766 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:34.199766 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:34.199766 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:34.199766 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:34.199766 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:34.199766 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:34.200781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:34.200781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:34.200781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:34.200781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:34.200781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:34.200781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:34.200781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:35:34.200781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:35:34.200781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:35:34.200781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:35:34.200781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:34.200781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:34.200781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:34.200781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:34.200781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:34.200781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:34.201575 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:34.201575 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:34.201575 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:34.201575 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:34.201575 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:34.201575 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:34.201575 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:34.201575 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:34.201575 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:34.201575 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:34.201575 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:35:34.201575 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:34.201575 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 13:35:34.201575 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:34.201575 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 417/835] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 1 13:35:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:34.208356 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcee228-867f-47d8-8225-cf605240b269 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:34.315602 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcee228-867f-47d8-8225-cf605240b269 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:34.352042 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b4587-096a-454a-87a2-22d87501f9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:34.353039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b4587-096a-454a-87a2-22d87501f9aa None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:34.353532 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b4587-096a-454a-87a2-22d87501f9aa None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:34.353997 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b4587-096a-454a-87a2-22d87501f9aa None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:34.354823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b4587-096a-454a-87a2-22d87501f9aa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:34.355330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b4587-096a-454a-87a2-22d87501f9aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:34.357202 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b4587-096a-454a-87a2-22d87501f9aa None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:34.367298 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 419/836] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 1 13:35:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:34.370143 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588a2af-27e5-43cf-9156-a65d4b24ea3f None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:34.388011 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:34.477379 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588a2af-27e5-43cf-9156-a65d4b24ea3f None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:34.513590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e2fd6-a079-4649-a79d-c305f5b7950c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:34.514583 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e2fd6-a079-4649-a79d-c305f5b7950c None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:34.515059 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e2fd6-a079-4649-a79d-c305f5b7950c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:34.515555 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e2fd6-a079-4649-a79d-c305f5b7950c None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:34.516375 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e2fd6-a079-4649-a79d-c305f5b7950c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:34.516897 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e2fd6-a079-4649-a79d-c305f5b7950c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:34.518447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e2fd6-a079-4649-a79d-c305f5b7950c None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:34.524333 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 418/837] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 1 13:35:34 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:34.971339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d55fef-af15-4239-8d16-a3716d478e5b None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:34.971908 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d55fef-af15-4239-8d16-a3716d478e5b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:34.971908 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d55fef-af15-4239-8d16-a3716d478e5b None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:34.973465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 420/838] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:34.979453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216d758-370c-4112-94e4-31c5cf31d3ca None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:34.979879 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216d758-370c-4112-94e4-31c5cf31d3ca None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:34.980055 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216d758-370c-4112-94e4-31c5cf31d3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:35.000213 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-f216d758-370c-4112-94e4-31c5cf31d3ca None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:35.001416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-f216d758-370c-4112-94e4-31c5cf31d3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:35.074969 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 419/839] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:35:35.339016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d55fef-af15-4239-8d16-a3716d478e5b None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:35.394678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:35.454175 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d55fef-af15-4239-8d16-a3716d478e5b None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:35.492574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d146f0-b225-446a-959e-6dbdfe05d063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:35.493743 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d146f0-b225-446a-959e-6dbdfe05d063 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:35.494024 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d146f0-b225-446a-959e-6dbdfe05d063 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:35.494299 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d146f0-b225-446a-959e-6dbdfe05d063 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:35.494885 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d146f0-b225-446a-959e-6dbdfe05d063 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:35.496300 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d146f0-b225-446a-959e-6dbdfe05d063 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:35.505547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-62d146f0-b225-446a-959e-6dbdfe05d063 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 13:35:35.505547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:35.505547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:35:35.505547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:35:35.505547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:35:35.505547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:35:35.505547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:35:35.505547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:35.505547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 13:35:35.505547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:35.505547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:35:35.505547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:35.505547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:35.505547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:35.505547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:35.505547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:35.506585 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:35.506585 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:35.506585 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:35.506585 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:35.506585 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:35.506585 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:35.506585 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:35.506585 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:35:35.506585 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:35:35.506585 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:35:35.506585 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:35:35.506585 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:35.506585 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:35.506585 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:35.506585 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:35.506585 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:35.506585 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:35.507465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:35.507465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:35.507465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:35.507465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:35.507465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:35.507465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:35.507465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:35.507465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:35.507465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:35.507465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:35.507465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:35:35.507465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:35.507465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 13:35:35.507465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:35.507465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 421/840] 10.222.0.50 () {56 vars in 1132 bytes} [Thu Sep 1 13:35:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:35.512908 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216d758-370c-4112-94e4-31c5cf31d3ca None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:35.534604 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:35.626363 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216d758-370c-4112-94e4-31c5cf31d3ca None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:35.662512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd7019-694a-4804-8f2b-f59250a5817a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:35.663986 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd7019-694a-4804-8f2b-f59250a5817a None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:35.664421 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd7019-694a-4804-8f2b-f59250a5817a None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:35.664830 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd7019-694a-4804-8f2b-f59250a5817a None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:35.665602 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd7019-694a-4804-8f2b-f59250a5817a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:35.666052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd7019-694a-4804-8f2b-f59250a5817a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:35.667609 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd7019-694a-4804-8f2b-f59250a5817a None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:35.673463 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 420/841] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Sep 1 13:35:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:35:35.679509 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d146f0-b225-446a-959e-6dbdfe05d063 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:35.787597 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d146f0-b225-446a-959e-6dbdfe05d063 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:35.801150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:35.823487 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47501c18-b254-4211-8fe8-400030d32e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:35.824102 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47501c18-b254-4211-8fe8-400030d32e1c None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:35.824385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47501c18-b254-4211-8fe8-400030d32e1c None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:35.824657 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47501c18-b254-4211-8fe8-400030d32e1c None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:35.825291 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47501c18-b254-4211-8fe8-400030d32e1c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:35.825592 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47501c18-b254-4211-8fe8-400030d32e1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:35.827032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47501c18-b254-4211-8fe8-400030d32e1c None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:35.832125 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 422/842] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Sep 1 13:35:35 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:35.918940 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393da555-d360-4349-b1c8-0e3db616abe2 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:35.919234 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393da555-d360-4349-b1c8-0e3db616abe2 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:35.919436 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393da555-d360-4349-b1c8-0e3db616abe2 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:35.921141 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 421/843] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:35.926898 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d5d33-c402-4e8d-9418-4f0caa5cc899 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:35.927200 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d5d33-c402-4e8d-9418-4f0caa5cc899 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:35.927486 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d5d33-c402-4e8d-9418-4f0caa5cc899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:35.947879 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-262d5d33-c402-4e8d-9418-4f0caa5cc899 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:35.949181 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-262d5d33-c402-4e8d-9418-4f0caa5cc899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:36.003680 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623985e-8749-4dd9-9b41-fa56c181e71d None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:36.004297 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623985e-8749-4dd9-9b41-fa56c181e71d None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:36.004297 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623985e-8749-4dd9-9b41-fa56c181e71d None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:36.006168 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 422/844] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:35:36.012737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33846642-b56b-4b73-990e-47d9e78c77cb None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:36.013021 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33846642-b56b-4b73-990e-47d9e78c77cb None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:36.013790 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33846642-b56b-4b73-990e-47d9e78c77cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:36.028041 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 423/845] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:35:36.047242 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-33846642-b56b-4b73-990e-47d9e78c77cb None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:36.048797 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-33846642-b56b-4b73-990e-47d9e78c77cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:36.116611 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:36.122402 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 423/846] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:35:36.295573 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d5d33-c402-4e8d-9418-4f0caa5cc899 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:36.403990 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d5d33-c402-4e8d-9418-4f0caa5cc899 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:36.407764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33846642-b56b-4b73-990e-47d9e78c77cb None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:36.413879 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:36.446697 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bb8ec-fb06-413e-854f-773fe4a49ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:36.447829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bb8ec-fb06-413e-854f-773fe4a49ab1 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:36.448468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bb8ec-fb06-413e-854f-773fe4a49ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:36.448746 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bb8ec-fb06-413e-854f-773fe4a49ab1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:36.462112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1bb8ec-fb06-413e-854f-773fe4a49ab1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:35:36.467334 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-4a1bb8ec-fb06-413e-854f-773fe4a49ab1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:35:36.467334 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:36.467334 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:36.467334 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:36.467334 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:36.467334 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:36.467334 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:36.467334 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:36.467334 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:36.467334 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:36.467334 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:36.467334 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:36.467334 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:35:36.467334 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:35:36.467334 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:35:36.467334 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:35:36.468269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:35:36.468269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:35:36.468269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:35:36.468269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:35:36.468269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:36.468269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:36.468269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:36.468269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:36.468269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:36.468269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:36.468269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:36.468269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:36.468269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:36.468269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:36.468269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:36.468269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:36.469064 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:36.469064 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:36.469064 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:36.469064 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:36.469064 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:35:36.469064 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:35:36.469064 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:35:36.469064 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:35:36.469064 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:35:36.469064 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:35:36.469064 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:35:36.469064 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:36.471653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 424/847] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 1 13:35:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:36.479494 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bb8ec-fb06-413e-854f-773fe4a49ab1 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:36.521040 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33846642-b56b-4b73-990e-47d9e78c77cb None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:36.563785 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9bc5a-7dd2-44ad-bbe0-759e8a430a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:36.564340 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9bc5a-7dd2-44ad-bbe0-759e8a430a9d None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:36.564618 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9bc5a-7dd2-44ad-bbe0-759e8a430a9d None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:36.564888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9bc5a-7dd2-44ad-bbe0-759e8a430a9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:36.576685 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9bc5a-7dd2-44ad-bbe0-759e8a430a9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:35:36.581568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-fed9bc5a-7dd2-44ad-bbe0-759e8a430a9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:35:36.581568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:36.581568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:36.581568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:36.581568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:36.581568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:36.581568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:36.581568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:36.581568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:36.581568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:36.581568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:36.581568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:36.581568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:35:36.581568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:35:36.581568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:35:36.581568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:35:36.582547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:35:36.582547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:35:36.582547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:35:36.582547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:35:36.582547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:36.582547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:36.582547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:36.582547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:36.582547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:36.582547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:36.582547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:36.582547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:36.582547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:36.582547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:36.582547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:36.582547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:36.583394 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:36.583394 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:36.583394 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:36.583394 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:36.583394 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:35:36.583394 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:35:36.583394 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:35:36.583394 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:35:36.583394 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:35:36.583394 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:35:36.583394 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:35:36.583394 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:36.583394 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 424/848] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:35:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:35:36.585143 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e670c7f-17e6-41ea-a077-8ee07473d051 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:36.585143 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e670c7f-17e6-41ea-a077-8ee07473d051 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:36.585143 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e670c7f-17e6-41ea-a077-8ee07473d051 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:36.587068 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 425/849] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:36.591720 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e670c7f-17e6-41ea-a077-8ee07473d051 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:36.612676 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bb8ec-fb06-413e-854f-773fe4a49ab1 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:36.654849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011cee4a-e90d-4530-a564-a66698483552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:36.655652 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011cee4a-e90d-4530-a564-a66698483552 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:36.656039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011cee4a-e90d-4530-a564-a66698483552 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:36.656335 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011cee4a-e90d-4530-a564-a66698483552 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:36.656995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011cee4a-e90d-4530-a564-a66698483552 None admin] RBAC: Adding query filter params (name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:36.657295 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011cee4a-e90d-4530-a564-a66698483552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:36.658797 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011cee4a-e90d-4530-a564-a66698483552 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:36.659664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:36.671169 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 425/850] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 1 13:35:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:36.673485 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d289d-259f-49c0-a156-f1b1881b3ab4 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:36.682229 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d289d-259f-49c0-a156-f1b1881b3ab4 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:36.682229 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d289d-259f-49c0-a156-f1b1881b3ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:36.697070 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-4d3d289d-259f-49c0-a156-f1b1881b3ab4 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:36.700072 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-4d3d289d-259f-49c0-a156-f1b1881b3ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:36.723459 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e670c7f-17e6-41ea-a077-8ee07473d051 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:36.733968 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:36.763903 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe5207-8791-41c4-bff4-33948fcd9b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:36.764506 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe5207-8791-41c4-bff4-33948fcd9b59 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:36.764782 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe5207-8791-41c4-bff4-33948fcd9b59 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:36.765051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe5207-8791-41c4-bff4-33948fcd9b59 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:36.765720 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe5207-8791-41c4-bff4-33948fcd9b59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:36.766012 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe5207-8791-41c4-bff4-33948fcd9b59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:36.767383 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe5207-8791-41c4-bff4-33948fcd9b59 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:36.776616 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 426/851] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:35:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:36.777421 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe5207-8791-41c4-bff4-33948fcd9b59 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:36.803768 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 426/852] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:35:36.803768 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d289d-259f-49c0-a156-f1b1881b3ab4 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:36.904111 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe5207-8791-41c4-bff4-33948fcd9b59 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:36.932623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:36.950657 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19939a1-f290-4cc2-b460-8cf0e2577e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:36.951307 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19939a1-f290-4cc2-b460-8cf0e2577e0e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:36.951635 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19939a1-f290-4cc2-b460-8cf0e2577e0e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:36.951913 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19939a1-f290-4cc2-b460-8cf0e2577e0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:36.966264 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d289d-259f-49c0-a156-f1b1881b3ab4 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:36.966472 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19939a1-f290-4cc2-b460-8cf0e2577e0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:36.968002 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19939a1-f290-4cc2-b460-8cf0e2577e0e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:36.984875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-e19939a1-f290-4cc2-b460-8cf0e2577e0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:36.984875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:36.984875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:36.984875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:36.984875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:36.984875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:36.984875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:36.984875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:36.984875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:36.984875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:36.984875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:36.984875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:36.984875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:36.984875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:36.984875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:36.984875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:36.985857 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:36.985857 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:36.985857 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:36.985857 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:36.985857 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:36.985857 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:36.985857 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:36.985857 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:36.985857 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:36.985857 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:36.985857 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:36.985857 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:36.985857 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:36.985857 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:36.985857 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:36.985857 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:36.985857 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:36.986728 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:36.986728 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:36.986728 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:36.986728 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 427/853] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:36.994283 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19939a1-f290-4cc2-b460-8cf0e2577e0e None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:37.014851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436208e9-7cb1-4aa4-920c-dfb6cdc9205f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:37.015523 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436208e9-7cb1-4aa4-920c-dfb6cdc9205f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:37.015805 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436208e9-7cb1-4aa4-920c-dfb6cdc9205f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:37.016116 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436208e9-7cb1-4aa4-920c-dfb6cdc9205f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:37.027834 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436208e9-7cb1-4aa4-920c-dfb6cdc9205f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:37.029419 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436208e9-7cb1-4aa4-920c-dfb6cdc9205f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:37.047045 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-436208e9-7cb1-4aa4-920c-dfb6cdc9205f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:37.047045 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:37.047045 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:37.047045 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:37.047045 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:37.047045 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:37.047045 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:37.047045 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:37.047045 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:37.047045 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:37.047045 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:37.047045 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:37.047045 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:37.047045 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:37.047045 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:37.047045 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:37.049000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:37.049000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:37.049000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:37.049000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:37.049000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:37.049000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:37.049000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:37.049000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:37.049000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:37.049000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:37.049000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:37.049000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:37.049000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:37.049000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:37.049000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:37.049000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:37.049000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:37.057380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:37.057380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:37.057380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:37.057380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 427/854] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:37.061745 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436208e9-7cb1-4aa4-920c-dfb6cdc9205f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:37.081113 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:37.149624 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19939a1-f290-4cc2-b460-8cf0e2577e0e None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:37.199344 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ced3c-a847-4a9f-9031-b678b0f72cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:37.200235 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436208e9-7cb1-4aa4-920c-dfb6cdc9205f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:37.200336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ced3c-a847-4a9f-9031-b678b0f72cb8 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:37.200336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ced3c-a847-4a9f-9031-b678b0f72cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:37.200336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ced3c-a847-4a9f-9031-b678b0f72cb8 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:37.201072 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ced3c-a847-4a9f-9031-b678b0f72cb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:37.201379 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ced3c-a847-4a9f-9031-b678b0f72cb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:37.203716 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ced3c-a847-4a9f-9031-b678b0f72cb8 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:37.216510 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 428/855] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:37.217334 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ced3c-a847-4a9f-9031-b678b0f72cb8 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:37.247291 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ccb795-f642-4e72-9087-6d0e948b843c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:37.248410 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccb795-f642-4e72-9087-6d0e948b843c None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:37.248708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccb795-f642-4e72-9087-6d0e948b843c None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:37.248984 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccb795-f642-4e72-9087-6d0e948b843c None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:37.249800 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ccb795-f642-4e72-9087-6d0e948b843c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:37.250111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ccb795-f642-4e72-9087-6d0e948b843c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:37.251526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ccb795-f642-4e72-9087-6d0e948b843c None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:37.261035 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:37.270535 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 428/856] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:37.274100 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ccb795-f642-4e72-9087-6d0e948b843c None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:37.342156 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ced3c-a847-4a9f-9031-b678b0f72cb8 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:37.356743 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:37.380025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101804e-7486-4133-9296-0551fc242e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:37.380772 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101804e-7486-4133-9296-0551fc242e52 None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:37.380967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101804e-7486-4133-9296-0551fc242e52 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:37.381188 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101804e-7486-4133-9296-0551fc242e52 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:37.381875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3101804e-7486-4133-9296-0551fc242e52 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:37.383379 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3101804e-7486-4133-9296-0551fc242e52 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:37.394514 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ccb795-f642-4e72-9087-6d0e948b843c None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:37.433335 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca2851-b161-43e5-9807-70149fe07317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:37.434216 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca2851-b161-43e5-9807-70149fe07317 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:37.434491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca2851-b161-43e5-9807-70149fe07317 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:37.434765 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca2851-b161-43e5-9807-70149fe07317 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:37.442799 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca2851-b161-43e5-9807-70149fe07317 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:37.444340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca2851-b161-43e5-9807-70149fe07317 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:37.456519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-22ca2851-b161-43e5-9807-70149fe07317 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 13:35:37.456519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:37.456519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:37.456519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:37.456519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:37.456519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:37.456519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:37.456519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:37.456519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:37.456519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:37.456519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:37.456519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:37.456519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:35:37.456519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:35:37.456519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:35:37.456519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:35:37.457481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:37.457481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:37.457481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:35:37.457481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:37.457481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:35:37.457481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:37.457481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:37.457481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:37.457481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:37.457481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:37.457481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:37.457481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:37.457481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:37.457481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:37.457481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:37.457481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:37.457481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:37.457481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:37.459001 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:37.459001 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:37.459001 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:35:37.459001 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:35:37.459001 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:35:37.459001 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:35:37.459001 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:35:37.459001 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:35:37.459001 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 13:35:37.459001 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:37.459001 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 429/857] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Sep 1 13:35:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:37.459001 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca2851-b161-43e5-9807-70149fe07317 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:37.493917 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 429/858] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Sep 1 13:35:37 2022] POST /identity/v3/services => generated 251 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:35:37.495085 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101804e-7486-4133-9296-0551fc242e52 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:37.603157 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca2851-b161-43e5-9807-70149fe07317 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:37.645675 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:37.662133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:37.664595 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff1d16-565c-4c26-ad0e-f3e458b43cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:37.666224 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff1d16-565c-4c26-ad0e-f3e458b43cc5 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:37.666224 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff1d16-565c-4c26-ad0e-f3e458b43cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:37.666224 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff1d16-565c-4c26-ad0e-f3e458b43cc5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:37.675659 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff1d16-565c-4c26-ad0e-f3e458b43cc5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:37.676502 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101804e-7486-4133-9296-0551fc242e52 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:37.678780 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff1d16-565c-4c26-ad0e-f3e458b43cc5 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:37.692135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-65ff1d16-565c-4c26-ad0e-f3e458b43cc5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 13:35:37.692135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:37.692135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:37.692135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:37.692135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:37.692135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:37.692135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:37.692135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:37.692135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:37.692135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:37.692135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:37.692135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:37.692135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:35:37.692135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:35:37.692135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:35:37.692135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:35:37.693106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:37.693106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:37.693106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:35:37.693106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:37.693106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:35:37.693106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:37.693106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:37.693106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:37.693106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:37.693106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:37.693106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:37.693106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:37.693106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:37.693106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:37.693106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:37.693106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:37.693106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:37.693106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:37.699340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:37.699340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:37.699340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:35:37.699340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:35:37.699340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:35:37.699340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:35:37.699340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:35:37.699340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:35:37.699340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 13:35:37.699340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:37.699340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 430/859] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:35:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:37.701718 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff1d16-565c-4c26-ad0e-f3e458b43cc5 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:37.728239 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a67e0-3456-424b-a295-58adb6202121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:37.729184 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a67e0-3456-424b-a295-58adb6202121 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:37.729458 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a67e0-3456-424b-a295-58adb6202121 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:37.729734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a67e0-3456-424b-a295-58adb6202121 None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:37.730484 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a67e0-3456-424b-a295-58adb6202121 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:37.731489 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a67e0-3456-424b-a295-58adb6202121 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:37.732742 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a67e0-3456-424b-a295-58adb6202121 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:37.757553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 430/860] 10.222.0.50 () {56 vars in 1149 bytes} [Thu Sep 1 13:35:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:37.765944 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a67e0-3456-424b-a295-58adb6202121 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:37.844187 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff1d16-565c-4c26-ad0e-f3e458b43cc5 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:37.884210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf61abc-d5be-4a02-a7cd-bd6865acce50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:37.885067 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf61abc-d5be-4a02-a7cd-bd6865acce50 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:37.885510 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf61abc-d5be-4a02-a7cd-bd6865acce50 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:37.885973 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf61abc-d5be-4a02-a7cd-bd6865acce50 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:37.887010 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf61abc-d5be-4a02-a7cd-bd6865acce50 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:37.887469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf61abc-d5be-4a02-a7cd-bd6865acce50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:37.889277 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf61abc-d5be-4a02-a7cd-bd6865acce50 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:37.911724 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 431/861] 10.222.0.50 () {56 vars in 1135 bytes} [Thu Sep 1 13:35:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:35:37.914589 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d46722-b253-4e32-b2ed-d5009e7e87e2 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:37.915069 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d46722-b253-4e32-b2ed-d5009e7e87e2 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:37.915555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d46722-b253-4e32-b2ed-d5009e7e87e2 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:37.915870 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a67e0-3456-424b-a295-58adb6202121 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:37.918325 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 432/862] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:37.920069 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d46722-b253-4e32-b2ed-d5009e7e87e2 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:37.963441 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec4e88-3944-4ec7-bf19-95e80e1b5345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:37.963761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec4e88-3944-4ec7-bf19-95e80e1b5345 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:37.964594 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec4e88-3944-4ec7-bf19-95e80e1b5345 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:37.964594 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec4e88-3944-4ec7-bf19-95e80e1b5345 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:37.980643 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:37.993826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:38.046925 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d46722-b253-4e32-b2ed-d5009e7e87e2 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:38.048842 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec4e88-3944-4ec7-bf19-95e80e1b5345 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:38.051323 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec4e88-3944-4ec7-bf19-95e80e1b5345 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:38.094439 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dca88-3b4a-43be-9533-e5c9866693bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:38.095047 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dca88-3b4a-43be-9533-e5c9866693bd None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:38.095328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dca88-3b4a-43be-9533-e5c9866693bd None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:38.095658 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dca88-3b4a-43be-9533-e5c9866693bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:38.178663 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181dca88-3b4a-43be-9533-e5c9866693bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:38.180374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181dca88-3b4a-43be-9533-e5c9866693bd None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:38.186664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 431/863] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:35:37 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:35:38.186664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f840c-3c39-460c-a9be-7002a2a611a3 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:38.186664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f840c-3c39-460c-a9be-7002a2a611a3 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:38.186664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f840c-3c39-460c-a9be-7002a2a611a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:38.205845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-9d8f840c-3c39-460c-a9be-7002a2a611a3 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:38.207148 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-9d8f840c-3c39-460c-a9be-7002a2a611a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:38.245886 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:38.270889 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:38.297803 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 432/864] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:38 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:35:38.298751 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f840c-3c39-460c-a9be-7002a2a611a3 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:38.319485 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 433/865] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:35:37 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:35:38.321341 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dca88-3b4a-43be-9533-e5c9866693bd None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:38.420314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f840c-3c39-460c-a9be-7002a2a611a3 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:38.444729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dca88-3b4a-43be-9533-e5c9866693bd None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:38.465836 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ced5b-92ab-4687-aec2-b0e87ac49e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:38.466623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ced5b-92ab-4687-aec2-b0e87ac49e9c None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:38.466900 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ced5b-92ab-4687-aec2-b0e87ac49e9c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:38.467176 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ced5b-92ab-4687-aec2-b0e87ac49e9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:38.480596 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ced5b-92ab-4687-aec2-b0e87ac49e9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:38.482642 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ced5b-92ab-4687-aec2-b0e87ac49e9c None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:38.495882 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a619277-515a-4f1d-9ab7-8113941de9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:38.497077 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a619277-515a-4f1d-9ab7-8113941de9ab None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:38.497520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a619277-515a-4f1d-9ab7-8113941de9ab None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:38.497943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a619277-515a-4f1d-9ab7-8113941de9ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:38.502578 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-946ced5b-92ab-4687-aec2-b0e87ac49e9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:38.502578 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:38.502578 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:38.502578 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:38.502578 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:38.502578 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:38.502578 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:38.502578 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:38.502578 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:38.502578 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:38.502578 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:38.502578 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:38.502578 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:38.502578 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:38.502578 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:38.502578 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:38.503654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:38.503654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:38.503654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:38.503654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:38.503654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:38.503654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:38.503654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:38.503654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:38.503654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:38.503654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:38.503654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:38.503654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:38.503654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:38.503654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:38.503654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:38.503654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:38.503654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:38.504552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:38.504552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:38.504552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:38.509654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 433/866] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:38.511888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ced5b-92ab-4687-aec2-b0e87ac49e9c None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:38.513716 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a619277-515a-4f1d-9ab7-8113941de9ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:38.515711 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a619277-515a-4f1d-9ab7-8113941de9ab None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:38.520007 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:38.537652 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-2a619277-515a-4f1d-9ab7-8113941de9ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:38.537652 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:38.537652 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:38.537652 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:38.537652 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:38.537652 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:38.537652 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:38.537652 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:38.537652 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:38.537652 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:38.537652 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:38.537652 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:38.537652 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:38.537652 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:38.537652 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:38.537652 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:38.545288 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:38.545288 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:38.545288 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:38.545288 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:38.545288 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:38.545288 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:38.545288 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:38.545288 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:38.545288 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:38.545288 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:38.545288 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:38.545288 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:38.545288 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:38.545288 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:38.545288 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:38.545288 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:38.545288 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:38.546307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:38.546307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:38.546307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:38.547036 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 434/867] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:38.548624 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a619277-515a-4f1d-9ab7-8113941de9ab None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:38.563808 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:38.648063 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ced5b-92ab-4687-aec2-b0e87ac49e9c None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:38.680380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a619277-515a-4f1d-9ab7-8113941de9ab None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:38.690274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1de4e4-3cee-4693-b66f-a53c77d63ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:38.691271 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1de4e4-3cee-4693-b66f-a53c77d63ba0 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:38.691610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1de4e4-3cee-4693-b66f-a53c77d63ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:38.692201 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1de4e4-3cee-4693-b66f-a53c77d63ba0 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:38.692869 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1de4e4-3cee-4693-b66f-a53c77d63ba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:38.693176 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1de4e4-3cee-4693-b66f-a53c77d63ba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:38.695232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1de4e4-3cee-4693-b66f-a53c77d63ba0 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:38.715053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 434/868] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:35:38.715268 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1de4e4-3cee-4693-b66f-a53c77d63ba0 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:38.725690 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0aec2-df8f-40dc-ac62-c65e754df23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:38.726304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0aec2-df8f-40dc-ac62-c65e754df23f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:38.728556 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0aec2-df8f-40dc-ac62-c65e754df23f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:38.728556 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0aec2-df8f-40dc-ac62-c65e754df23f None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:38.728556 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0aec2-df8f-40dc-ac62-c65e754df23f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:38.728556 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0aec2-df8f-40dc-ac62-c65e754df23f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:38.729162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0aec2-df8f-40dc-ac62-c65e754df23f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:38.742558 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 435/869] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:38.743221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0aec2-df8f-40dc-ac62-c65e754df23f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:38.822162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:38.840403 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:38.851810 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1de4e4-3cee-4693-b66f-a53c77d63ba0 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:38.874015 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0aec2-df8f-40dc-ac62-c65e754df23f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:38.896043 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e5a86-8bb7-402b-9f7a-43088fbd37d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:38.897260 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e5a86-8bb7-402b-9f7a-43088fbd37d8 None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:38.897893 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e5a86-8bb7-402b-9f7a-43088fbd37d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:38.898515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e5a86-8bb7-402b-9f7a-43088fbd37d8 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:38.899178 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e5a86-8bb7-402b-9f7a-43088fbd37d8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:38.900621 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e5a86-8bb7-402b-9f7a-43088fbd37d8 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:38.911677 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391a13e-9a40-4d80-af6b-a2d32fe50281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:38.917667 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391a13e-9a40-4d80-af6b-a2d32fe50281 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:38.917667 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391a13e-9a40-4d80-af6b-a2d32fe50281 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:38.917667 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391a13e-9a40-4d80-af6b-a2d32fe50281 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:38.920442 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391a13e-9a40-4d80-af6b-a2d32fe50281 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:38.921871 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391a13e-9a40-4d80-af6b-a2d32fe50281 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:38.934259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-7391a13e-9a40-4d80-af6b-a2d32fe50281 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:38.934259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:38.934259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:38.934259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:38.934259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:38.934259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:38.934259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:38.934259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:38.934259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:38.934259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:38.934259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:38.934259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:38.934259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:35:38.934259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:35:38.934259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:35:38.935306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:35:38.935306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:38.935306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:38.935306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:38.935306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:38.935306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:38.935306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:38.935306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:38.935306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:38.935306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:38.935306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:38.935306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:38.935306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:38.935306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:38.935306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:38.935306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:38.935306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:38.936275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:35:38.936275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:35:38.936275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:35:38.936275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:35:38.936275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:35:38.936275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:35:38.936275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:38.936275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:38.939493 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 436/870] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:38.940608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391a13e-9a40-4d80-af6b-a2d32fe50281 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:38.984710 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 435/871] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Sep 1 13:35:38 2022] POST /identity/v3/services => generated 269 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:35:38.993038 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e5a86-8bb7-402b-9f7a-43088fbd37d8 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:39.093011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391a13e-9a40-4d80-af6b-a2d32fe50281 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:39.116080 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:39.146401 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5f27f-d0a1-435f-983a-c23d64ab55eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:39.148143 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5f27f-d0a1-435f-983a-c23d64ab55eb None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:39.148654 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5f27f-d0a1-435f-983a-c23d64ab55eb None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:39.149139 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e5a86-8bb7-402b-9f7a-43088fbd37d8 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:39.149413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5f27f-d0a1-435f-983a-c23d64ab55eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:39.158684 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5f27f-d0a1-435f-983a-c23d64ab55eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:39.161634 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5f27f-d0a1-435f-983a-c23d64ab55eb None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:39.176668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-e7c5f27f-d0a1-435f-983a-c23d64ab55eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:39.176668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:39.176668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:39.176668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:39.176668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:39.176668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:39.176668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:39.176668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:39.176668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:39.176668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:39.176668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:39.176668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:39.176668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:35:39.176668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:35:39.176668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:35:39.178127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:35:39.178127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:39.178127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:39.178127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:39.178127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:39.178127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:39.178127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:39.178127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:39.178127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:39.178127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:39.178127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:39.178127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:39.178127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:39.178127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:39.178127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:39.178127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:39.178127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:39.179435 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:35:39.179435 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:35:39.179435 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:35:39.179435 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:35:39.179435 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:35:39.179435 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:35:39.179435 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:39.179435 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:39.179435 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 437/872] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:39.189186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5f27f-d0a1-435f-983a-c23d64ab55eb None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:39.206172 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f665b-243c-413f-91e5-8003f4109453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:39.206815 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f665b-243c-413f-91e5-8003f4109453 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:39.207111 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f665b-243c-413f-91e5-8003f4109453 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:39.207350 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f665b-243c-413f-91e5-8003f4109453 None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:39.207350 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f665b-243c-413f-91e5-8003f4109453 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:39.208540 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f665b-243c-413f-91e5-8003f4109453 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:39.210411 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f665b-243c-413f-91e5-8003f4109453 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:39.227555 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 436/873] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:35:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:39.234289 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f665b-243c-413f-91e5-8003f4109453 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:39.263752 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:39.320055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5f27f-d0a1-435f-983a-c23d64ab55eb None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:39.346409 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f665b-243c-413f-91e5-8003f4109453 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:39.361763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac240fad-c5f7-49eb-9b47-8833370bf869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:39.362532 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac240fad-c5f7-49eb-9b47-8833370bf869 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:39.362823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac240fad-c5f7-49eb-9b47-8833370bf869 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:39.363099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac240fad-c5f7-49eb-9b47-8833370bf869 None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:39.364047 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac240fad-c5f7-49eb-9b47-8833370bf869 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:39.364362 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac240fad-c5f7-49eb-9b47-8833370bf869 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:39.365930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac240fad-c5f7-49eb-9b47-8833370bf869 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:39.380292 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 438/874] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:35:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:35:39.386288 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac240fad-c5f7-49eb-9b47-8833370bf869 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:39.387561 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbea5a-b6fc-4351-8ed0-5d08628fb7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:39.388490 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbea5a-b6fc-4351-8ed0-5d08628fb7a9 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:39.388967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbea5a-b6fc-4351-8ed0-5d08628fb7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:39.389440 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbea5a-b6fc-4351-8ed0-5d08628fb7a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:39.390581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbea5a-b6fc-4351-8ed0-5d08628fb7a9 None admin] RBAC: Adding query filter params (role.id=f8c77ddd17fd4bc7af83e8d8905fb404, scope.project.id=6283121e17814cd792df9d0edf81bf2d, user.id=6f01578bf21244a5ac357e54979ffc0d) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:39.390581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbea5a-b6fc-4351-8ed0-5d08628fb7a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:39.392186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbea5a-b6fc-4351-8ed0-5d08628fb7a9 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:39.401312 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 437/875] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:35:39 2022] GET /identity/v3/role_assignments?user.id=6f01578bf21244a5ac357e54979ffc0d&scope.project.id=6283121e17814cd792df9d0edf81bf2d&role.id=f8c77ddd17fd4bc7af83e8d8905fb404 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:39.453958 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:39.532251 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac240fad-c5f7-49eb-9b47-8833370bf869 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:39.569809 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a0996-15c4-4576-98a1-8720ff718e53 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:39.570091 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a0996-15c4-4576-98a1-8720ff718e53 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:39.570371 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a0996-15c4-4576-98a1-8720ff718e53 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:39.571911 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 438/876] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:35:39.575476 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53515fc3-5853-4ce9-9fce-4126739da33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:39.576103 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53515fc3-5853-4ce9-9fce-4126739da33a None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:39.576382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53515fc3-5853-4ce9-9fce-4126739da33a None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:39.576655 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53515fc3-5853-4ce9-9fce-4126739da33a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:39.577478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53515fc3-5853-4ce9-9fce-4126739da33a None admin] RBAC: Adding query filter params (role.id=98ffd3c114804da292d7cb33721e9085, scope.project.id=6283121e17814cd792df9d0edf81bf2d, user.id=85bbede0f8674384bcc3028ea77eb724) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:39.577794 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53515fc3-5853-4ce9-9fce-4126739da33a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:39.579260 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53515fc3-5853-4ce9-9fce-4126739da33a None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:39.580793 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426a40e-a4c1-43e5-b96e-4daf6bc71db6 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:39.581074 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426a40e-a4c1-43e5-b96e-4daf6bc71db6 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:39.581355 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426a40e-a4c1-43e5-b96e-4daf6bc71db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:39.586923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 439/877] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:35:39 2022] GET /identity/v3/role_assignments?user.id=85bbede0f8674384bcc3028ea77eb724&scope.project.id=6283121e17814cd792df9d0edf81bf2d&role.id=98ffd3c114804da292d7cb33721e9085 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:35:39.603622 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-7426a40e-a4c1-43e5-b96e-4daf6bc71db6 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:39.605519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-7426a40e-a4c1-43e5-b96e-4daf6bc71db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:39.708443 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 439/878] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:39 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:35:39.996817 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53515fc3-5853-4ce9-9fce-4126739da33a None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:40.107763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:40.118177 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53515fc3-5853-4ce9-9fce-4126739da33a None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:40.155953 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0f732-e5b2-48c9-a459-56a78b0d48fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:40.156594 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0f732-e5b2-48c9-a459-56a78b0d48fe None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:40.156874 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0f732-e5b2-48c9-a459-56a78b0d48fe None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:40.157148 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0f732-e5b2-48c9-a459-56a78b0d48fe None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:40.157737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0f732-e5b2-48c9-a459-56a78b0d48fe None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:40.159144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0f732-e5b2-48c9-a459-56a78b0d48fe None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:40.171186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-0ce0f732-e5b2-48c9-a459-56a78b0d48fe None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 13:35:40.171186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:40.171186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:35:40.171186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:35:40.171186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:35:40.171186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:35:40.171186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:35:40.171186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:40.171186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 13:35:40.171186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:40.171186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:35:40.171186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:40.171186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:40.171186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:40.171186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:40.171186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:40.171186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:40.172491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:40.172491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:40.172491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:40.172491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:40.172491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:40.172491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:40.172491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:35:40.172491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:35:40.172491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:35:40.172491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:35:40.172491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:40.172491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:40.172491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:40.172491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:40.172491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:40.172491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:40.173542 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:40.173542 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:40.173542 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:40.173542 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:40.173542 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:40.173542 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:40.173542 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:40.173542 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:40.173542 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:40.173542 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:40.173542 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:35:40.173542 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:40.173542 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 13:35:40.173542 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:40.173542 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 440/879] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 1 13:35:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:40.181089 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426a40e-a4c1-43e5-b96e-4daf6bc71db6 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:40.207109 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:40.303901 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426a40e-a4c1-43e5-b96e-4daf6bc71db6 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:40.343689 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fccf22-b2ab-4c53-a385-75973f93e0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:40.344301 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fccf22-b2ab-4c53-a385-75973f93e0e5 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:40.344579 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fccf22-b2ab-4c53-a385-75973f93e0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:40.344851 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fccf22-b2ab-4c53-a385-75973f93e0e5 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:40.345481 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fccf22-b2ab-4c53-a385-75973f93e0e5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:40.345780 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fccf22-b2ab-4c53-a385-75973f93e0e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:40.347213 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fccf22-b2ab-4c53-a385-75973f93e0e5 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:40.353000 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 440/880] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 1 13:35:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:40.359996 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0f732-e5b2-48c9-a459-56a78b0d48fe None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:40.489721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0f732-e5b2-48c9-a459-56a78b0d48fe None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:40.528045 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0a17b-7917-40b9-81e6-25f618b33e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:40.528652 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0a17b-7917-40b9-81e6-25f618b33e31 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:40.528928 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0a17b-7917-40b9-81e6-25f618b33e31 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:40.529197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0a17b-7917-40b9-81e6-25f618b33e31 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:40.529829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0a17b-7917-40b9-81e6-25f618b33e31 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:40.530125 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0a17b-7917-40b9-81e6-25f618b33e31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:40.531532 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0a17b-7917-40b9-81e6-25f618b33e31 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:40.536987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 441/881] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 1 13:35:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:40.544011 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fccf22-b2ab-4c53-a385-75973f93e0e5 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:40.629477 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:40.670657 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fccf22-b2ab-4c53-a385-75973f93e0e5 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:40.707903 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716bd9f8-617d-4ff6-b7d5-d7455e0e7044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:40.708525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bd9f8-617d-4ff6-b7d5-d7455e0e7044 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:40.708808 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bd9f8-617d-4ff6-b7d5-d7455e0e7044 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:40.709086 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bd9f8-617d-4ff6-b7d5-d7455e0e7044 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:40.710322 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716bd9f8-617d-4ff6-b7d5-d7455e0e7044 None admin] RBAC: Adding query filter params (interface=public, service_id=0eebe1206193402ba44decc8369ccd23, region_id=RegionOne) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:40.710634 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716bd9f8-617d-4ff6-b7d5-d7455e0e7044 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:40.712065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716bd9f8-617d-4ff6-b7d5-d7455e0e7044 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:40.718467 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 441/882] 10.222.0.50 () {56 vars in 1251 bytes} [Thu Sep 1 13:35:40 2022] GET /identity/v3/endpoints?service_id=0eebe1206193402ba44decc8369ccd23&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:40.724392 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0a17b-7917-40b9-81e6-25f618b33e31 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:40.756131 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:40.853407 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0a17b-7917-40b9-81e6-25f618b33e31 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:40.888863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0caf8d-b2a7-4ee6-961c-fb19fc954e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:40.889391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0caf8d-b2a7-4ee6-961c-fb19fc954e05 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:40.889669 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0caf8d-b2a7-4ee6-961c-fb19fc954e05 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:40.889942 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0caf8d-b2a7-4ee6-961c-fb19fc954e05 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:40.890550 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0caf8d-b2a7-4ee6-961c-fb19fc954e05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:40.892000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0caf8d-b2a7-4ee6-961c-fb19fc954e05 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:40.899081 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 442/883] 10.222.0.50 () {56 vars in 1087 bytes} [Thu Sep 1 13:35:40 2022] GET /identity/v3/services => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:35:41.118326 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990069e-353e-49ea-89e2-5f7f4693d057 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:41.119031 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990069e-353e-49ea-89e2-5f7f4693d057 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:41.119569 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990069e-353e-49ea-89e2-5f7f4693d057 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:41.121494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 442/884] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:41.127489 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5e208-ed16-4f34-af36-3a7d14ea325a None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:41.128402 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5e208-ed16-4f34-af36-3a7d14ea325a None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:41.128903 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5e208-ed16-4f34-af36-3a7d14ea325a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:41.150031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-f4a5e208-ed16-4f34-af36-3a7d14ea325a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:41.152093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-f4a5e208-ed16-4f34-af36-3a7d14ea325a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:41.247501 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 443/885] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:35:41.519228 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990069e-353e-49ea-89e2-5f7f4693d057 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:41.628404 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d3d08-f3d9-4241-be2e-e107252426cc None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:41.628751 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d3d08-f3d9-4241-be2e-e107252426cc None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:41.628964 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d3d08-f3d9-4241-be2e-e107252426cc None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:41.630320 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990069e-353e-49ea-89e2-5f7f4693d057 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:41.630605 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 444/886] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:35:41.636074 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b837124-0b90-4d29-bea7-53c2d3ebc123 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:41.636365 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b837124-0b90-4d29-bea7-53c2d3ebc123 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:41.636634 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b837124-0b90-4d29-bea7-53c2d3ebc123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:41.656472 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-7b837124-0b90-4d29-bea7-53c2d3ebc123 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:41.657794 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-7b837124-0b90-4d29-bea7-53c2d3ebc123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:41.670666 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab439d0-03d4-4b01-b294-bca41c116369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:41.671306 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab439d0-03d4-4b01-b294-bca41c116369 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:41.671683 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab439d0-03d4-4b01-b294-bca41c116369 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:41.671965 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab439d0-03d4-4b01-b294-bca41c116369 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:41.672561 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab439d0-03d4-4b01-b294-bca41c116369 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:41.673514 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:41.673969 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab439d0-03d4-4b01-b294-bca41c116369 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:41.676948 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:41.683655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-9ab439d0-03d4-4b01-b294-bca41c116369 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 13:35:41.683655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:41.683655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:35:41.683655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:35:41.683655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:35:41.683655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:35:41.683655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:35:41.683655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:41.683655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 13:35:41.683655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:41.683655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:35:41.683655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:41.683655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:41.683655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:41.683655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:41.683655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:41.684674 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:41.684674 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:41.684674 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:41.684674 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:41.684674 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:41.684674 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:41.684674 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:41.684674 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:35:41.684674 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:35:41.684674 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:35:41.684674 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:35:41.684674 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:41.684674 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:41.684674 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:41.684674 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:41.684674 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:41.684674 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:41.685581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:41.685581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:41.685581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:41.685581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:41.685581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:41.685581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:41.685581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:41.685581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:41.685581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:41.685581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:41.685581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:35:41.685581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:41.685581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 13:35:41.685581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:41.685581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 443/887] 10.222.0.50 () {56 vars in 1132 bytes} [Thu Sep 1 13:35:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:41.686345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92af7af-b59a-4d96-ba27-fac5383e02c7 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:41.686345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92af7af-b59a-4d96-ba27-fac5383e02c7 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:41.687323 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92af7af-b59a-4d96-ba27-fac5383e02c7 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:41.688097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 444/888] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:41.691018 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92af7af-b59a-4d96-ba27-fac5383e02c7 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:41.737769 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 445/889] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:35:41.739050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e07c61-e959-479a-9d2f-b6cfa18d9272 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:41.739333 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e07c61-e959-479a-9d2f-b6cfa18d9272 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:41.739727 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e07c61-e959-479a-9d2f-b6cfa18d9272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:41.760739 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-09e07c61-e959-479a-9d2f-b6cfa18d9272 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:41.761953 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-09e07c61-e959-479a-9d2f-b6cfa18d9272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:41.825340 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92af7af-b59a-4d96-ba27-fac5383e02c7 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:41.855503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 446/890] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:35:41.876370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44e9ae-33af-4a0e-b4c7-7c75c2c41e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:41.877346 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44e9ae-33af-4a0e-b4c7-7c75c2c41e59 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:41.877841 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44e9ae-33af-4a0e-b4c7-7c75c2c41e59 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:41.878350 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44e9ae-33af-4a0e-b4c7-7c75c2c41e59 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:41.879173 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44e9ae-33af-4a0e-b4c7-7c75c2c41e59 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:41.879728 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44e9ae-33af-4a0e-b4c7-7c75c2c41e59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:41.881896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44e9ae-33af-4a0e-b4c7-7c75c2c41e59 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:41.891730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 445/891] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Sep 1 13:35:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:35:41.893591 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e07c61-e959-479a-9d2f-b6cfa18d9272 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:41.979731 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:42.003091 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e07c61-e959-479a-9d2f-b6cfa18d9272 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:42.010813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44e9ae-33af-4a0e-b4c7-7c75c2c41e59 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:42.052175 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a916365-0ee9-45fa-accf-e33ab6636838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:42.052847 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a916365-0ee9-45fa-accf-e33ab6636838 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:42.053220 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a916365-0ee9-45fa-accf-e33ab6636838 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:42.053502 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a916365-0ee9-45fa-accf-e33ab6636838 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:42.054159 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a916365-0ee9-45fa-accf-e33ab6636838 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:42.054445 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a916365-0ee9-45fa-accf-e33ab6636838 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:42.055956 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a916365-0ee9-45fa-accf-e33ab6636838 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:42.063334 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 447/892] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Sep 1 13:35:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:42.069746 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a916365-0ee9-45fa-accf-e33ab6636838 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:42.088590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:42.132380 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44e9ae-33af-4a0e-b4c7-7c75c2c41e59 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:42.169623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90339a8c-dae6-47b8-b1bc-eabfb84371c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:42.170257 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90339a8c-dae6-47b8-b1bc-eabfb84371c2 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:42.170537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90339a8c-dae6-47b8-b1bc-eabfb84371c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:42.170810 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90339a8c-dae6-47b8-b1bc-eabfb84371c2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:42.180688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a916365-0ee9-45fa-accf-e33ab6636838 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:42.181918 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90339a8c-dae6-47b8-b1bc-eabfb84371c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:35:42.187278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-90339a8c-dae6-47b8-b1bc-eabfb84371c2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 13:35:42.187278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:42.187278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:42.187278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:42.187278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:42.187278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:42.187278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:42.187278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:42.187278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:42.187278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:42.187278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:42.187278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:42.187278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:35:42.187278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:35:42.187278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:35:42.187278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:35:42.188426 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:35:42.188426 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:35:42.188426 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:35:42.188426 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:35:42.188426 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:42.188426 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:42.188426 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:42.188426 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:42.188426 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:42.188426 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:42.188426 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:42.188426 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:42.188426 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:42.188426 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:42.188426 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:42.188426 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:42.189249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:42.189249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:42.189249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:42.189249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:42.189249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:35:42.189249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:35:42.189249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:35:42.189249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:35:42.189249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:35:42.189249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:35:42.189249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 13:35:42.189249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:42.189249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 446/893] 10.222.0.50 () {56 vars in 1120 bytes} [Thu Sep 1 13:35:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:35:42.189928 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90339a8c-dae6-47b8-b1bc-eabfb84371c2 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:42.225150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61589e6c-ad05-4bb1-84d2-d657a7774210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:42.226040 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61589e6c-ad05-4bb1-84d2-d657a7774210 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:42.226463 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61589e6c-ad05-4bb1-84d2-d657a7774210 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:42.227002 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61589e6c-ad05-4bb1-84d2-d657a7774210 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:42.228693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61589e6c-ad05-4bb1-84d2-d657a7774210 None admin] RBAC: Adding query filter params (interface=public, service_id=ac73ddef7d29479ab771a086031e5474, region_id=RegionOne) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:42.229169 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61589e6c-ad05-4bb1-84d2-d657a7774210 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:42.230681 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61589e6c-ad05-4bb1-84d2-d657a7774210 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:42.245865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 448/894] 10.222.0.50 () {56 vars in 1251 bytes} [Thu Sep 1 13:35:42 2022] GET /identity/v3/endpoints?service_id=ac73ddef7d29479ab771a086031e5474&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:35:42.245865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61589e6c-ad05-4bb1-84d2-d657a7774210 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:42.255110 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:42.300335 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90339a8c-dae6-47b8-b1bc-eabfb84371c2 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:42.328260 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:42.340148 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfec4cf-7fef-4dd5-b01a-a1d4e95d3bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:42.340456 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfec4cf-7fef-4dd5-b01a-a1d4e95d3bee None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:42.340684 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfec4cf-7fef-4dd5-b01a-a1d4e95d3bee None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:42.340958 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfec4cf-7fef-4dd5-b01a-a1d4e95d3bee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:42.341551 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfec4cf-7fef-4dd5-b01a-a1d4e95d3bee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:42.342988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfec4cf-7fef-4dd5-b01a-a1d4e95d3bee None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:42.352065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-4dfec4cf-7fef-4dd5-b01a-a1d4e95d3bee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:35:42.352065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:42.352065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:35:42.352065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:35:42.352065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:35:42.352065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:35:42.352065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:35:42.352065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:42.352065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:35:42.352065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:42.352065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:35:42.352065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:42.352065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:42.352065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:42.352065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:42.352065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:42.352065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:42.353080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:42.353080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:42.353080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:42.353080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:42.353080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:42.353080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:42.353080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:35:42.353080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:35:42.353080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:35:42.353080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:35:42.353080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:42.353080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:42.353080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:42.353080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:42.353080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:42.353080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:42.353891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:42.353891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:42.353891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:42.353891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:42.353891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:42.353891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:42.353891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:42.353891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:42.353891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:42.353891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:42.353891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:35:42.353891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:42.353891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:35:42.353891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:42.354627 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61589e6c-ad05-4bb1-84d2-d657a7774210 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:42.358456 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 447/895] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Sep 1 13:35:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:42.359789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfec4cf-7fef-4dd5-b01a-a1d4e95d3bee None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:42.390188 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a38235-0f0b-4971-854a-0d150f7e79be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:42.390802 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a38235-0f0b-4971-854a-0d150f7e79be None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:42.391075 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a38235-0f0b-4971-854a-0d150f7e79be None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:42.391343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a38235-0f0b-4971-854a-0d150f7e79be None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:42.392036 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a38235-0f0b-4971-854a-0d150f7e79be None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:42.392334 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a38235-0f0b-4971-854a-0d150f7e79be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:42.393731 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a38235-0f0b-4971-854a-0d150f7e79be None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:42.407988 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 449/896] 10.222.0.50 () {56 vars in 1115 bytes} [Thu Sep 1 13:35:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:42.407988 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a38235-0f0b-4971-854a-0d150f7e79be None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:42.472510 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfec4cf-7fef-4dd5-b01a-a1d4e95d3bee None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:42.476979 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:42.508202 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4639d39-f4e1-428c-b971-fa0388a14809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:42.508672 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4639d39-f4e1-428c-b971-fa0388a14809 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:42.508947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4639d39-f4e1-428c-b971-fa0388a14809 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:42.509217 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4639d39-f4e1-428c-b971-fa0388a14809 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:42.509820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4639d39-f4e1-428c-b971-fa0388a14809 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:42.511187 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4639d39-f4e1-428c-b971-fa0388a14809 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:42.515330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a38235-0f0b-4971-854a-0d150f7e79be None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:42.516881 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 448/897] 10.222.0.50 () {56 vars in 1087 bytes} [Thu Sep 1 13:35:42 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:35:42.517659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4639d39-f4e1-428c-b971-fa0388a14809 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:42.576704 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64655998-7d22-41d0-8f5e-d741741adbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:42.576704 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64655998-7d22-41d0-8f5e-d741741adbe4 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:42.577030 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64655998-7d22-41d0-8f5e-d741741adbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:42.577107 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64655998-7d22-41d0-8f5e-d741741adbe4 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:42.577725 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64655998-7d22-41d0-8f5e-d741741adbe4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:42.578032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64655998-7d22-41d0-8f5e-d741741adbe4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:42.579517 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64655998-7d22-41d0-8f5e-d741741adbe4 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:42.585521 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 450/898] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Sep 1 13:35:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:42.595561 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64655998-7d22-41d0-8f5e-d741741adbe4 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:42.599292 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:42.659346 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4639d39-f4e1-428c-b971-fa0388a14809 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:42.705774 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d4448-95ce-4ee4-8120-eb55ce9ce4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:42.706468 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d4448-95ce-4ee4-8120-eb55ce9ce4b0 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:42.706751 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d4448-95ce-4ee4-8120-eb55ce9ce4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:42.707334 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d4448-95ce-4ee4-8120-eb55ce9ce4b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:42.719820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d4448-95ce-4ee4-8120-eb55ce9ce4b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:42.720771 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d4448-95ce-4ee4-8120-eb55ce9ce4b0 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:42.733408 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64655998-7d22-41d0-8f5e-d741741adbe4 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:42.737623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-398d4448-95ce-4ee4-8120-eb55ce9ce4b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:42.737623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:42.737623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:42.737623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:42.737623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:42.737623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:42.737623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:42.737623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:42.737623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:42.737623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:42.737623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:42.737623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:42.737623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:42.737623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:42.737623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:42.737623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:42.738527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:42.738527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:42.738527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:42.738527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:42.738527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:42.738527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:42.738527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:42.738527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:42.738527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:42.738527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:42.738527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:42.738527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:42.738527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:42.738527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:42.738527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:42.738527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:42.738527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:42.739496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:42.739496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:42.739496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:42.739496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 449/899] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:42.745813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d4448-95ce-4ee4-8120-eb55ce9ce4b0 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:42.771604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:42.781660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6d96c-4bba-4742-99e5-a82f39214c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:42.782281 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6d96c-4bba-4742-99e5-a82f39214c24 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:42.785796 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6d96c-4bba-4742-99e5-a82f39214c24 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:42.785796 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6d96c-4bba-4742-99e5-a82f39214c24 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:42.785796 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6d96c-4bba-4742-99e5-a82f39214c24 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:42.785796 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6d96c-4bba-4742-99e5-a82f39214c24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:42.785796 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6d96c-4bba-4742-99e5-a82f39214c24 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:42.799561 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 451/900] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Sep 1 13:35:42 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:42.880745 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d4448-95ce-4ee4-8120-eb55ce9ce4b0 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:42.883651 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:42.913509 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76724b0c-8844-476e-a418-a0a86e3ff4b4 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:42.914149 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76724b0c-8844-476e-a418-a0a86e3ff4b4 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:42.914640 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76724b0c-8844-476e-a418-a0a86e3ff4b4 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:42.916631 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 452/901] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:35:42.923323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dcde5-74db-4065-908a-7832b1a9fdff None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:42.923658 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dcde5-74db-4065-908a-7832b1a9fdff None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:42.923940 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dcde5-74db-4065-908a-7832b1a9fdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:42.926023 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80393e-cbae-4653-8013-08b7213d40dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:42.926889 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80393e-cbae-4653-8013-08b7213d40dd None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:42.927345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80393e-cbae-4653-8013-08b7213d40dd None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:42.927870 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80393e-cbae-4653-8013-08b7213d40dd None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:42.928755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80393e-cbae-4653-8013-08b7213d40dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:42.929241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80393e-cbae-4653-8013-08b7213d40dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:42.932321 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80393e-cbae-4653-8013-08b7213d40dd None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:42.943659 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-fd6dcde5-74db-4065-908a-7832b1a9fdff None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:42.944891 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-fd6dcde5-74db-4065-908a-7832b1a9fdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:42.947649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 450/902] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:35:42.956368 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80393e-cbae-4653-8013-08b7213d40dd None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:43.025423 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 453/903] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:42 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:35:43.077290 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80393e-cbae-4653-8013-08b7213d40dd None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:43.116213 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3342dad-ea1d-4ccc-bde2-484a51db90b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:43.116864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3342dad-ea1d-4ccc-bde2-484a51db90b4 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:43.117148 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3342dad-ea1d-4ccc-bde2-484a51db90b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:43.117495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3342dad-ea1d-4ccc-bde2-484a51db90b4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:43.127226 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3342dad-ea1d-4ccc-bde2-484a51db90b4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:43.129044 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3342dad-ea1d-4ccc-bde2-484a51db90b4 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:43.141794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-b3342dad-ea1d-4ccc-bde2-484a51db90b4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 13:35:43.141794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:43.141794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:43.141794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:43.141794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:43.141794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:43.141794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:43.141794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:43.141794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:43.141794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:43.141794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:43.141794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:43.141794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:35:43.141794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:35:43.141794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:35:43.141794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:35:43.142740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:43.142740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:43.142740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:35:43.142740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:43.142740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:35:43.142740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:43.142740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:43.142740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:43.142740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:43.142740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:43.142740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:43.142740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:43.142740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:43.142740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:43.142740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:43.142740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:43.142740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:43.142740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:43.148696 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:43.148696 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:43.148696 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:35:43.148696 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:35:43.148696 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:35:43.148696 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:35:43.148696 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:35:43.148696 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:35:43.148696 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 13:35:43.148696 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:43.148696 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 451/904] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Sep 1 13:35:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:43.155380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dcde5-74db-4065-908a-7832b1a9fdff None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:43.258814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dcde5-74db-4065-908a-7832b1a9fdff None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:43.291962 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:43.295819 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3342dad-ea1d-4ccc-bde2-484a51db90b4 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:43.298146 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ca1ec-71fb-4bf6-83e3-9219bbd220bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:43.298771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ca1ec-71fb-4bf6-83e3-9219bbd220bc None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:43.299049 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ca1ec-71fb-4bf6-83e3-9219bbd220bc None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:43.299318 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ca1ec-71fb-4bf6-83e3-9219bbd220bc None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:43.300161 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ca1ec-71fb-4bf6-83e3-9219bbd220bc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:43.300464 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ca1ec-71fb-4bf6-83e3-9219bbd220bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:43.301903 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ca1ec-71fb-4bf6-83e3-9219bbd220bc None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:43.321145 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 454/905] 10.222.0.50 () {56 vars in 1149 bytes} [Thu Sep 1 13:35:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:43.329709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ca1ec-71fb-4bf6-83e3-9219bbd220bc None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:43.335098 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:43.433888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3342dad-ea1d-4ccc-bde2-484a51db90b4 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:43.445674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ca1ec-71fb-4bf6-83e3-9219bbd220bc None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:43.478392 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863db251-7946-42c6-8ae1-5666c6da90cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:43.479319 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863db251-7946-42c6-8ae1-5666c6da90cd None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:43.479887 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863db251-7946-42c6-8ae1-5666c6da90cd None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:43.480167 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863db251-7946-42c6-8ae1-5666c6da90cd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:43.480753 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863db251-7946-42c6-8ae1-5666c6da90cd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:43.482377 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863db251-7946-42c6-8ae1-5666c6da90cd None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:43.484390 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e142a-1e76-4dd3-88fd-8ebdfdfd2a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:43.485233 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e142a-1e76-4dd3-88fd-8ebdfdfd2a0b None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:43.485614 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e142a-1e76-4dd3-88fd-8ebdfdfd2a0b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:43.485986 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e142a-1e76-4dd3-88fd-8ebdfdfd2a0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:43.492513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-863db251-7946-42c6-8ae1-5666c6da90cd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 13:35:43.492513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:43.492513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:35:43.492513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:35:43.492513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:35:43.492513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:35:43.492513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:35:43.492513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:43.492513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 13:35:43.492513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:43.492513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:35:43.492513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:43.492513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:43.492513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:43.492513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:43.492513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:43.492513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:43.494470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:43.494470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:43.494470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:43.494470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:43.494470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:43.494470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:43.494470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:35:43.494470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:35:43.494470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:35:43.494470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:35:43.494470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:43.494470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:43.494470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:43.494470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:43.494470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:43.494470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:43.496241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:43.496241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:43.496241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:43.496241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:43.496241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:43.496241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:43.496241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:43.496241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:43.496241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:43.496241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:43.496241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:35:43.496241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:43.496241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 13:35:43.496241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:43.503381 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 452/906] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 1 13:35:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:35:43.503381 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863db251-7946-42c6-8ae1-5666c6da90cd None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:43.548465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:43.566841 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e142a-1e76-4dd3-88fd-8ebdfdfd2a0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:43.569216 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e142a-1e76-4dd3-88fd-8ebdfdfd2a0b None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:43.611728 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:43.626918 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863db251-7946-42c6-8ae1-5666c6da90cd None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:43.669651 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5e151-0685-4089-b71e-258464ef4de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:43.670397 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5e151-0685-4089-b71e-258464ef4de6 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:43.670680 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5e151-0685-4089-b71e-258464ef4de6 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:43.670957 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5e151-0685-4089-b71e-258464ef4de6 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:43.671835 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5e151-0685-4089-b71e-258464ef4de6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:43.672519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5e151-0685-4089-b71e-258464ef4de6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:43.673973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5e151-0685-4089-b71e-258464ef4de6 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:43.683625 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 453/907] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 1 13:35:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:43.686840 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5e151-0685-4089-b71e-258464ef4de6 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:43.699450 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 455/908] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:35:43 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:35:43.706291 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e142a-1e76-4dd3-88fd-8ebdfdfd2a0b None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:43.791760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:43.803222 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5e151-0685-4089-b71e-258464ef4de6 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:43.807908 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e142a-1e76-4dd3-88fd-8ebdfdfd2a0b None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:43.841657 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4661de-798d-475a-8b2b-742f6eda6e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:43.842668 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4661de-798d-475a-8b2b-742f6eda6e0c None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:43.843094 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700cdeb-fb40-40f5-b4e0-1eba39acd567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:43.843475 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4661de-798d-475a-8b2b-742f6eda6e0c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:43.843891 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700cdeb-fb40-40f5-b4e0-1eba39acd567 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:43.844171 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700cdeb-fb40-40f5-b4e0-1eba39acd567 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:43.844402 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4661de-798d-475a-8b2b-742f6eda6e0c None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:43.844513 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700cdeb-fb40-40f5-b4e0-1eba39acd567 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:43.845373 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4661de-798d-475a-8b2b-742f6eda6e0c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:43.845883 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4661de-798d-475a-8b2b-742f6eda6e0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:43.850664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4661de-798d-475a-8b2b-742f6eda6e0c None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:43.855665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700cdeb-fb40-40f5-b4e0-1eba39acd567 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:43.857374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700cdeb-fb40-40f5-b4e0-1eba39acd567 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:43.858416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 454/909] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Sep 1 13:35:43 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:35:43.864195 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4661de-798d-475a-8b2b-742f6eda6e0c None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:43.884103 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-f700cdeb-fb40-40f5-b4e0-1eba39acd567 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:43.884103 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:43.884103 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:43.884103 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:43.884103 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:43.884103 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:43.884103 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:43.884103 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:43.884103 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:43.884103 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:43.884103 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:43.884103 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:43.884103 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:43.884103 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:43.884103 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:43.884103 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:43.885092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:43.885092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:43.885092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:43.885092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:43.885092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:43.885092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:43.885092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:43.885092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:43.885092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:43.885092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:43.885092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:43.885092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:43.885092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:43.885092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:43.885092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:43.885092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:43.885092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:43.886046 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:43.886046 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:43.886046 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:43.886046 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 456/910] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:43.892322 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700cdeb-fb40-40f5-b4e0-1eba39acd567 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:43.895601 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:44.016466 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4661de-798d-475a-8b2b-742f6eda6e0c None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:44.018208 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700cdeb-fb40-40f5-b4e0-1eba39acd567 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:44.056499 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fa367-08ab-4d5d-b91b-24aa4ba5694a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:44.057641 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fa367-08ab-4d5d-b91b-24aa4ba5694a None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:44.058220 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fa367-08ab-4d5d-b91b-24aa4ba5694a None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:44.058812 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fa367-08ab-4d5d-b91b-24aa4ba5694a None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:44.059713 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fa367-08ab-4d5d-b91b-24aa4ba5694a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:44.060305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fa367-08ab-4d5d-b91b-24aa4ba5694a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:44.060511 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0246c-bfec-4fc6-9898-068186448bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:44.061125 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0246c-bfec-4fc6-9898-068186448bbd None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:44.061406 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0246c-bfec-4fc6-9898-068186448bbd None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:44.061680 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0246c-bfec-4fc6-9898-068186448bbd None admin] PATH_INFO: `/v3/endpoints` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:44.062361 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0246c-bfec-4fc6-9898-068186448bbd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:44.062929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fa367-08ab-4d5d-b91b-24aa4ba5694a None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:44.063737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0246c-bfec-4fc6-9898-068186448bbd None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:44.066524 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:44.083412 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 457/911] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:44.086119 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fa367-08ab-4d5d-b91b-24aa4ba5694a None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:44.167668 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 455/912] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:35:43 2022] POST /identity/v3/endpoints => generated 346 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:35:44.210526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fa367-08ab-4d5d-b91b-24aa4ba5694a None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:44.260004 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb778151-d1d8-4950-a451-b52779bc9e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:44.261483 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb778151-d1d8-4950-a451-b52779bc9e13 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:44.261996 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb778151-d1d8-4950-a451-b52779bc9e13 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:44.262473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb778151-d1d8-4950-a451-b52779bc9e13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:44.271180 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb778151-d1d8-4950-a451-b52779bc9e13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:44.273702 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb778151-d1d8-4950-a451-b52779bc9e13 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:44.287304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-bb778151-d1d8-4950-a451-b52779bc9e13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:44.287304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:44.287304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:44.287304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:44.287304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:44.287304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:44.287304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:44.287304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:44.287304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:44.287304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:44.287304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:44.287304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:44.287304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:35:44.287304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:35:44.287304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:35:44.288481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:35:44.288481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:44.288481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:44.288481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:44.288481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:44.288481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:44.288481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:44.288481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:44.288481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:44.288481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:44.288481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:44.288481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:44.288481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:44.288481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:44.288481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:44.288481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:44.288481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:44.289473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:35:44.289473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:35:44.289473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:35:44.289473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:35:44.289473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:35:44.289473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:35:44.289473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:44.289473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:44.295751 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 458/913] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:35:44.297969 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0246c-bfec-4fc6-9898-068186448bbd None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:44.378594 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:44.410690 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0246c-bfec-4fc6-9898-068186448bbd None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:44.447926 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da980fdc-c0ec-4c29-b19a-7e3784310bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:44.448588 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da980fdc-c0ec-4c29-b19a-7e3784310bed None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:44.448870 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da980fdc-c0ec-4c29-b19a-7e3784310bed None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:44.449191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da980fdc-c0ec-4c29-b19a-7e3784310bed None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:44.449896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da980fdc-c0ec-4c29-b19a-7e3784310bed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:44.450206 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da980fdc-c0ec-4c29-b19a-7e3784310bed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:44.451762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da980fdc-c0ec-4c29-b19a-7e3784310bed None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:44.468433 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 456/914] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:35:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:44.471163 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb778151-d1d8-4950-a451-b52779bc9e13 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:44.525117 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bda71d-1b46-41ed-ad3d-782cae824d09 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:44.525434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bda71d-1b46-41ed-ad3d-782cae824d09 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:44.525607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bda71d-1b46-41ed-ad3d-782cae824d09 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:44.527278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 457/915] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:35:44.532761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5263ccf-ed67-4bee-a84d-249616136a61 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:44.533045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5263ccf-ed67-4bee-a84d-249616136a61 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:44.533377 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5263ccf-ed67-4bee-a84d-249616136a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:44.539037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:44.557817 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-a5263ccf-ed67-4bee-a84d-249616136a61 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:44.559467 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a5263ccf-ed67-4bee-a84d-249616136a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:44.593918 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb778151-d1d8-4950-a451-b52779bc9e13 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:44.636072 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f67d4-8c0f-440e-9f33-138cab28c215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:44.636832 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f67d4-8c0f-440e-9f33-138cab28c215 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:44.637454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f67d4-8c0f-440e-9f33-138cab28c215 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:44.637733 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f67d4-8c0f-440e-9f33-138cab28c215 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:44.638737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f67d4-8c0f-440e-9f33-138cab28c215 None admin] RBAC: Adding query filter params (role.id=802471bc911e46a6b7ad1f122b1a9e9e, scope.project.id=6283121e17814cd792df9d0edf81bf2d, user.id=6f01578bf21244a5ac357e54979ffc0d) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:44.639110 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f67d4-8c0f-440e-9f33-138cab28c215 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:44.641409 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f67d4-8c0f-440e-9f33-138cab28c215 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:44.651518 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 459/917] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:35:44 2022] GET /identity/v3/role_assignments?user.id=6f01578bf21244a5ac357e54979ffc0d&scope.project.id=6283121e17814cd792df9d0edf81bf2d&role.id=802471bc911e46a6b7ad1f122b1a9e9e => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:44.653397 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 458/917] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:35:44.825174 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6f184-f919-41f1-af62-aa2f03156e4a None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:44.825461 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6f184-f919-41f1-af62-aa2f03156e4a None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:44.825736 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6f184-f919-41f1-af62-aa2f03156e4a None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:44.827195 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 460/918] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:44.832565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04dff13-a234-40d5-94ba-a5123fb3071e None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:44.833083 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04dff13-a234-40d5-94ba-a5123fb3071e None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:44.833559 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04dff13-a234-40d5-94ba-a5123fb3071e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:44.859852 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-d04dff13-a234-40d5-94ba-a5123fb3071e None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:44.861356 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-d04dff13-a234-40d5-94ba-a5123fb3071e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:44.920657 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:44.928989 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6f184-f919-41f1-af62-aa2f03156e4a None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:44.933312 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 459/919] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:35:45.038728 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6f184-f919-41f1-af62-aa2f03156e4a None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:45.056458 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:45.075460 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f49600-11f4-4e15-aabc-6f4e699bb310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:45.076481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f49600-11f4-4e15-aabc-6f4e699bb310 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:45.076960 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f49600-11f4-4e15-aabc-6f4e699bb310 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:45.077448 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f49600-11f4-4e15-aabc-6f4e699bb310 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:45.078268 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f49600-11f4-4e15-aabc-6f4e699bb310 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:45.079901 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f49600-11f4-4e15-aabc-6f4e699bb310 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:45.090032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-d4f49600-11f4-4e15-aabc-6f4e699bb310 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 13:35:45.090032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:45.090032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:35:45.090032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:35:45.090032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:35:45.090032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:35:45.090032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:35:45.090032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:45.090032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 13:35:45.090032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:45.090032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:35:45.090032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:45.090032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:45.090032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:45.090032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:45.090032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:45.090952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:45.090952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:45.090952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:45.090952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:45.090952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:45.090952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:45.090952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:45.090952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:35:45.090952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:35:45.090952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:35:45.090952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:35:45.090952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:45.090952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:45.090952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:45.090952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:45.090952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:45.090952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:45.091851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:45.091851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:45.091851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:45.091851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:45.091851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:45.091851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:45.091851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:45.091851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:45.091851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:45.091851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:45.091851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:35:45.091851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:45.091851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 13:35:45.091851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:45.094532 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 461/920] 10.222.0.50 () {56 vars in 1132 bytes} [Thu Sep 1 13:35:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:35:45.101921 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04dff13-a234-40d5-94ba-a5123fb3071e None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:45.210706 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04dff13-a234-40d5-94ba-a5123fb3071e None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:45.213241 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f49600-11f4-4e15-aabc-6f4e699bb310 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:45.260703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0325975-64e0-4cb0-b2d7-874b467c5b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:45.261335 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0325975-64e0-4cb0-b2d7-874b467c5b42 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:45.261602 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0325975-64e0-4cb0-b2d7-874b467c5b42 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:45.261875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0325975-64e0-4cb0-b2d7-874b467c5b42 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:45.262513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0325975-64e0-4cb0-b2d7-874b467c5b42 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:45.262817 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0325975-64e0-4cb0-b2d7-874b467c5b42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:45.264224 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0325975-64e0-4cb0-b2d7-874b467c5b42 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:45.271412 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 460/921] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Sep 1 13:35:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:45.275111 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0325975-64e0-4cb0-b2d7-874b467c5b42 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:45.341426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f49600-11f4-4e15-aabc-6f4e699bb310 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:45.347398 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:45.390763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4f589-d292-4372-8081-f9542398b504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:45.391779 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4f589-d292-4372-8081-f9542398b504 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:45.392179 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4f589-d292-4372-8081-f9542398b504 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:45.392550 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4f589-d292-4372-8081-f9542398b504 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:45.393463 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4f589-d292-4372-8081-f9542398b504 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:45.395607 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4f589-d292-4372-8081-f9542398b504 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:45.397542 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0325975-64e0-4cb0-b2d7-874b467c5b42 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:45.433624 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1e70b-5c87-4cbc-a6de-b8a93e8c28b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:45.434492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1e70b-5c87-4cbc-a6de-b8a93e8c28b4 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:45.434943 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1e70b-5c87-4cbc-a6de-b8a93e8c28b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:45.435403 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1e70b-5c87-4cbc-a6de-b8a93e8c28b4 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:45.436191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1e70b-5c87-4cbc-a6de-b8a93e8c28b4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:45.436652 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1e70b-5c87-4cbc-a6de-b8a93e8c28b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:45.438200 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1e70b-5c87-4cbc-a6de-b8a93e8c28b4 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:45.444242 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 461/922] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Sep 1 13:35:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:45.449546 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1e70b-5c87-4cbc-a6de-b8a93e8c28b4 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:45.477807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 462/923] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Sep 1 13:35:45 2022] POST /identity/v3/services => generated 241 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:35:45.577015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1e70b-5c87-4cbc-a6de-b8a93e8c28b4 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:45.601405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:45.623768 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01588472-ce13-4b9b-b05a-93b3acc8955d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:45.624599 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01588472-ce13-4b9b-b05a-93b3acc8955d None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:45.625025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01588472-ce13-4b9b-b05a-93b3acc8955d None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:45.625441 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01588472-ce13-4b9b-b05a-93b3acc8955d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:45.626211 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01588472-ce13-4b9b-b05a-93b3acc8955d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:45.627828 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01588472-ce13-4b9b-b05a-93b3acc8955d None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:45.747838 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 462/924] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:35:45 2022] POST /identity/v3/endpoints => generated 347 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:35:46.213475 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23610382-2c99-4a79-8056-be3c98bfbb3e None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:46.213860 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23610382-2c99-4a79-8056-be3c98bfbb3e None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:46.214104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23610382-2c99-4a79-8056-be3c98bfbb3e None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:46.215761 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 463/925] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:46.221143 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3cdb6a-098f-4642-ad2e-ed5b772c785f None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:46.221692 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3cdb6a-098f-4642-ad2e-ed5b772c785f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:46.222174 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3cdb6a-098f-4642-ad2e-ed5b772c785f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:46.242396 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-ba3cdb6a-098f-4642-ad2e-ed5b772c785f None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:46.243961 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ba3cdb6a-098f-4642-ad2e-ed5b772c785f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:46.326405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 463/926] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:35:46.581337 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73420fed-5f23-4207-a2e1-cc74219b04a2 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:46.582341 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73420fed-5f23-4207-a2e1-cc74219b04a2 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:46.582833 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73420fed-5f23-4207-a2e1-cc74219b04a2 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:46.585212 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 464/927] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:46.590164 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7ba9e-b21f-4e77-9583-a234e3b41e35 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:46.590458 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7ba9e-b21f-4e77-9583-a234e3b41e35 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:46.590735 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7ba9e-b21f-4e77-9583-a234e3b41e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:46.605505 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73420fed-5f23-4207-a2e1-cc74219b04a2 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:46.610905 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-71b7ba9e-b21f-4e77-9583-a234e3b41e35 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:46.611292 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-71b7ba9e-b21f-4e77-9583-a234e3b41e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:46.655050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:46.698508 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 464/928] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:35:46.722744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73420fed-5f23-4207-a2e1-cc74219b04a2 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:46.760780 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e091587-13ee-4777-a6b7-d77cbc3ff6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:46.761834 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e091587-13ee-4777-a6b7-d77cbc3ff6a1 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:46.762332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e091587-13ee-4777-a6b7-d77cbc3ff6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:46.762836 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e091587-13ee-4777-a6b7-d77cbc3ff6a1 None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:46.763742 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e091587-13ee-4777-a6b7-d77cbc3ff6a1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:46.765460 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e091587-13ee-4777-a6b7-d77cbc3ff6a1 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:46.768364 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: WARNING keystone.server.flask.common [None req-3e091587-13ee-4777-a6b7-d77cbc3ff6a1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 01 13:35:46.813810 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.sql.core [None req-3e091587-13ee-4777-a6b7-d77cbc3ff6a1 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 13:35:46.813810 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 13:35:46.813810 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [parameters: {'id': 'b7dd1809b2814f3f87d57a87870c8dbe', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 13:35:46.813810 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88417) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 13:35:46.831263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-3e091587-13ee-4777-a6b7-d77cbc3ff6a1 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b7dd1809b2814f3f87d57a87870c8dbe.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b7dd1809b2814f3f87d57a87870c8dbe. Sep 01 13:35:46.831263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:46.831263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 13:35:46.831263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 13:35:46.831263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 13:35:46.831263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 13:35:46.831263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 13:35:46.831263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 13:35:46.831263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 13:35:46.831263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application conn.query(q) Sep 01 13:35:46.831263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 13:35:46.831263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 13:35:46.831263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 13:35:46.833165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application result.read() Sep 01 13:35:46.833165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 13:35:46.833165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 13:35:46.833165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 13:35:46.833165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 13:35:46.833165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 13:35:46.833165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 13:35:46.833165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 13:35:46.833165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 13:35:46.833165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 13:35:46.833165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:46.833165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 13:35:46.833165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:46.833165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:46.833165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 13:35:46.833165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 13:35:46.833165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 01 13:35:46.833165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 01 13:35:46.834764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 13:35:46.834764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application next(self.gen) Sep 01 13:35:46.834764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 13:35:46.834764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application yield resource Sep 01 13:35:46.834764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 13:35:46.834764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application next(self.gen) Sep 01 13:35:46.834764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 13:35:46.834764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 13:35:46.834764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 13:35:46.834764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 13:35:46.834764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 13:35:46.834764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise self.value Sep 01 13:35:46.834764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 13:35:46.834764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 13:35:46.834764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 13:35:46.834764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application session.commit() Sep 01 13:35:46.834764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 13:35:46.835688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 13:35:46.835688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 13:35:46.835688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 13:35:46.835688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 13:35:46.835688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self.session.flush() Sep 01 13:35:46.835688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 13:35:46.835688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 13:35:46.835688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 13:35:46.835688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 13:35:46.835688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 13:35:46.835688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application compat.raise_( Sep 01 13:35:46.835688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 13:35:46.835688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception Sep 01 13:35:46.835688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 13:35:46.835688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 13:35:46.835688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 13:35:46.835688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 13:35:46.837135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 13:35:46.837135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 13:35:46.837135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 13:35:46.837135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 13:35:46.837135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 13:35:46.837135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 13:35:46.837135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 13:35:46.837135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 13:35:46.837135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 13:35:46.837135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 13:35:46.837135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 13:35:46.837135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 13:35:46.837135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 13:35:46.837135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 13:35:46.837135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 13:35:46.837919 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 13:35:46.837919 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 13:35:46.837919 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception Sep 01 13:35:46.837919 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 13:35:46.837919 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 13:35:46.837919 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 13:35:46.837919 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 13:35:46.837919 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 13:35:46.837919 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 13:35:46.837919 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 13:35:46.837919 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application conn.query(q) Sep 01 13:35:46.837919 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 13:35:46.837919 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 13:35:46.837919 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 13:35:46.837919 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application result.read() Sep 01 13:35:46.837919 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 13:35:46.837919 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 13:35:46.838766 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 13:35:46.838766 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 13:35:46.838766 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 13:35:46.838766 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 13:35:46.838766 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 13:35:46.838766 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 13:35:46.838766 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 13:35:46.838766 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 13:35:46.838766 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [parameters: {'id': 'b7dd1809b2814f3f87d57a87870c8dbe', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 13:35:46.838766 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 13:35:46.838766 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:46.838766 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:35:46.838766 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:46.838766 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:46.838766 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 01 13:35:46.839574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 01 13:35:46.839574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 13:35:46.839574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 13:35:46.839574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 01 13:35:46.839574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:46.839574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:35:46.839574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:46.839574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:46.839574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:46.839574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:46.839574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:46.839574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:46.839574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:46.839574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:46.839574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:46.839574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:46.839574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:46.841880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:46.841880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 01 13:35:46.841880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 01 13:35:46.841880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:46.841880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:46.841880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 01 13:35:46.841880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 01 13:35:46.841880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b7dd1809b2814f3f87d57a87870c8dbe. Sep 01 13:35:46.841880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:46.844069 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 465/929] 10.222.0.50 () {60 vars in 1140 bytes} [Thu Sep 1 13:35:46 2022] POST /identity/v3/projects => generated 262 bytes in 239 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:35:46.853808 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7ba9e-b21f-4e77-9583-a234e3b41e35 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:46.888549 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:46.969304 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7ba9e-b21f-4e77-9583-a234e3b41e35 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:47.006166 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e091587-13ee-4777-a6b7-d77cbc3ff6a1 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:47.007224 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16c39f-ed4c-4da1-85e4-43a5d9174a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:47.007942 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16c39f-ed4c-4da1-85e4-43a5d9174a2c None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:47.008225 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16c39f-ed4c-4da1-85e4-43a5d9174a2c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:47.008496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16c39f-ed4c-4da1-85e4-43a5d9174a2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:47.016039 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16c39f-ed4c-4da1-85e4-43a5d9174a2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:47.017494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16c39f-ed4c-4da1-85e4-43a5d9174a2c None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:47.030132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-ae16c39f-ed4c-4da1-85e4-43a5d9174a2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:47.030132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:47.030132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:47.030132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:47.030132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:47.030132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:47.030132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:47.030132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:47.030132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:47.030132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:47.030132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:47.030132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:47.030132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:35:47.030132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:35:47.030132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:35:47.031097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:35:47.031097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:47.031097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:47.031097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:47.031097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:47.031097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:47.031097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:47.031097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:47.031097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:47.031097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:47.031097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:47.031097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:47.031097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:47.031097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:47.031097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:47.031097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:47.031097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:47.036571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:35:47.036571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:35:47.036571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:35:47.036571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:35:47.036571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:35:47.036571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:35:47.036571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:47.036571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:47.036571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 465/930] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:47.039617 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16c39f-ed4c-4da1-85e4-43a5d9174a2c None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:47.138694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:47.149328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e091587-13ee-4777-a6b7-d77cbc3ff6a1 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:47.152275 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:47.165082 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16c39f-ed4c-4da1-85e4-43a5d9174a2c None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:47.201376 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7dc53-8330-449e-8680-275c14bc3d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:47.201927 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9b88c-850c-40f5-8a9b-07b0177cd063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:47.202167 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7dc53-8330-449e-8680-275c14bc3d48 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:47.202515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7dc53-8330-449e-8680-275c14bc3d48 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:47.202856 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7dc53-8330-449e-8680-275c14bc3d48 None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:47.203500 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9b88c-850c-40f5-8a9b-07b0177cd063 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:47.203664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7dc53-8330-449e-8680-275c14bc3d48 None admin] RBAC: Adding query filter params (name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:47.204113 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9b88c-850c-40f5-8a9b-07b0177cd063 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:47.204243 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7dc53-8330-449e-8680-275c14bc3d48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:47.204682 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9b88c-850c-40f5-8a9b-07b0177cd063 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:47.206154 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7dc53-8330-449e-8680-275c14bc3d48 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:47.221126 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d9b88c-850c-40f5-8a9b-07b0177cd063 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:35:47.234388 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 466/931] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Sep 1 13:35:47 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:35:47.234613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-22d9b88c-850c-40f5-8a9b-07b0177cd063 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 13:35:47.234613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:47.234613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:47.234613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:47.234613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:47.234613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:47.234613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:47.234613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:47.234613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:47.234613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:47.234613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:47.234613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:47.234613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:35:47.234613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:35:47.234613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:35:47.234613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:35:47.235491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:35:47.235491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:35:47.235491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:35:47.235491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:35:47.235491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:47.235491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:47.235491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:47.235491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:47.235491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:47.235491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:47.235491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:47.235491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:47.235491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:47.235491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:47.235491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:47.235491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:47.236343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:47.236343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:47.236343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:47.236343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:47.236343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:35:47.236343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:35:47.236343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:35:47.236343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:35:47.236343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:35:47.236343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:35:47.236343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 13:35:47.236343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:47.236343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 466/932] 10.222.0.50 () {56 vars in 1120 bytes} [Thu Sep 1 13:35:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:35:47.244831 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7dc53-8330-449e-8680-275c14bc3d48 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:47.368998 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7dc53-8330-449e-8680-275c14bc3d48 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:47.407104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87e340-1c0e-4b97-9fb9-d70d2c6ad21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:47.408172 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87e340-1c0e-4b97-9fb9-d70d2c6ad21e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:47.408657 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87e340-1c0e-4b97-9fb9-d70d2c6ad21e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:47.409195 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87e340-1c0e-4b97-9fb9-d70d2c6ad21e None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:47.410067 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87e340-1c0e-4b97-9fb9-d70d2c6ad21e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:47.410590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87e340-1c0e-4b97-9fb9-d70d2c6ad21e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:47.412389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87e340-1c0e-4b97-9fb9-d70d2c6ad21e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:47.422018 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 467/933] 10.222.0.50 () {56 vars in 1115 bytes} [Thu Sep 1 13:35:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:47.428428 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9b88c-850c-40f5-8a9b-07b0177cd063 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:47.537322 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9b88c-850c-40f5-8a9b-07b0177cd063 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:47.539323 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c9355-d17f-44bb-b3c8-06644eba8f84 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:47.539849 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c9355-d17f-44bb-b3c8-06644eba8f84 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:47.540327 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c9355-d17f-44bb-b3c8-06644eba8f84 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:47.542130 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 468/934] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:47.547577 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2100ad-f48e-45a2-9a1a-9171ccf96e77 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:47.548148 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2100ad-f48e-45a2-9a1a-9171ccf96e77 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:47.548634 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2100ad-f48e-45a2-9a1a-9171ccf96e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:47.572007 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-1b2100ad-f48e-45a2-9a1a-9171ccf96e77 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:47.573205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-1b2100ad-f48e-45a2-9a1a-9171ccf96e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:47.577129 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:47.584917 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017afd2-87a7-465c-a0f4-5d664aa5353f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:47.586551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017afd2-87a7-465c-a0f4-5d664aa5353f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:47.587328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017afd2-87a7-465c-a0f4-5d664aa5353f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:47.587813 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017afd2-87a7-465c-a0f4-5d664aa5353f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:47.603458 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017afd2-87a7-465c-a0f4-5d664aa5353f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:47.606481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017afd2-87a7-465c-a0f4-5d664aa5353f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:47.624258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-b017afd2-87a7-465c-a0f4-5d664aa5353f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:47.624258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:47.624258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:47.624258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:47.624258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:47.624258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:47.624258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:47.624258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:47.624258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:47.624258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:47.624258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:47.624258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:47.624258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:47.624258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:47.624258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:47.624258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:47.625238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:47.625238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:47.625238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:47.625238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:47.625238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:47.625238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:47.625238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:47.625238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:47.625238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:47.625238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:47.625238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:47.625238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:47.625238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:47.625238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:47.625238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:47.625238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:47.625238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:47.626112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:47.626112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:47.626112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:47.626112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 467/935] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:35:47.630939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017afd2-87a7-465c-a0f4-5d664aa5353f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:47.642900 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:47.666201 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 469/936] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:35:47.713360 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d8296-f8c2-4916-a29c-16abcf8dd937 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:47.713807 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d8296-f8c2-4916-a29c-16abcf8dd937 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:47.714194 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d8296-f8c2-4916-a29c-16abcf8dd937 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:47.715983 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 470/937] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:35:47.721719 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0680696-4809-4460-bcf2-e6a6d8a28f1e None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:47.722006 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0680696-4809-4460-bcf2-e6a6d8a28f1e None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:47.722283 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0680696-4809-4460-bcf2-e6a6d8a28f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:47.741539 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-b0680696-4809-4460-bcf2-e6a6d8a28f1e None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:47.742746 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b0680696-4809-4460-bcf2-e6a6d8a28f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:47.754666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017afd2-87a7-465c-a0f4-5d664aa5353f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:47.791200 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4eef3-2e9e-4dda-9b31-4525eef31a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:47.791859 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4eef3-2e9e-4dda-9b31-4525eef31a26 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:47.792136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4eef3-2e9e-4dda-9b31-4525eef31a26 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:47.792407 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4eef3-2e9e-4dda-9b31-4525eef31a26 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:47.793048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4eef3-2e9e-4dda-9b31-4525eef31a26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:47.793346 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4eef3-2e9e-4dda-9b31-4525eef31a26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:47.794719 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4eef3-2e9e-4dda-9b31-4525eef31a26 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:47.815056 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 468/938] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:47.816053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4eef3-2e9e-4dda-9b31-4525eef31a26 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:47.827539 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 471/939] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:35:47.888216 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:47.922455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4eef3-2e9e-4dda-9b31-4525eef31a26 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:47.957459 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab7579-fc3d-4362-b084-51aae079ab8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:47.958092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab7579-fc3d-4362-b084-51aae079ab8e None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:47.958366 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab7579-fc3d-4362-b084-51aae079ab8e None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:47.958735 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab7579-fc3d-4362-b084-51aae079ab8e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:47.965463 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0680696-4809-4460-bcf2-e6a6d8a28f1e None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:47.966473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab7579-fc3d-4362-b084-51aae079ab8e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:47.967954 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab7579-fc3d-4362-b084-51aae079ab8e None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:47.984413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-eeab7579-fc3d-4362-b084-51aae079ab8e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 13:35:47.984413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:47.984413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:47.984413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:47.984413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:47.984413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:47.984413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:47.984413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:47.984413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:47.984413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:47.984413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:47.984413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:47.984413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:35:47.984413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:35:47.984413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:35:47.984413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:35:47.985455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:47.985455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:47.985455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:35:47.985455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:47.985455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:35:47.985455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:47.985455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:47.985455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:47.985455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:47.985455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:47.985455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:47.985455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:47.985455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:47.985455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:47.985455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:47.985455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:47.985455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:47.985455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:47.987011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:47.987011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:47.987011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:35:47.987011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:35:47.987011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:35:47.987011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:35:47.987011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:35:47.987011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:35:47.987011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 13:35:47.987011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:47.987011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 469/940] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Sep 1 13:35:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:35:47.991923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab7579-fc3d-4362-b084-51aae079ab8e None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:48.058704 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:48.102389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0680696-4809-4460-bcf2-e6a6d8a28f1e None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:48.103708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab7579-fc3d-4362-b084-51aae079ab8e None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:48.134571 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:48.142461 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f695441-f370-461a-9412-756ad0320c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:48.142791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5551f86-db88-4966-9d06-7a5578a0068a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:48.143076 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f695441-f370-461a-9412-756ad0320c5d None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:48.143377 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f695441-f370-461a-9412-756ad0320c5d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:48.143568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5551f86-db88-4966-9d06-7a5578a0068a None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:48.143668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f695441-f370-461a-9412-756ad0320c5d None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:48.143816 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5551f86-db88-4966-9d06-7a5578a0068a None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:48.144086 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5551f86-db88-4966-9d06-7a5578a0068a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:48.144373 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f695441-f370-461a-9412-756ad0320c5d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:48.144671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5551f86-db88-4966-9d06-7a5578a0068a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:48.144769 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f695441-f370-461a-9412-756ad0320c5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:48.146591 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5551f86-db88-4966-9d06-7a5578a0068a None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:48.146713 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f695441-f370-461a-9412-756ad0320c5d None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:48.156764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-b5551f86-db88-4966-9d06-7a5578a0068a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:35:48.156764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:48.156764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:35:48.156764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:35:48.156764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:35:48.156764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:35:48.156764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:35:48.156764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:48.156764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:35:48.156764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:48.156764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:35:48.156764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:48.156764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:48.156764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:48.156764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:48.156764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:48.156764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:48.161189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:48.161189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:48.161189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:48.161189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:48.161189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:48.161189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:48.161189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:35:48.161189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:35:48.161189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:35:48.161189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:35:48.161189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:48.161189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:48.161189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:48.161189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:48.161189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:48.161189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:48.162100 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:48.162100 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:48.162100 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:48.162100 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:48.162100 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:48.162100 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:48.162100 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:48.162100 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:48.162100 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:48.162100 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:48.162100 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:35:48.162100 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:48.162100 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:35:48.162100 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:48.163933 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 472/941] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Sep 1 13:35:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:35:48.163933 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5551f86-db88-4966-9d06-7a5578a0068a None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:48.168764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 470/942] 10.222.0.50 () {56 vars in 1149 bytes} [Thu Sep 1 13:35:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:48.169330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f695441-f370-461a-9412-756ad0320c5d None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:48.278269 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5551f86-db88-4966-9d06-7a5578a0068a None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:48.285714 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f695441-f370-461a-9412-756ad0320c5d None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:48.315665 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fbb72-5930-4885-8ba3-e3e197af055e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:48.316498 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fbb72-5930-4885-8ba3-e3e197af055e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:48.316945 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fbb72-5930-4885-8ba3-e3e197af055e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:48.317433 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fbb72-5930-4885-8ba3-e3e197af055e None admin] PATH_INFO: `/v3/services/compute` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:48.318602 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28fbb72-5930-4885-8ba3-e3e197af055e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:48.321165 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28fbb72-5930-4885-8ba3-e3e197af055e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:48.323881 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:48.325565 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7033c2-108b-409b-8f9f-62771888e606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:48.326820 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7033c2-108b-409b-8f9f-62771888e606 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:48.327306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7033c2-108b-409b-8f9f-62771888e606 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:48.327769 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7033c2-108b-409b-8f9f-62771888e606 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:48.328467 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7033c2-108b-409b-8f9f-62771888e606 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:48.328774 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7033c2-108b-409b-8f9f-62771888e606 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:48.330151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7033c2-108b-409b-8f9f-62771888e606 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:48.332777 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-a28fbb72-5930-4885-8ba3-e3e197af055e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 13:35:48.332777 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:48.332777 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:35:48.332777 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:35:48.332777 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:35:48.332777 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:35:48.332777 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:35:48.332777 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:48.332777 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 13:35:48.332777 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:48.332777 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:35:48.332777 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:48.332777 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:48.332777 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:48.332777 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:48.332777 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:48.332777 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:48.340590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:48.340590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:48.340590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:48.340590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:48.340590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:48.340590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:48.340590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:35:48.340590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:35:48.340590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:35:48.340590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:35:48.340590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:48.340590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:48.340590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:48.340590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:48.340590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:48.340590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:48.341408 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:48.341408 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:48.341408 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:48.341408 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:48.341408 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:48.341408 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:48.341408 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:48.341408 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:48.341408 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:48.341408 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:48.341408 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:35:48.341408 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:48.341408 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 13:35:48.341408 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:48.341408 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 473/943] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:48.342163 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fbb72-5930-4885-8ba3-e3e197af055e None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:48.342237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 471/944] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Sep 1 13:35:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:48.342237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7033c2-108b-409b-8f9f-62771888e606 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:48.394494 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:48.453842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7033c2-108b-409b-8f9f-62771888e606 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:48.455376 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fbb72-5930-4885-8ba3-e3e197af055e None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:48.491584 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36277a7-b740-4eb6-ab54-4002aecc51f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:48.492197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36277a7-b740-4eb6-ab54-4002aecc51f8 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:48.492472 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36277a7-b740-4eb6-ab54-4002aecc51f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:48.492745 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36277a7-b740-4eb6-ab54-4002aecc51f8 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:48.493373 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36277a7-b740-4eb6-ab54-4002aecc51f8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:48.493642 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d08ff-b11e-4bb8-8b65-b0673c252d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:48.493768 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36277a7-b740-4eb6-ab54-4002aecc51f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:48.494278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d08ff-b11e-4bb8-8b65-b0673c252d62 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:48.494552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d08ff-b11e-4bb8-8b65-b0673c252d62 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:48.494822 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d08ff-b11e-4bb8-8b65-b0673c252d62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:48.495053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36277a7-b740-4eb6-ab54-4002aecc51f8 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:48.503400 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 472/945] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Sep 1 13:35:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:48.503400 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36277a7-b740-4eb6-ab54-4002aecc51f8 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:48.509543 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d08ff-b11e-4bb8-8b65-b0673c252d62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:48.511519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d08ff-b11e-4bb8-8b65-b0673c252d62 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:48.527119 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-5b8d08ff-b11e-4bb8-8b65-b0673c252d62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:48.527119 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:48.527119 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:48.527119 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:48.527119 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:48.527119 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:48.527119 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:48.527119 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:48.527119 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:48.527119 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:48.527119 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:48.527119 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:48.527119 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:48.527119 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:48.527119 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:48.527119 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:48.528084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:48.528084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:48.528084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:48.528084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:48.528084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:48.528084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:48.528084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:48.528084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:48.528084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:48.528084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:48.528084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:48.528084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:48.528084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:48.528084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:48.528084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:48.528084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:48.528084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:48.528994 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:48.528994 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:48.528994 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:48.528994 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 474/946] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:48.529241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d08ff-b11e-4bb8-8b65-b0673c252d62 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:48.582752 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:48.614693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36277a7-b740-4eb6-ab54-4002aecc51f8 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:48.629758 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:48.635333 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d08ff-b11e-4bb8-8b65-b0673c252d62 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:48.651390 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba2a90-7a08-44fd-98dc-a2fbe381a18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:48.651998 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba2a90-7a08-44fd-98dc-a2fbe381a18b None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:48.652335 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba2a90-7a08-44fd-98dc-a2fbe381a18b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:48.652609 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba2a90-7a08-44fd-98dc-a2fbe381a18b None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:48.653233 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba2a90-7a08-44fd-98dc-a2fbe381a18b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:48.653536 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba2a90-7a08-44fd-98dc-a2fbe381a18b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:48.654905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba2a90-7a08-44fd-98dc-a2fbe381a18b None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:48.664961 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 473/947] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Sep 1 13:35:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:48.665704 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba2a90-7a08-44fd-98dc-a2fbe381a18b None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:48.670115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76e99c-1e8f-480a-911b-99dc831923fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:48.670812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76e99c-1e8f-480a-911b-99dc831923fd None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:48.671096 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76e99c-1e8f-480a-911b-99dc831923fd None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:48.671389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76e99c-1e8f-480a-911b-99dc831923fd None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:48.672093 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76e99c-1e8f-480a-911b-99dc831923fd None admin] RBAC: Adding query filter params (type=compute) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:48.672649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76e99c-1e8f-480a-911b-99dc831923fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:48.674791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76e99c-1e8f-480a-911b-99dc831923fd None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:48.689063 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 475/948] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Sep 1 13:35:48 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:48.689063 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76e99c-1e8f-480a-911b-99dc831923fd None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:48.823382 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76e99c-1e8f-480a-911b-99dc831923fd None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:48.837294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba2a90-7a08-44fd-98dc-a2fbe381a18b None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:48.847555 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:48.871471 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09462e3b-ddf0-48b6-aa48-d5c90d7b6772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:48.872439 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09462e3b-ddf0-48b6-aa48-d5c90d7b6772 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:48.872971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09462e3b-ddf0-48b6-aa48-d5c90d7b6772 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:48.873445 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09462e3b-ddf0-48b6-aa48-d5c90d7b6772 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:48.874400 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09462e3b-ddf0-48b6-aa48-d5c90d7b6772 None admin] RBAC: Adding query filter params (interface=public, service_id=3dafb6b239104a5c8b06a3c68d86d5c9, region_id=RegionOne) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:48.874716 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09462e3b-ddf0-48b6-aa48-d5c90d7b6772 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:48.876142 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09462e3b-ddf0-48b6-aa48-d5c90d7b6772 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:48.881397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ad9a6-b44e-4ea9-a057-21e38d831e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:48.882019 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ad9a6-b44e-4ea9-a057-21e38d831e25 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:48.882301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ad9a6-b44e-4ea9-a057-21e38d831e25 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:48.882754 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ad9a6-b44e-4ea9-a057-21e38d831e25 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:48.882857 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 476/949] 10.222.0.50 () {56 vars in 1251 bytes} [Thu Sep 1 13:35:48 2022] GET /identity/v3/endpoints?service_id=3dafb6b239104a5c8b06a3c68d86d5c9&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:48.883306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ad9a6-b44e-4ea9-a057-21e38d831e25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:48.883712 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ad9a6-b44e-4ea9-a057-21e38d831e25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:48.885101 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ad9a6-b44e-4ea9-a057-21e38d831e25 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:48.888112 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09462e3b-ddf0-48b6-aa48-d5c90d7b6772 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:48.915795 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 474/950] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:48.922244 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ad9a6-b44e-4ea9-a057-21e38d831e25 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:48.968951 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:49.011202 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09462e3b-ddf0-48b6-aa48-d5c90d7b6772 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:49.037363 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ad9a6-b44e-4ea9-a057-21e38d831e25 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:49.053779 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593243bf-d477-4cbe-bc79-ce47bd6b3561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:49.054146 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593243bf-d477-4cbe-bc79-ce47bd6b3561 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:49.054337 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593243bf-d477-4cbe-bc79-ce47bd6b3561 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:49.054620 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593243bf-d477-4cbe-bc79-ce47bd6b3561 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:49.055235 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593243bf-d477-4cbe-bc79-ce47bd6b3561 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:49.056747 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593243bf-d477-4cbe-bc79-ce47bd6b3561 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:49.067416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 477/951] 10.222.0.50 () {56 vars in 1087 bytes} [Thu Sep 1 13:35:48 2022] GET /identity/v3/services => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 13:35:49.087586 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29cf8eb-b063-46db-935f-ac1fd06e208f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:49.088186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cf8eb-b063-46db-935f-ac1fd06e208f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:49.088465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cf8eb-b063-46db-935f-ac1fd06e208f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:49.088735 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cf8eb-b063-46db-935f-ac1fd06e208f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:49.096988 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29cf8eb-b063-46db-935f-ac1fd06e208f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:49.098536 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29cf8eb-b063-46db-935f-ac1fd06e208f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:49.112814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-d29cf8eb-b063-46db-935f-ac1fd06e208f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:49.112814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:49.112814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:49.112814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:49.112814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:49.112814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:49.112814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:49.112814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:49.112814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:49.112814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:49.112814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:49.112814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:49.112814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:35:49.112814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:35:49.112814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:35:49.113872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:35:49.113872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:49.113872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:49.113872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:49.113872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:49.113872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:49.113872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:49.113872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:49.113872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:49.113872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:49.113872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:49.113872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:49.113872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:49.113872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:49.113872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:49.113872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:49.113872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:49.114872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:35:49.114872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:35:49.114872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:35:49.114872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:35:49.114872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:35:49.114872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:35:49.114872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:49.114872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:49.118856 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 475/952] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:49.132539 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593243bf-d477-4cbe-bc79-ce47bd6b3561 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:49.190307 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:49.284293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593243bf-d477-4cbe-bc79-ce47bd6b3561 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:49.288212 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc4732-7170-4819-826f-d6993687d5d3 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:49.289040 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc4732-7170-4819-826f-d6993687d5d3 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:49.289972 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc4732-7170-4819-826f-d6993687d5d3 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:49.293149 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 476/953] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:49.302426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba8e59-876d-4b54-be47-d2b6fe640b17 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:49.303299 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba8e59-876d-4b54-be47-d2b6fe640b17 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:49.304265 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba8e59-876d-4b54-be47-d2b6fe640b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:49.327619 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb84db-9b0b-40d5-a79f-1c108ca90c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:49.328585 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb84db-9b0b-40d5-a79f-1c108ca90c18 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:49.329067 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb84db-9b0b-40d5-a79f-1c108ca90c18 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:49.329642 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb84db-9b0b-40d5-a79f-1c108ca90c18 None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:49.330241 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-94ba8e59-876d-4b54-be47-d2b6fe640b17 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:49.330919 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb84db-9b0b-40d5-a79f-1c108ca90c18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:49.331502 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb84db-9b0b-40d5-a79f-1c108ca90c18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:49.331785 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-94ba8e59-876d-4b54-be47-d2b6fe640b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:49.333460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb84db-9b0b-40d5-a79f-1c108ca90c18 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:49.351616 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 478/954] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:35:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:49.360891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb84db-9b0b-40d5-a79f-1c108ca90c18 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:49.410739 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 477/955] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:35:49.485816 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb84db-9b0b-40d5-a79f-1c108ca90c18 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:49.487315 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:49.522485 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57035c2e-dc9f-4672-a4ca-ec5d016bcde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:49.523138 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57035c2e-dc9f-4672-a4ca-ec5d016bcde4 None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:49.523487 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57035c2e-dc9f-4672-a4ca-ec5d016bcde4 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:49.523767 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57035c2e-dc9f-4672-a4ca-ec5d016bcde4 None admin] PATH_INFO: `/v3/projects/6283121e17814cd792df9d0edf81bf2d/users/6f01578bf21244a5ac357e54979ffc0d/roles/802471bc911e46a6b7ad1f122b1a9e9e` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:49.526007 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57035c2e-dc9f-4672-a4ca-ec5d016bcde4 None admin] RBAC: Authorizing `identity:create_grant(project_id=6283121e17814cd792df9d0edf81bf2d, user_id=6f01578bf21244a5ac357e54979ffc0d, role_id=802471bc911e46a6b7ad1f122b1a9e9e)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:49.527512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57035c2e-dc9f-4672-a4ca-ec5d016bcde4 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:49.609453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 479/956] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 1 13:35:49 2022] PUT /identity/v3/projects/6283121e17814cd792df9d0edf81bf2d/users/6f01578bf21244a5ac357e54979ffc0d/roles/802471bc911e46a6b7ad1f122b1a9e9e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:35:49.716910 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba8e59-876d-4b54-be47-d2b6fe640b17 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:49.748157 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:49.831166 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba8e59-876d-4b54-be47-d2b6fe640b17 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:49.876965 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5d1ea-1b8f-4fbe-b2c6-ac8e46b359c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:49.877550 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5d1ea-1b8f-4fbe-b2c6-ac8e46b359c0 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:49.877898 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5d1ea-1b8f-4fbe-b2c6-ac8e46b359c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:49.878176 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5d1ea-1b8f-4fbe-b2c6-ac8e46b359c0 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:49.878824 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5d1ea-1b8f-4fbe-b2c6-ac8e46b359c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:49.880959 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5d1ea-1b8f-4fbe-b2c6-ac8e46b359c0 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:49.928511 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.sql.core [None req-53a5d1ea-1b8f-4fbe-b2c6-ac8e46b359c0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 13:35:49.928511 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 13:35:49.928511 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [parameters: {'user_id': 'b85d34077eed4f9db2307511c380a918', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 13:35:49.928511 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88417) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 13:35:49.937257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-53a5d1ea-1b8f-4fbe-b2c6-ac8e46b359c0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 13:35:49.937257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:49.937257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 13:35:49.937257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 13:35:49.937257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 13:35:49.937257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 13:35:49.937257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 13:35:49.937257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 13:35:49.937257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 13:35:49.937257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application conn.query(q) Sep 01 13:35:49.937257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 13:35:49.937257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 13:35:49.937257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 13:35:49.937257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application result.read() Sep 01 13:35:49.937257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 13:35:49.946136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 13:35:49.946136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 13:35:49.946136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 13:35:49.946136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 13:35:49.946136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 13:35:49.946136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 13:35:49.946136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 13:35:49.946136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 13:35:49.946136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:49.946136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 13:35:49.946136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:49.946136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:49.946136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 13:35:49.946136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 13:35:49.946136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 01 13:35:49.946136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 01 13:35:49.946136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 13:35:49.946136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application next(self.gen) Sep 01 13:35:49.947112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 13:35:49.947112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application yield resource Sep 01 13:35:49.947112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 13:35:49.947112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application next(self.gen) Sep 01 13:35:49.947112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 13:35:49.947112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 13:35:49.947112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 13:35:49.947112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 13:35:49.947112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 13:35:49.947112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise self.value Sep 01 13:35:49.947112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 13:35:49.947112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 13:35:49.947112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 13:35:49.947112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application session.commit() Sep 01 13:35:49.947112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 13:35:49.947112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 13:35:49.947112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 13:35:49.948023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 13:35:49.948023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 13:35:49.948023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self.session.flush() Sep 01 13:35:49.948023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 13:35:49.948023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 13:35:49.948023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 13:35:49.948023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 13:35:49.948023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 13:35:49.948023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application compat.raise_( Sep 01 13:35:49.948023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 13:35:49.948023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception Sep 01 13:35:49.948023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 13:35:49.948023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 13:35:49.948023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 13:35:49.948023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 13:35:49.948023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 13:35:49.948023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 13:35:49.948885 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 13:35:49.948885 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 13:35:49.948885 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 01 13:35:49.948885 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 01 13:35:49.948885 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 13:35:49.948885 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 13:35:49.948885 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 13:35:49.948885 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 13:35:49.948885 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 13:35:49.948885 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 13:35:49.948885 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 13:35:49.948885 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 13:35:49.948885 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 13:35:49.948885 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 13:35:49.948885 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 13:35:49.948885 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception Sep 01 13:35:49.949729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 13:35:49.949729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 13:35:49.949729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 13:35:49.949729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 13:35:49.949729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 13:35:49.949729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 13:35:49.949729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 13:35:49.949729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application conn.query(q) Sep 01 13:35:49.949729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 13:35:49.949729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 13:35:49.949729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 13:35:49.949729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application result.read() Sep 01 13:35:49.949729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 13:35:49.949729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 13:35:49.949729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 13:35:49.949729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 13:35:49.950555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 13:35:49.950555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 13:35:49.950555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 13:35:49.950555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 13:35:49.950555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 13:35:49.950555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 13:35:49.950555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b85d34077eed4f9db2307511c380a918', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 13:35:49.950555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 13:35:49.950555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:49.950555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:35:49.950555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:49.950555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:49.950555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:49.950555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:49.950555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:49.951351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:49.951351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:49.951351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:49.951351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:49.951351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:49.951351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:49.951351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:49.951351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 01 13:35:49.951351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 01 13:35:49.951351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:49.951351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:49.951351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:35:49.951351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:49.951351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:35:49.951351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:49.951351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 01 13:35:49.951351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 01 13:35:49.952607 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 01 13:35:49.952607 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 01 13:35:49.952607 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 13:35:49.952607 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 13:35:49.952607 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 13:35:49.952607 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:49.952607 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 478/957] 10.222.0.50 () {60 vars in 1131 bytes} [Thu Sep 1 13:35:49 2022] POST /identity/v3/users => generated 160 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:49.953692 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57035c2e-dc9f-4672-a4ca-ec5d016bcde4 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:50.063593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57035c2e-dc9f-4672-a4ca-ec5d016bcde4 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:50.099604 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aec18a-88b6-4702-85b5-3e282c37e9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:50.100238 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aec18a-88b6-4702-85b5-3e282c37e9d3 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:50.100501 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aec18a-88b6-4702-85b5-3e282c37e9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:50.100756 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aec18a-88b6-4702-85b5-3e282c37e9d3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:50.108916 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aec18a-88b6-4702-85b5-3e282c37e9d3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:50.110426 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aec18a-88b6-4702-85b5-3e282c37e9d3 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:50.122626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-48aec18a-88b6-4702-85b5-3e282c37e9d3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 13:35:50.122626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:50.122626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:50.122626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:50.122626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:50.122626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:50.122626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:50.122626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:50.122626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:50.122626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:50.122626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:50.122626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:50.122626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:35:50.122626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:35:50.122626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:35:50.122626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:35:50.125812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:50.125812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:50.125812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:35:50.125812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:50.125812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:35:50.125812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:50.125812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:50.125812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:50.125812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:50.125812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:50.125812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:50.125812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:50.125812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:50.125812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:50.125812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:50.125812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:50.125812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:50.125812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:50.128647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:50.128647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:50.128647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:35:50.128647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:35:50.128647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:35:50.128647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:35:50.128647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:35:50.128647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:35:50.128647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 13:35:50.128647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:50.128647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 480/958] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:35:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:50.145360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5d1ea-1b8f-4fbe-b2c6-ac8e46b359c0 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:50.258096 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:50.267804 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5d1ea-1b8f-4fbe-b2c6-ac8e46b359c0 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:50.303681 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c035b-3794-49fe-bec1-92d6917c5f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:50.304333 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c035b-3794-49fe-bec1-92d6917c5f99 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:50.304612 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c035b-3794-49fe-bec1-92d6917c5f99 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:50.304881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c035b-3794-49fe-bec1-92d6917c5f99 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:50.305580 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c035b-3794-49fe-bec1-92d6917c5f99 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:50.305875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c035b-3794-49fe-bec1-92d6917c5f99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:50.307537 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c035b-3794-49fe-bec1-92d6917c5f99 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:50.345679 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 479/959] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Sep 1 13:35:50 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:50.778512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fd6a3-9179-48f1-a654-026ee67b89c8 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:50.778868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fd6a3-9179-48f1-a654-026ee67b89c8 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:50.779077 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fd6a3-9179-48f1-a654-026ee67b89c8 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:50.780435 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 481/960] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:50.785863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c774c0-de59-483e-b123-bd87f4e0f671 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:50.786324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c774c0-de59-483e-b123-bd87f4e0f671 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:50.787134 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c774c0-de59-483e-b123-bd87f4e0f671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:50.805886 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-b2c774c0-de59-483e-b123-bd87f4e0f671 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:50.807557 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b2c774c0-de59-483e-b123-bd87f4e0f671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:50.888943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 480/961] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:35:51.085127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee442d56-7711-4bdd-93ef-894309c06a9f None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:51.085652 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee442d56-7711-4bdd-93ef-894309c06a9f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:51.085652 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee442d56-7711-4bdd-93ef-894309c06a9f None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:51.087090 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 482/962] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:51.092524 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2144a-f1ad-4b72-ae02-4f2c8c29b57c None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:51.092820 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2144a-f1ad-4b72-ae02-4f2c8c29b57c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:51.093097 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2144a-f1ad-4b72-ae02-4f2c8c29b57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:51.112185 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-dcd2144a-f1ad-4b72-ae02-4f2c8c29b57c None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:51.114284 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-dcd2144a-f1ad-4b72-ae02-4f2c8c29b57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:51.150996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee442d56-7711-4bdd-93ef-894309c06a9f None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:51.178353 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:51.206497 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 481/963] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:35:51.259541 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee442d56-7711-4bdd-93ef-894309c06a9f None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:51.296191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8433adb-9f95-46da-8d8d-ca14d3c095e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:51.296797 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8433adb-9f95-46da-8d8d-ca14d3c095e3 None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:51.297080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8433adb-9f95-46da-8d8d-ca14d3c095e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:51.297351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8433adb-9f95-46da-8d8d-ca14d3c095e3 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:51.298016 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8433adb-9f95-46da-8d8d-ca14d3c095e3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:51.299465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8433adb-9f95-46da-8d8d-ca14d3c095e3 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:51.375482 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 483/964] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Sep 1 13:35:51 2022] POST /identity/v3/services => generated 242 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:35:51.495810 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2144a-f1ad-4b72-ae02-4f2c8c29b57c None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:51.507243 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:51.597536 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2144a-f1ad-4b72-ae02-4f2c8c29b57c None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:51.638165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47473347-6a70-424d-aa87-3e6e81cdf64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:51.638752 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47473347-6a70-424d-aa87-3e6e81cdf64a None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:51.639030 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47473347-6a70-424d-aa87-3e6e81cdf64a None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:51.639293 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47473347-6a70-424d-aa87-3e6e81cdf64a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:51.639961 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47473347-6a70-424d-aa87-3e6e81cdf64a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:51.641325 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47473347-6a70-424d-aa87-3e6e81cdf64a None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:51.650151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-47473347-6a70-424d-aa87-3e6e81cdf64a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:35:51.650151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:51.650151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:35:51.650151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:35:51.650151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:35:51.650151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:35:51.650151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:35:51.650151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:51.650151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:35:51.650151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:51.650151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:35:51.650151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:51.650151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:51.650151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:51.650151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:51.650151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:51.650151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:51.651283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:51.651283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:51.651283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:51.651283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:51.651283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:51.651283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:51.651283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:35:51.651283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:35:51.651283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:35:51.651283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:35:51.651283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:51.651283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:51.651283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:51.651283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:51.651283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:51.651283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:51.656391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:51.656391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:51.656391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:51.656391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:51.656391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:51.656391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:51.656391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:51.656391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:51.656391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:51.656391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:51.656391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:35:51.656391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:51.656391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:35:51.656391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:51.656391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 482/965] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Sep 1 13:35:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:51.657640 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8433adb-9f95-46da-8d8d-ca14d3c095e3 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:51.729556 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad2109-740f-403a-8f57-130e1c83e8fa None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:51.730087 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad2109-740f-403a-8f57-130e1c83e8fa None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:51.730355 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad2109-740f-403a-8f57-130e1c83e8fa None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:51.732155 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 483/966] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:51.737016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2c3c3-4fb9-45fb-81fb-480ac4625546 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:51.737297 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2c3c3-4fb9-45fb-81fb-480ac4625546 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:51.737555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2c3c3-4fb9-45fb-81fb-480ac4625546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:51.742726 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:51.756276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-8be2c3c3-4fb9-45fb-81fb-480ac4625546 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:51.757471 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-8be2c3c3-4fb9-45fb-81fb-480ac4625546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:51.763685 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8433adb-9f95-46da-8d8d-ca14d3c095e3 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:51.801424 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3196502-64e1-4221-953c-d45e01e8a830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:51.802066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3196502-64e1-4221-953c-d45e01e8a830 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:51.802679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3196502-64e1-4221-953c-d45e01e8a830 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:51.802962 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3196502-64e1-4221-953c-d45e01e8a830 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:51.803787 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3196502-64e1-4221-953c-d45e01e8a830 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:51.804098 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3196502-64e1-4221-953c-d45e01e8a830 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:51.805488 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3196502-64e1-4221-953c-d45e01e8a830 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:51.810644 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 484/967] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Sep 1 13:35:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:51.816348 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3196502-64e1-4221-953c-d45e01e8a830 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:51.822457 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:51.827969 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 484/968] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:51 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:35:51.928720 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3196502-64e1-4221-953c-d45e01e8a830 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:51.963054 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e2cdc-6633-430f-a4e7-4c8ff91b2e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:51.963721 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e2cdc-6633-430f-a4e7-4c8ff91b2e2d None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:51.964006 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e2cdc-6633-430f-a4e7-4c8ff91b2e2d None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:51.964279 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e2cdc-6633-430f-a4e7-4c8ff91b2e2d None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:51.964907 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e2cdc-6633-430f-a4e7-4c8ff91b2e2d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:51.965209 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e2cdc-6633-430f-a4e7-4c8ff91b2e2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:51.966570 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e2cdc-6633-430f-a4e7-4c8ff91b2e2d None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:51.976072 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 485/969] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Sep 1 13:35:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:35:51.977607 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2c3c3-4fb9-45fb-81fb-480ac4625546 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:52.081301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2c3c3-4fb9-45fb-81fb-480ac4625546 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:52.097473 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e2cdc-6633-430f-a4e7-4c8ff91b2e2d None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:52.112399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:52.122278 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535633b9-1cb6-4f83-9719-171f659b66c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:52.122905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535633b9-1cb6-4f83-9719-171f659b66c2 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:52.123183 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535633b9-1cb6-4f83-9719-171f659b66c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:52.123502 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535633b9-1cb6-4f83-9719-171f659b66c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:52.124304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535633b9-1cb6-4f83-9719-171f659b66c2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:52.125570 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535633b9-1cb6-4f83-9719-171f659b66c2 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:52.201304 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e2cdc-6633-430f-a4e7-4c8ff91b2e2d None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:52.227394 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 485/970] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:35:51 2022] POST /identity/v3/endpoints => generated 349 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:35:52.258743 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe01520-2e3f-45bf-9b5d-a9cf3311dc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:52.259442 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe01520-2e3f-45bf-9b5d-a9cf3311dc84 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:52.259762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe01520-2e3f-45bf-9b5d-a9cf3311dc84 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:52.260034 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe01520-2e3f-45bf-9b5d-a9cf3311dc84 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:52.274212 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe01520-2e3f-45bf-9b5d-a9cf3311dc84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:35:52.279185 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-6fe01520-2e3f-45bf-9b5d-a9cf3311dc84 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 13:35:52.279185 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:52.279185 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:52.279185 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:52.279185 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:52.279185 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:52.279185 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:52.279185 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:52.279185 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:52.279185 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:52.279185 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:52.279185 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:52.279185 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:35:52.279185 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:35:52.279185 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:35:52.279185 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:35:52.280345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:35:52.280345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:35:52.280345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:35:52.280345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:35:52.280345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:52.280345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:52.280345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:52.280345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:52.280345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:52.280345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:52.280345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:52.280345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:52.280345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:52.280345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:52.280345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:52.280345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:52.281177 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:52.281177 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:52.281177 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:52.281177 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:52.281177 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:35:52.281177 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:35:52.281177 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:35:52.281177 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:35:52.281177 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:35:52.281177 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:35:52.281177 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 13:35:52.281177 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:52.283567 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 486/971] 10.222.0.50 () {56 vars in 1120 bytes} [Thu Sep 1 13:35:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:35:52.286910 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535633b9-1cb6-4f83-9719-171f659b66c2 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:52.353434 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:52.403110 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535633b9-1cb6-4f83-9719-171f659b66c2 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:52.437277 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081edff-8ae7-4d69-8f80-8ab6d6c47f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:52.437889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081edff-8ae7-4d69-8f80-8ab6d6c47f8d None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:52.438196 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081edff-8ae7-4d69-8f80-8ab6d6c47f8d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:52.438432 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081edff-8ae7-4d69-8f80-8ab6d6c47f8d None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:52.439092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081edff-8ae7-4d69-8f80-8ab6d6c47f8d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:52.439417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081edff-8ae7-4d69-8f80-8ab6d6c47f8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:52.440785 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081edff-8ae7-4d69-8f80-8ab6d6c47f8d None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:52.449773 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 486/972] 10.222.0.50 () {56 vars in 1115 bytes} [Thu Sep 1 13:35:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:52.455766 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe01520-2e3f-45bf-9b5d-a9cf3311dc84 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:52.531276 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:52.568565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe01520-2e3f-45bf-9b5d-a9cf3311dc84 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:52.602574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe43f0f-b603-4a52-a1d8-87b0d7617d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:52.603345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe43f0f-b603-4a52-a1d8-87b0d7617d36 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:52.603755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe43f0f-b603-4a52-a1d8-87b0d7617d36 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:52.604133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe43f0f-b603-4a52-a1d8-87b0d7617d36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:52.615588 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe43f0f-b603-4a52-a1d8-87b0d7617d36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:52.617144 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe43f0f-b603-4a52-a1d8-87b0d7617d36 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:52.631979 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-7fe43f0f-b603-4a52-a1d8-87b0d7617d36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:52.631979 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:52.631979 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:52.631979 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:52.631979 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:52.631979 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:52.631979 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:52.631979 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:52.631979 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:52.631979 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:52.631979 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:52.631979 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:52.631979 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:52.631979 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:52.631979 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:52.631979 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:52.632973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:52.632973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:52.632973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:52.632973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:52.632973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:52.632973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:52.632973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:52.632973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:52.632973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:52.632973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:52.632973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:52.632973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:52.632973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:52.632973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:52.632973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:52.632973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:52.632973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:52.633852 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:52.633852 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:52.633852 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:52.635441 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 487/973] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:52.639258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081edff-8ae7-4d69-8f80-8ab6d6c47f8d None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:52.743235 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081edff-8ae7-4d69-8f80-8ab6d6c47f8d None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:52.760054 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:52.777833 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4d131-76fc-4099-b1a0-3c4a2285340e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:52.778434 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4d131-76fc-4099-b1a0-3c4a2285340e None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:52.778707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4d131-76fc-4099-b1a0-3c4a2285340e None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:52.778977 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4d131-76fc-4099-b1a0-3c4a2285340e None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:52.779634 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4d131-76fc-4099-b1a0-3c4a2285340e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:52.779932 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4d131-76fc-4099-b1a0-3c4a2285340e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:52.781294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4d131-76fc-4099-b1a0-3c4a2285340e None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:52.797649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 487/974] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:35:52.799171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe43f0f-b603-4a52-a1d8-87b0d7617d36 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:52.912894 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe43f0f-b603-4a52-a1d8-87b0d7617d36 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:52.930561 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:52.948295 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934f07f-58d6-4ce0-8c8a-25c325b02197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:52.948922 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934f07f-58d6-4ce0-8c8a-25c325b02197 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:52.949194 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934f07f-58d6-4ce0-8c8a-25c325b02197 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:52.949462 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934f07f-58d6-4ce0-8c8a-25c325b02197 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:52.957184 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934f07f-58d6-4ce0-8c8a-25c325b02197 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:52.958688 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934f07f-58d6-4ce0-8c8a-25c325b02197 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:52.970646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-0934f07f-58d6-4ce0-8c8a-25c325b02197 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 13:35:52.970646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:52.970646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:52.970646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:52.970646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:52.970646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:52.970646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:52.970646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:52.970646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:52.970646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:52.970646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:52.970646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:52.970646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:35:52.970646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:35:52.970646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:35:52.970646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:35:52.971633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:52.971633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:52.971633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:35:52.971633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:52.971633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:35:52.971633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:35:52.971633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:52.971633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:52.971633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:52.971633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:52.971633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:52.971633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:52.971633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:52.971633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:52.971633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:52.971633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:52.971633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:52.971633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:52.977789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:52.977789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:52.977789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:35:52.977789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:35:52.977789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:35:52.977789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:35:52.977789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:35:52.977789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:35:52.977789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 13:35:52.977789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:52.977789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 488/975] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Sep 1 13:35:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:35:52.978425 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4d131-76fc-4099-b1a0-3c4a2285340e None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:53.081887 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4d131-76fc-4099-b1a0-3c4a2285340e None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:53.117185 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5af61-c557-4b7f-ab07-de98041aca2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:53.117788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5af61-c557-4b7f-ab07-de98041aca2c None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:53.118066 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5af61-c557-4b7f-ab07-de98041aca2c None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:53.118333 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5af61-c557-4b7f-ab07-de98041aca2c None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:53.119051 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5af61-c557-4b7f-ab07-de98041aca2c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:53.119346 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5af61-c557-4b7f-ab07-de98041aca2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:53.120842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5af61-c557-4b7f-ab07-de98041aca2c None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:53.142537 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 488/976] 10.222.0.50 () {56 vars in 1149 bytes} [Thu Sep 1 13:35:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:35:53.144115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934f07f-58d6-4ce0-8c8a-25c325b02197 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:53.248406 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934f07f-58d6-4ce0-8c8a-25c325b02197 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:53.282828 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e7afb-5ccd-4c99-97fc-e052546820f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:53.283458 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e7afb-5ccd-4c99-97fc-e052546820f3 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:53.283736 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e7afb-5ccd-4c99-97fc-e052546820f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:53.284011 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e7afb-5ccd-4c99-97fc-e052546820f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:53.335555 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:53.340562 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d43b47-647c-412b-baf6-4b945e66afd3 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:53.340850 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d43b47-647c-412b-baf6-4b945e66afd3 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:53.341122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d43b47-647c-412b-baf6-4b945e66afd3 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:53.342468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 489/977] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:53.347654 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f2881-cdb7-4923-96a5-28ec57d758c8 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:53.347955 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f2881-cdb7-4923-96a5-28ec57d758c8 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:53.348221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f2881-cdb7-4923-96a5-28ec57d758c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:53.360222 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e7afb-5ccd-4c99-97fc-e052546820f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:53.361664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e7afb-5ccd-4c99-97fc-e052546820f3 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:53.367330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-7c2f2881-cdb7-4923-96a5-28ec57d758c8 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:53.368554 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-7c2f2881-cdb7-4923-96a5-28ec57d758c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:53.396948 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:53.437754 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 490/978] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:53 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:35:53.475502 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 489/979] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:35:53 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 13:35:53.476865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f2881-cdb7-4923-96a5-28ec57d758c8 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:53.607994 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f2881-cdb7-4923-96a5-28ec57d758c8 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:53.665175 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e9b6b-497e-4da8-887b-553160772802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:53.666218 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e9b6b-497e-4da8-887b-553160772802 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:53.666700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e9b6b-497e-4da8-887b-553160772802 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:53.667179 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e9b6b-497e-4da8-887b-553160772802 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:53.684267 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e9b6b-497e-4da8-887b-553160772802 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:53.686915 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e9b6b-497e-4da8-887b-553160772802 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:53.708112 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e7afb-5ccd-4c99-97fc-e052546820f3 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:53.714417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-906e9b6b-497e-4da8-887b-553160772802 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:53.714417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:53.714417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:53.714417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:53.714417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:53.714417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:53.714417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:53.714417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:53.714417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:53.714417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:53.714417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:53.714417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:53.714417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:35:53.714417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:35:53.714417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:35:53.714417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:35:53.715338 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:53.715338 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:53.715338 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:53.715338 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:53.715338 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:53.715338 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:53.715338 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:53.715338 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:53.715338 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:53.715338 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:53.715338 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:53.715338 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:53.715338 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:53.715338 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:53.715338 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:53.715338 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:53.715338 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:35:53.716246 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:35:53.716246 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:35:53.716246 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:53.721375 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 491/980] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:53.722158 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e9b6b-497e-4da8-887b-553160772802 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:53.743192 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:53.791693 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:53.814538 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e7afb-5ccd-4c99-97fc-e052546820f3 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:53.835405 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e9b6b-497e-4da8-887b-553160772802 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:53.859579 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf2749-c28d-496e-b0c2-be8d42104b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:53.860144 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf2749-c28d-496e-b0c2-be8d42104b34 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:53.860425 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf2749-c28d-496e-b0c2-be8d42104b34 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:53.860698 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf2749-c28d-496e-b0c2-be8d42104b34 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:53.861279 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf2749-c28d-496e-b0c2-be8d42104b34 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:53.862646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf2749-c28d-496e-b0c2-be8d42104b34 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:53.871633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-dbcf2749-c28d-496e-b0c2-be8d42104b34 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 13:35:53.871633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:53.871633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:35:53.871633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:35:53.871633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:35:53.871633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:35:53.871633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:35:53.871633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:53.871633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 13:35:53.871633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:53.871633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:35:53.871633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:53.871633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:53.871633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:53.871633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:53.871633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:53.871633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:53.872789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:53.872789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:53.872789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:53.872789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:53.872789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:53.872789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:53.872789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:35:53.872789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:35:53.872789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:35:53.872789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:35:53.872789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:53.872789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:53.872789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:53.872789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:53.872789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:53.872789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:53.873799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:53.873799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:53.873799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:53.873799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:53.873799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:53.873799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:53.873799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:53.873799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:53.873799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:53.873799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:53.873799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:35:53.873799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:53.873799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 13:35:53.873799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:53.877544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 490/981] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:35:53.877846 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b3d01-4701-4268-abcf-6b19cf65b482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:53.878489 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf2749-c28d-496e-b0c2-be8d42104b34 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:53.878800 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b3d01-4701-4268-abcf-6b19cf65b482 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:53.879227 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b3d01-4701-4268-abcf-6b19cf65b482 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:53.879529 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b3d01-4701-4268-abcf-6b19cf65b482 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:53.880724 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b3d01-4701-4268-abcf-6b19cf65b482 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:53.881020 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b3d01-4701-4268-abcf-6b19cf65b482 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:53.882384 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b3d01-4701-4268-abcf-6b19cf65b482 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:53.894848 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 492/982] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:35:53.901409 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b3d01-4701-4268-abcf-6b19cf65b482 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:53.979583 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:54.004257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b3d01-4701-4268-abcf-6b19cf65b482 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:54.004600 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf2749-c28d-496e-b0c2-be8d42104b34 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:54.040757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f3907-3ac4-4f63-bbf6-03b18e7438a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:54.041388 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f3907-3ac4-4f63-bbf6-03b18e7438a1 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:54.041671 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f3907-3ac4-4f63-bbf6-03b18e7438a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:54.041951 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f3907-3ac4-4f63-bbf6-03b18e7438a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:54.043287 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ba99e-bfc3-45d2-9ba2-c7c9bac6c6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:54.043920 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ba99e-bfc3-45d2-9ba2-c7c9bac6c6ef None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:54.044202 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ba99e-bfc3-45d2-9ba2-c7c9bac6c6ef None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:54.044474 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ba99e-bfc3-45d2-9ba2-c7c9bac6c6ef None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:54.045101 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ba99e-bfc3-45d2-9ba2-c7c9bac6c6ef None admin] RBAC: Adding query filter params (name=compute) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:54.045402 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ba99e-bfc3-45d2-9ba2-c7c9bac6c6ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:54.046765 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ba99e-bfc3-45d2-9ba2-c7c9bac6c6ef None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:54.048962 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f3907-3ac4-4f63-bbf6-03b18e7438a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:54.050426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f3907-3ac4-4f63-bbf6-03b18e7438a1 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:54.051852 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 491/983] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Sep 1 13:35:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:35:54.057403 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ba99e-bfc3-45d2-9ba2-c7c9bac6c6ef None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:54.062182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-237f3907-3ac4-4f63-bbf6-03b18e7438a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:54.062182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:54.062182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:54.062182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:54.062182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:54.062182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:54.062182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:54.062182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:54.062182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:54.062182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:54.062182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:54.062182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:54.062182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:35:54.062182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:35:54.062182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:35:54.063153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:35:54.063153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:54.063153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:54.063153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:54.063153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:54.063153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:54.063153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:54.063153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:54.063153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:54.063153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:54.063153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:54.063153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:54.063153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:54.063153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:54.063153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:54.063153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:54.063153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:54.069532 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:35:54.069532 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:35:54.069532 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:35:54.069532 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:35:54.069532 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:35:54.069532 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:35:54.069532 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:35:54.069532 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:54.069532 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 493/984] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:35:54.070022 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f3907-3ac4-4f63-bbf6-03b18e7438a1 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:54.070804 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:54.164490 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ba99e-bfc3-45d2-9ba2-c7c9bac6c6ef None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:54.178249 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f3907-3ac4-4f63-bbf6-03b18e7438a1 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:54.205703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35686f-59d2-4e20-82b2-86d058aed906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:54.206315 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35686f-59d2-4e20-82b2-86d058aed906 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:54.206717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35686f-59d2-4e20-82b2-86d058aed906 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:54.206999 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35686f-59d2-4e20-82b2-86d058aed906 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:54.207782 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35686f-59d2-4e20-82b2-86d058aed906 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:54.208087 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35686f-59d2-4e20-82b2-86d058aed906 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:54.209509 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35686f-59d2-4e20-82b2-86d058aed906 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:54.215239 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 492/985] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Sep 1 13:35:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:35:54.215533 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119890cb-5fa1-4528-add4-9077027f332a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:54.216101 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119890cb-5fa1-4528-add4-9077027f332a None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:54.216441 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119890cb-5fa1-4528-add4-9077027f332a None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:54.216602 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52a2e8-2d0f-476e-9e1b-c08ffd40d9ef None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:54.216711 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119890cb-5fa1-4528-add4-9077027f332a None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:54.216910 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52a2e8-2d0f-476e-9e1b-c08ffd40d9ef None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:54.217121 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52a2e8-2d0f-476e-9e1b-c08ffd40d9ef None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:54.217394 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119890cb-5fa1-4528-add4-9077027f332a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:54.217699 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119890cb-5fa1-4528-add4-9077027f332a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:54.222369 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 493/986] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:54.222536 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119890cb-5fa1-4528-add4-9077027f332a None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:54.222639 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52a2e8-2d0f-476e-9e1b-c08ffd40d9ef None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:54.224283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:54.235339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 494/987] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:35:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:54.236578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51090b-218d-4f3c-a24d-2c923c7225e0 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:54.236884 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51090b-218d-4f3c-a24d-2c923c7225e0 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:54.237131 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51090b-218d-4f3c-a24d-2c923c7225e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:54.256641 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-5a51090b-218d-4f3c-a24d-2c923c7225e0 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:54.258534 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-5a51090b-218d-4f3c-a24d-2c923c7225e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:54.292850 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:54.326320 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 495/988] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:54 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:35:54.327180 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51090b-218d-4f3c-a24d-2c923c7225e0 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:54.328325 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52a2e8-2d0f-476e-9e1b-c08ffd40d9ef None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:54.366154 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1bce9-0ada-4f38-8986-4c5d8294728e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:54.366781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1bce9-0ada-4f38-8986-4c5d8294728e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:54.367065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1bce9-0ada-4f38-8986-4c5d8294728e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:54.367726 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1bce9-0ada-4f38-8986-4c5d8294728e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:54.368059 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1bce9-0ada-4f38-8986-4c5d8294728e None admin] RBAC: Adding query filter params (interface=public, service_id=1ab6c8a97c5d4042a0f9364d30690f10, region_id=RegionOne) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:54.368423 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1bce9-0ada-4f38-8986-4c5d8294728e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:54.369726 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1bce9-0ada-4f38-8986-4c5d8294728e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:54.374786 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 494/989] 10.222.0.50 () {56 vars in 1251 bytes} [Thu Sep 1 13:35:54 2022] GET /identity/v3/endpoints?service_id=1ab6c8a97c5d4042a0f9364d30690f10&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:54.381058 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1bce9-0ada-4f38-8986-4c5d8294728e None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:54.440185 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51090b-218d-4f3c-a24d-2c923c7225e0 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:54.465978 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:54.475722 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0ccf2-025c-458b-9e20-217e917c257b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:54.476334 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0ccf2-025c-458b-9e20-217e917c257b None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:54.478970 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0ccf2-025c-458b-9e20-217e917c257b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:54.478970 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0ccf2-025c-458b-9e20-217e917c257b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:54.478970 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0ccf2-025c-458b-9e20-217e917c257b None admin] RBAC: Adding query filter params (role.id=802471bc911e46a6b7ad1f122b1a9e9e, scope.project.id=6283121e17814cd792df9d0edf81bf2d, user.id=6f01578bf21244a5ac357e54979ffc0d) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:54.478970 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0ccf2-025c-458b-9e20-217e917c257b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:54.479535 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0ccf2-025c-458b-9e20-217e917c257b None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:54.485540 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 496/990] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:35:54 2022] GET /identity/v3/role_assignments?user.id=6f01578bf21244a5ac357e54979ffc0d&scope.project.id=6283121e17814cd792df9d0edf81bf2d&role.id=802471bc911e46a6b7ad1f122b1a9e9e => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:54.506302 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1bce9-0ada-4f38-8986-4c5d8294728e None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:54.544425 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e29b5e-dde9-4b2d-94e3-6a6d0b09a665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:54.545046 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e29b5e-dde9-4b2d-94e3-6a6d0b09a665 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:54.545324 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e29b5e-dde9-4b2d-94e3-6a6d0b09a665 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:54.545597 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e29b5e-dde9-4b2d-94e3-6a6d0b09a665 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:54.546221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e29b5e-dde9-4b2d-94e3-6a6d0b09a665 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:54.547636 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e29b5e-dde9-4b2d-94e3-6a6d0b09a665 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:54.548940 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:54.556256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 495/991] 10.222.0.50 () {56 vars in 1087 bytes} [Thu Sep 1 13:35:54 2022] GET /identity/v3/services => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 13:35:54.593189 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0ccf2-025c-458b-9e20-217e917c257b None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:54.709261 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0ccf2-025c-458b-9e20-217e917c257b None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:54.745339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42015c-f05a-4755-b90d-ffb0ac1fa9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:54.745970 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42015c-f05a-4755-b90d-ffb0ac1fa9e1 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:54.746248 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42015c-f05a-4755-b90d-ffb0ac1fa9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:54.746521 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42015c-f05a-4755-b90d-ffb0ac1fa9e1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:54.747102 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42015c-f05a-4755-b90d-ffb0ac1fa9e1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:54.748515 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42015c-f05a-4755-b90d-ffb0ac1fa9e1 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:54.757598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-0b42015c-f05a-4755-b90d-ffb0ac1fa9e1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:35:54.757598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:54.757598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:35:54.757598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:35:54.757598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:35:54.757598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:35:54.757598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:35:54.757598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:54.757598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:35:54.757598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:54.757598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:35:54.757598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:54.757598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:54.757598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:54.757598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:54.757598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:54.757598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:54.758788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:54.758788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:54.758788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:54.758788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:54.758788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:54.758788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:54.758788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:35:54.758788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:35:54.758788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:35:54.758788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:35:54.758788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:54.758788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:54.758788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:54.758788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:54.758788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:54.758788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:54.759757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:54.759757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:54.759757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:54.759757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:54.759757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:54.759757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:54.759757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:54.759757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:54.759757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:54.759757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:54.759757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:35:54.759757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:54.759757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:35:54.759757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:54.759757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 497/992] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Sep 1 13:35:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:54.764580 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e29b5e-dde9-4b2d-94e3-6a6d0b09a665 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:54.871706 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e29b5e-dde9-4b2d-94e3-6a6d0b09a665 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:54.906795 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d9a7d-6a39-4485-b437-152c61e33d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:54.907725 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d9a7d-6a39-4485-b437-152c61e33d17 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:54.908174 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d9a7d-6a39-4485-b437-152c61e33d17 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:54.908587 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d9a7d-6a39-4485-b437-152c61e33d17 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:54.909353 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d9a7d-6a39-4485-b437-152c61e33d17 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:54.909818 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d9a7d-6a39-4485-b437-152c61e33d17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:54.911350 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d9a7d-6a39-4485-b437-152c61e33d17 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:54.918792 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 496/993] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Sep 1 13:35:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:54.924104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42015c-f05a-4755-b90d-ffb0ac1fa9e1 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:54.995190 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:55.051423 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42015c-f05a-4755-b90d-ffb0ac1fa9e1 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:55.088534 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2a24a-abca-4110-b640-23d3f1c7f480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:55.089141 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2a24a-abca-4110-b640-23d3f1c7f480 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:55.089416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2a24a-abca-4110-b640-23d3f1c7f480 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:55.089684 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2a24a-abca-4110-b640-23d3f1c7f480 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:55.090312 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2a24a-abca-4110-b640-23d3f1c7f480 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:55.090610 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2a24a-abca-4110-b640-23d3f1c7f480 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:55.092105 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2a24a-abca-4110-b640-23d3f1c7f480 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:55.097803 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 498/994] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Sep 1 13:35:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:55.104921 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d9a7d-6a39-4485-b437-152c61e33d17 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:55.190823 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:55.233139 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d9a7d-6a39-4485-b437-152c61e33d17 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:55.266185 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514447d7-b955-4222-b1ae-a50f26f9071b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:55.266717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514447d7-b955-4222-b1ae-a50f26f9071b None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:55.266992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514447d7-b955-4222-b1ae-a50f26f9071b None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:55.267261 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514447d7-b955-4222-b1ae-a50f26f9071b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:55.267992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514447d7-b955-4222-b1ae-a50f26f9071b None admin] RBAC: Adding query filter params (interface=admin, service_id=3dafb6b239104a5c8b06a3c68d86d5c9, region_id=RegionOne) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:55.268299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514447d7-b955-4222-b1ae-a50f26f9071b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:55.269644 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514447d7-b955-4222-b1ae-a50f26f9071b None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:55.275389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 497/995] 10.222.0.50 () {56 vars in 1249 bytes} [Thu Sep 1 13:35:55 2022] GET /identity/v3/endpoints?service_id=3dafb6b239104a5c8b06a3c68d86d5c9&interface=admin®ion_id=RegionOne => generated 193 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:35:55.280785 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2a24a-abca-4110-b640-23d3f1c7f480 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:55.383689 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2a24a-abca-4110-b640-23d3f1c7f480 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:55.401778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:55.418849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95664c-1d19-4e23-9ebe-782c27f3bfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:55.419517 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95664c-1d19-4e23-9ebe-782c27f3bfc8 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:55.419800 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95664c-1d19-4e23-9ebe-782c27f3bfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:55.420076 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95664c-1d19-4e23-9ebe-782c27f3bfc8 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:55.420685 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95664c-1d19-4e23-9ebe-782c27f3bfc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:55.422053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95664c-1d19-4e23-9ebe-782c27f3bfc8 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:55.435660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 499/996] 10.222.0.50 () {56 vars in 1087 bytes} [Thu Sep 1 13:35:55 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 13:35:56.460325 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5e345-3b97-447e-9709-4e6101212e7c None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:56.460887 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5e345-3b97-447e-9709-4e6101212e7c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:56.460887 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5e345-3b97-447e-9709-4e6101212e7c None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:56.462346 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 498/997] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:56.467405 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fb768-60ea-4864-b81a-3114bd67ff65 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:56.467825 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fb768-60ea-4864-b81a-3114bd67ff65 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:56.468006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fb768-60ea-4864-b81a-3114bd67ff65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:56.486803 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-381fb768-60ea-4864-b81a-3114bd67ff65 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:56.488016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-381fb768-60ea-4864-b81a-3114bd67ff65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:56.506498 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341305e-ead3-45cb-b904-6fb377d07fbe None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:56.506835 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341305e-ead3-45cb-b904-6fb377d07fbe None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:56.507056 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341305e-ead3-45cb-b904-6fb377d07fbe None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:56.508559 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 499/998] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:35:56.514099 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5dd03-ceaf-4683-a715-8feceb3a7fac None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:56.514390 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5dd03-ceaf-4683-a715-8feceb3a7fac None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:56.514669 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5dd03-ceaf-4683-a715-8feceb3a7fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:56.534024 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-88d5dd03-ceaf-4683-a715-8feceb3a7fac None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:56.535208 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-88d5dd03-ceaf-4683-a715-8feceb3a7fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:56.562005 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 500/999] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:35:56.604562 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 500/1000] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:35:56.828024 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fb768-60ea-4864-b81a-3114bd67ff65 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:56.873915 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5dd03-ceaf-4683-a715-8feceb3a7fac None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:56.936724 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:56.943213 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fb768-60ea-4864-b81a-3114bd67ff65 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:56.959737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:56.983264 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f28eb-d0d1-4ab7-ac4c-f451d58ffb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:56.983935 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f28eb-d0d1-4ab7-ac4c-f451d58ffb70 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:56.984209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f28eb-d0d1-4ab7-ac4c-f451d58ffb70 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:56.984480 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f28eb-d0d1-4ab7-ac4c-f451d58ffb70 None admin] PATH_INFO: `/v3/services/image` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:56.985063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f28eb-d0d1-4ab7-ac4c-f451d58ffb70 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:56.985602 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5dd03-ceaf-4683-a715-8feceb3a7fac None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:56.986438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f28eb-d0d1-4ab7-ac4c-f451d58ffb70 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:56.997118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-535f28eb-d0d1-4ab7-ac4c-f451d58ffb70 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 13:35:56.997118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:56.997118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:35:56.997118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:35:56.997118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:35:56.997118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:35:56.997118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:35:56.997118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:56.997118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 13:35:56.997118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:56.997118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:35:56.997118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:56.997118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:56.997118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:56.997118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:56.997118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:56.997118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:56.998172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:56.998172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:56.998172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:56.998172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:56.998172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:56.998172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:56.998172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:35:56.998172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:35:56.998172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:35:56.998172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:35:56.998172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:56.998172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:56.998172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:56.998172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:56.998172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:56.998172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:56.999011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:56.999011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:56.999011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:56.999011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:56.999011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:56.999011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:56.999011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:56.999011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:56.999011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:56.999011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:56.999011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:35:56.999011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:56.999011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 13:35:56.999011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:57.006661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 501/1001] 10.222.0.50 () {56 vars in 1105 bytes} [Thu Sep 1 13:35:56 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:57.007636 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f28eb-d0d1-4ab7-ac4c-f451d58ffb70 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:57.025222 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561b037-88ec-4785-b04e-68fdbbf3e465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:57.025953 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561b037-88ec-4785-b04e-68fdbbf3e465 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:57.026312 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561b037-88ec-4785-b04e-68fdbbf3e465 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:57.026593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561b037-88ec-4785-b04e-68fdbbf3e465 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:57.027188 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561b037-88ec-4785-b04e-68fdbbf3e465 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:57.028590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561b037-88ec-4785-b04e-68fdbbf3e465 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:57.038299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-5561b037-88ec-4785-b04e-68fdbbf3e465 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 13:35:57.038299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:57.038299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:35:57.038299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:35:57.038299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:35:57.038299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:35:57.038299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:35:57.038299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:57.038299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 13:35:57.038299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:57.038299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:35:57.038299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:57.038299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:57.038299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:57.038299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:57.038299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:57.038299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:57.039336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:57.039336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:57.039336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:57.039336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:57.039336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:57.039336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:57.039336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:35:57.039336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:35:57.039336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:35:57.039336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:35:57.039336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:57.039336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:57.039336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:57.039336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:57.039336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:57.039336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:57.040182 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:57.040182 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:57.040182 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:57.040182 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:57.040182 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:57.040182 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:57.040182 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:57.040182 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:57.040182 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:57.040182 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:57.040182 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:35:57.040182 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:57.040182 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 13:35:57.040182 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:35:57.040182 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 501/1002] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:35:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:35:57.045211 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561b037-88ec-4785-b04e-68fdbbf3e465 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:57.118777 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f28eb-d0d1-4ab7-ac4c-f451d58ffb70 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:57.151669 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561b037-88ec-4785-b04e-68fdbbf3e465 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:57.155133 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d37a23-e94b-451d-9bf6-4900852ac5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:57.155824 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d37a23-e94b-451d-9bf6-4900852ac5a2 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:57.156104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d37a23-e94b-451d-9bf6-4900852ac5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:57.156373 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d37a23-e94b-451d-9bf6-4900852ac5a2 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:57.157001 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d37a23-e94b-451d-9bf6-4900852ac5a2 None admin] RBAC: Adding query filter params (name=image) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:57.157302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d37a23-e94b-451d-9bf6-4900852ac5a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:57.158720 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d37a23-e94b-451d-9bf6-4900852ac5a2 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:57.164428 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 502/1003] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:57.170004 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d37a23-e94b-451d-9bf6-4900852ac5a2 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:57.174498 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:57.188292 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36167ac-091f-4fc2-bbed-71b711467ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:57.189151 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36167ac-091f-4fc2-bbed-71b711467ef1 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:57.189474 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36167ac-091f-4fc2-bbed-71b711467ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:57.189782 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36167ac-091f-4fc2-bbed-71b711467ef1 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:57.190445 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36167ac-091f-4fc2-bbed-71b711467ef1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:57.190802 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36167ac-091f-4fc2-bbed-71b711467ef1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:57.192205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36167ac-091f-4fc2-bbed-71b711467ef1 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:57.198452 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 502/1004] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Sep 1 13:35:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:35:57.203120 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36167ac-091f-4fc2-bbed-71b711467ef1 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:57.222126 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:57.283848 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d37a23-e94b-451d-9bf6-4900852ac5a2 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:57.322815 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5912133-cc80-4f48-a0d1-db3b2aab143c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:57.323501 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5912133-cc80-4f48-a0d1-db3b2aab143c None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:57.323783 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5912133-cc80-4f48-a0d1-db3b2aab143c None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:57.324235 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5912133-cc80-4f48-a0d1-db3b2aab143c None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:57.324700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5912133-cc80-4f48-a0d1-db3b2aab143c None admin] RBAC: Adding query filter params (type=image) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:57.325002 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5912133-cc80-4f48-a0d1-db3b2aab143c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:57.326368 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5912133-cc80-4f48-a0d1-db3b2aab143c None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:57.330648 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36167ac-091f-4fc2-bbed-71b711467ef1 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:57.339401 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 503/1005] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:35:57 2022] GET /identity/v3/services?type=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:35:57.352598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da0fcf-4f01-4ec3-95bc-35835a60754d None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:57.352933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da0fcf-4f01-4ec3-95bc-35835a60754d None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:57.353159 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da0fcf-4f01-4ec3-95bc-35835a60754d None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:57.354724 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 504/1006] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:35:57.360687 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f852d-940e-4ff5-90bb-55ddc50a944f None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:57.360995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f852d-940e-4ff5-90bb-55ddc50a944f None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:57.361282 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f852d-940e-4ff5-90bb-55ddc50a944f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:57.380674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-f01f852d-940e-4ff5-90bb-55ddc50a944f None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:57.381834 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-f01f852d-940e-4ff5-90bb-55ddc50a944f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:57.382994 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34582b08-4140-4fc2-8fc5-2ba5ccc52a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:57.383911 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34582b08-4140-4fc2-8fc5-2ba5ccc52a12 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:57.384351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34582b08-4140-4fc2-8fc5-2ba5ccc52a12 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:57.384776 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34582b08-4140-4fc2-8fc5-2ba5ccc52a12 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:57.385602 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34582b08-4140-4fc2-8fc5-2ba5ccc52a12 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:57.386071 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34582b08-4140-4fc2-8fc5-2ba5ccc52a12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:57.387535 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34582b08-4140-4fc2-8fc5-2ba5ccc52a12 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:57.393501 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 503/1007] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Sep 1 13:35:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:57.400079 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34582b08-4140-4fc2-8fc5-2ba5ccc52a12 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:57.456615 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:57.464693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 505/1008] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:57 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:35:57.515611 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34582b08-4140-4fc2-8fc5-2ba5ccc52a12 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:57.550529 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313070a-5226-4f5c-8ade-8dd27b0e30a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:57.551135 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313070a-5226-4f5c-8ade-8dd27b0e30a7 None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:57.551437 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313070a-5226-4f5c-8ade-8dd27b0e30a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:57.551749 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313070a-5226-4f5c-8ade-8dd27b0e30a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:57.552424 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313070a-5226-4f5c-8ade-8dd27b0e30a7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:57.553785 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313070a-5226-4f5c-8ade-8dd27b0e30a7 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:57.660215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 504/1009] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:35:57 2022] POST /identity/v3/endpoints => generated 334 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:35:57.741942 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f852d-940e-4ff5-90bb-55ddc50a944f None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:57.781423 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:57.856022 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f852d-940e-4ff5-90bb-55ddc50a944f None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:57.899757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129388fb-2c27-4208-9698-5650e226ca06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:57.900423 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129388fb-2c27-4208-9698-5650e226ca06 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:57.900703 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129388fb-2c27-4208-9698-5650e226ca06 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:57.900974 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129388fb-2c27-4208-9698-5650e226ca06 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:57.901555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129388fb-2c27-4208-9698-5650e226ca06 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:57.902928 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129388fb-2c27-4208-9698-5650e226ca06 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:57.912055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-129388fb-2c27-4208-9698-5650e226ca06 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:35:57.912055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:57.912055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:35:57.912055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:35:57.912055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:35:57.912055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:35:57.912055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:35:57.912055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:57.912055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:35:57.912055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:57.912055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:35:57.912055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:57.912055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:35:57.912055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:35:57.912055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:35:57.912055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:35:57.912055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:35:57.913080 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:35:57.913080 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:35:57.913080 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:35:57.913080 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:35:57.913080 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:35:57.913080 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:35:57.913080 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:35:57.913080 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:35:57.913080 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:35:57.913080 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:35:57.913080 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:35:57.913080 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:35:57.913080 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:35:57.913080 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:35:57.913080 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:35:57.913080 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:35:57.913905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:35:57.913905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:35:57.913905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:35:57.913905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:35:57.913905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:35:57.913905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:35:57.913905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:35:57.913905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:35:57.913905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:35:57.913905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:35:57.913905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:35:57.913905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:35:57.913905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:35:57.913905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:35:57.913905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 506/1010] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Sep 1 13:35:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:35:57.919183 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313070a-5226-4f5c-8ade-8dd27b0e30a7 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:58.025311 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313070a-5226-4f5c-8ade-8dd27b0e30a7 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:58.027704 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:58.060249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de093fab-ac1d-4cbe-9016-7e18aa94ea20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:58.060859 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de093fab-ac1d-4cbe-9016-7e18aa94ea20 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:58.061147 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de093fab-ac1d-4cbe-9016-7e18aa94ea20 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:58.061422 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de093fab-ac1d-4cbe-9016-7e18aa94ea20 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:58.062060 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de093fab-ac1d-4cbe-9016-7e18aa94ea20 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:58.062365 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de093fab-ac1d-4cbe-9016-7e18aa94ea20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:58.063785 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de093fab-ac1d-4cbe-9016-7e18aa94ea20 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:58.069108 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 505/1011] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Sep 1 13:35:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:58.074771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129388fb-2c27-4208-9698-5650e226ca06 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:58.175246 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:58.182381 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129388fb-2c27-4208-9698-5650e226ca06 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:58.218275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2319d-d26d-4abd-87fe-0fddf3eb283f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:58.218885 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2319d-d26d-4abd-87fe-0fddf3eb283f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:58.219166 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2319d-d26d-4abd-87fe-0fddf3eb283f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:58.219465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2319d-d26d-4abd-87fe-0fddf3eb283f None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:58.220098 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2319d-d26d-4abd-87fe-0fddf3eb283f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:35:58.220400 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2319d-d26d-4abd-87fe-0fddf3eb283f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:58.221776 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2319d-d26d-4abd-87fe-0fddf3eb283f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:58.232310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 507/1012] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Sep 1 13:35:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:35:58.233572 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de093fab-ac1d-4cbe-9016-7e18aa94ea20 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:58.339222 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de093fab-ac1d-4cbe-9016-7e18aa94ea20 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:58.374727 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6363b0a-3a29-4355-846f-5b0d6887011d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:58.375390 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6363b0a-3a29-4355-846f-5b0d6887011d None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:58.375672 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6363b0a-3a29-4355-846f-5b0d6887011d None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:58.375947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6363b0a-3a29-4355-846f-5b0d6887011d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:58.376615 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6363b0a-3a29-4355-846f-5b0d6887011d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:58.377976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6363b0a-3a29-4355-846f-5b0d6887011d None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:58.457008 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 506/1013] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:35:58 2022] POST /identity/v3/endpoints => generated 325 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:35:59.276102 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46daede-7b5c-4243-9dcc-f25cf5de98ba None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:59.276745 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46daede-7b5c-4243-9dcc-f25cf5de98ba None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:59.276745 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46daede-7b5c-4243-9dcc-f25cf5de98ba None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:59.278138 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 508/1014] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:35:59.283257 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa541e-f123-40ef-b904-ab47f8508377 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:59.283746 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa541e-f123-40ef-b904-ab47f8508377 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:59.283822 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa541e-f123-40ef-b904-ab47f8508377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:59.302052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-34aa541e-f123-40ef-b904-ab47f8508377 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:59.303240 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-34aa541e-f123-40ef-b904-ab47f8508377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:59.327215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:35:59.378615 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 507/1015] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:59 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:35:59.645977 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46daede-7b5c-4243-9dcc-f25cf5de98ba None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:35:59.732417 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb5097-06ab-4c15-aa6b-8f75e9dd9994 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:59.732748 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb5097-06ab-4c15-aa6b-8f75e9dd9994 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:59.732960 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb5097-06ab-4c15-aa6b-8f75e9dd9994 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:59.734428 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 508/1016] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:35:59.740707 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd052eea-ea70-4d55-afd2-2571f8342089 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:59.741025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd052eea-ea70-4d55-afd2-2571f8342089 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:59.741304 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd052eea-ea70-4d55-afd2-2571f8342089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:59.751558 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46daede-7b5c-4243-9dcc-f25cf5de98ba None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:35:59.759234 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-fd052eea-ea70-4d55-afd2-2571f8342089 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:35:59.760456 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-fd052eea-ea70-4d55-afd2-2571f8342089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:35:59.788674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee4c60-5301-4573-a669-12de8a64751a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:35:59.789346 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee4c60-5301-4573-a669-12de8a64751a None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:35:59.789618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee4c60-5301-4573-a669-12de8a64751a None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:35:59.789822 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee4c60-5301-4573-a669-12de8a64751a None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:35:59.790514 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee4c60-5301-4573-a669-12de8a64751a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:35:59.791939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee4c60-5301-4573-a669-12de8a64751a None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:35:59.842375 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 509/1017] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:35:59 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:35:59.911539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 509/1018] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Sep 1 13:35:59 2022] POST /identity/v3/services => generated 242 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:36:00.115912 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd052eea-ea70-4d55-afd2-2571f8342089 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:00.202068 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:00.219456 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd052eea-ea70-4d55-afd2-2571f8342089 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:00.261156 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294bb5a-f247-4372-9914-5f6dacabb3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:00.261791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294bb5a-f247-4372-9914-5f6dacabb3c4 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:00.262071 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294bb5a-f247-4372-9914-5f6dacabb3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:00.262340 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294bb5a-f247-4372-9914-5f6dacabb3c4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:00.273073 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294bb5a-f247-4372-9914-5f6dacabb3c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:36:00.277820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-4294bb5a-f247-4372-9914-5f6dacabb3c4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 13:36:00.277820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:00.277820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:36:00.277820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:36:00.277820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:36:00.277820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:36:00.277820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:36:00.277820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:36:00.277820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:36:00.277820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:36:00.277820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:36:00.277820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:36:00.277820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:36:00.277820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:36:00.277820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:36:00.277820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:36:00.278713 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:36:00.278713 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:36:00.278713 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:36:00.278713 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:36:00.278713 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:36:00.278713 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:36:00.278713 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:36:00.278713 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:36:00.278713 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:36:00.278713 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:36:00.278713 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:36:00.278713 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:36:00.278713 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:36:00.278713 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:36:00.278713 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:36:00.278713 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:36:00.284956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:36:00.284956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:36:00.284956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:36:00.284956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:36:00.284956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:36:00.284956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:36:00.284956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:36:00.284956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:36:00.284956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:36:00.284956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:36:00.284956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 13:36:00.284956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:36:00.284956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 510/1019] 10.222.0.50 () {56 vars in 1120 bytes} [Thu Sep 1 13:36:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:36:00.287504 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee4c60-5301-4573-a669-12de8a64751a None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:00.307856 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:00.386750 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bf504-5b3c-4cdc-a270-d26508d14e22 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:00.387032 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bf504-5b3c-4cdc-a270-d26508d14e22 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:00.387304 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bf504-5b3c-4cdc-a270-d26508d14e22 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:00.389752 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 511/1020] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:36:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:36:00.394961 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4357516-cca5-44b5-b1b1-3cf7223d7e08 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:00.395794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4357516-cca5-44b5-b1b1-3cf7223d7e08 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:00.396072 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4357516-cca5-44b5-b1b1-3cf7223d7e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:00.402122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee4c60-5301-4573-a669-12de8a64751a None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:00.414960 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-f4357516-cca5-44b5-b1b1-3cf7223d7e08 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:36:00.416467 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-f4357516-cca5-44b5-b1b1-3cf7223d7e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:36:00.440766 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9884dd-a8cd-480d-9943-6cff83f7203b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:00.441389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9884dd-a8cd-480d-9943-6cff83f7203b None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:00.441670 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9884dd-a8cd-480d-9943-6cff83f7203b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:00.441943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9884dd-a8cd-480d-9943-6cff83f7203b None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:00.443134 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9884dd-a8cd-480d-9943-6cff83f7203b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:00.443473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9884dd-a8cd-480d-9943-6cff83f7203b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:00.444851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9884dd-a8cd-480d-9943-6cff83f7203b None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:00.453654 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 510/1021] 10.222.0.50 () {56 vars in 1115 bytes} [Thu Sep 1 13:36:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:36:00.460395 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9884dd-a8cd-480d-9943-6cff83f7203b None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:00.491035 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 512/1022] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:36:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:36:00.545685 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:00.564036 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9884dd-a8cd-480d-9943-6cff83f7203b None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:00.598726 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d76425-6e05-48bc-a7c7-b4e6d9cb16a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:00.599344 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d76425-6e05-48bc-a7c7-b4e6d9cb16a1 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:00.599647 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d76425-6e05-48bc-a7c7-b4e6d9cb16a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:00.599916 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d76425-6e05-48bc-a7c7-b4e6d9cb16a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:00.610004 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d76425-6e05-48bc-a7c7-b4e6d9cb16a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:00.611459 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d76425-6e05-48bc-a7c7-b4e6d9cb16a1 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:00.625680 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-34d76425-6e05-48bc-a7c7-b4e6d9cb16a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:36:00.625680 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:00.625680 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:36:00.625680 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:36:00.625680 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:36:00.625680 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:36:00.625680 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:36:00.625680 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:36:00.625680 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:36:00.625680 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:36:00.625680 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:36:00.625680 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:36:00.625680 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:36:00.625680 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:36:00.625680 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:36:00.625680 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:36:00.626608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:36:00.626608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:36:00.626608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:36:00.626608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:36:00.626608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:36:00.626608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:36:00.626608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:36:00.626608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:36:00.626608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:36:00.626608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:36:00.626608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:36:00.626608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:36:00.626608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:36:00.626608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:36:00.626608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:36:00.626608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:36:00.626608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:36:00.627535 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:36:00.627535 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:36:00.627535 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:36:00.627535 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 511/1023] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:36:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:36:00.633243 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4357516-cca5-44b5-b1b1-3cf7223d7e08 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:00.702754 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:00.732894 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4357516-cca5-44b5-b1b1-3cf7223d7e08 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:00.760612 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d76425-6e05-48bc-a7c7-b4e6d9cb16a1 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:00.768436 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044bfdf-ab1b-45cd-b213-d1e3dc3240ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:00.769050 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044bfdf-ab1b-45cd-b213-d1e3dc3240ae None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:00.769327 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044bfdf-ab1b-45cd-b213-d1e3dc3240ae None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:00.770010 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044bfdf-ab1b-45cd-b213-d1e3dc3240ae None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:00.770761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044bfdf-ab1b-45cd-b213-d1e3dc3240ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:00.771062 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044bfdf-ab1b-45cd-b213-d1e3dc3240ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:00.772812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044bfdf-ab1b-45cd-b213-d1e3dc3240ae None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:00.790351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 513/1024] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:36:00.792062 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044bfdf-ab1b-45cd-b213-d1e3dc3240ae None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:00.878104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d76425-6e05-48bc-a7c7-b4e6d9cb16a1 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:00.899946 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044bfdf-ab1b-45cd-b213-d1e3dc3240ae None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:00.909225 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:00.914628 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e7098-5fa4-4a36-a9f6-7159c5ed4c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:00.920340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e7098-5fa4-4a36-a9f6-7159c5ed4c06 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:00.920340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e7098-5fa4-4a36-a9f6-7159c5ed4c06 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:00.920340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e7098-5fa4-4a36-a9f6-7159c5ed4c06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:00.920340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e7098-5fa4-4a36-a9f6-7159c5ed4c06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:00.920340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e7098-5fa4-4a36-a9f6-7159c5ed4c06 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:00.920340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 512/1025] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:36:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:36:00.926218 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e7098-5fa4-4a36-a9f6-7159c5ed4c06 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:00.934778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:00.941436 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe0ef3-8fce-4fab-bb04-ab649e6bc047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:00.941853 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe0ef3-8fce-4fab-bb04-ab649e6bc047 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:00.942207 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe0ef3-8fce-4fab-bb04-ab649e6bc047 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:00.942992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe0ef3-8fce-4fab-bb04-ab649e6bc047 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:00.951079 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe0ef3-8fce-4fab-bb04-ab649e6bc047 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:00.954921 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe0ef3-8fce-4fab-bb04-ab649e6bc047 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:00.965229 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-63fe0ef3-8fce-4fab-bb04-ab649e6bc047 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:36:00.965229 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:00.965229 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:36:00.965229 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:36:00.965229 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:36:00.965229 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:36:00.965229 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:36:00.965229 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:36:00.965229 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:36:00.965229 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:36:00.965229 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:36:00.965229 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:36:00.965229 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:36:00.965229 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:36:00.965229 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:36:00.965229 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:36:00.966219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:36:00.966219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:36:00.966219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:36:00.966219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:36:00.966219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:36:00.966219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:36:00.966219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:36:00.966219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:36:00.966219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:36:00.966219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:36:00.966219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:36:00.966219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:36:00.966219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:36:00.966219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:36:00.966219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:36:00.966219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:36:00.966219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:36:00.966219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:36:00.967140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:36:00.967140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:36:00.967140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:36:00.967140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:36:00.967140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:36:00.967140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:36:00.967140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:36:00.967140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:36:00.967140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:36:00.967140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:36:00.967140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 514/1026] 10.222.0.50 () {56 vars in 1093 bytes} [Thu Sep 1 13:36:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:36:00.972422 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe0ef3-8fce-4fab-bb04-ab649e6bc047 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:01.046039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e7098-5fa4-4a36-a9f6-7159c5ed4c06 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:01.076968 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe0ef3-8fce-4fab-bb04-ab649e6bc047 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:01.082028 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1cdcae-5f0e-4fcb-b62d-6c1afda5dd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:01.082672 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cdcae-5f0e-4fcb-b62d-6c1afda5dd36 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:01.083127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cdcae-5f0e-4fcb-b62d-6c1afda5dd36 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:01.083427 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cdcae-5f0e-4fcb-b62d-6c1afda5dd36 None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:01.084111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1cdcae-5f0e-4fcb-b62d-6c1afda5dd36 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:01.085659 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1cdcae-5f0e-4fcb-b62d-6c1afda5dd36 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:01.111214 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98a800-ad35-458a-b93e-8fc0725d3bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:01.111844 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98a800-ad35-458a-b93e-8fc0725d3bd0 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:01.112122 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98a800-ad35-458a-b93e-8fc0725d3bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:01.112389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98a800-ad35-458a-b93e-8fc0725d3bd0 None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:01.113104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98a800-ad35-458a-b93e-8fc0725d3bd0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:01.113404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98a800-ad35-458a-b93e-8fc0725d3bd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:01.115337 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98a800-ad35-458a-b93e-8fc0725d3bd0 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:01.132853 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 515/1027] 10.222.0.50 () {56 vars in 1133 bytes} [Thu Sep 1 13:36:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:36:01.138420 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98a800-ad35-458a-b93e-8fc0725d3bd0 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:01.185832 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 513/1028] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Sep 1 13:36:00 2022] POST /identity/v3/projects => generated 311 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:36:01.196588 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:01.256275 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98a800-ad35-458a-b93e-8fc0725d3bd0 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:01.293893 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd18614-19db-456c-a651-ed8256d7870c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:01.294538 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd18614-19db-456c-a651-ed8256d7870c None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:01.294781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd18614-19db-456c-a651-ed8256d7870c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:01.295059 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd18614-19db-456c-a651-ed8256d7870c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:01.372187 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd18614-19db-456c-a651-ed8256d7870c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:01.373687 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd18614-19db-456c-a651-ed8256d7870c None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:01.425102 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:01.479182 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 516/1029] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:36:01 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 13:36:01.485136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1cdcae-5f0e-4fcb-b62d-6c1afda5dd36 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:01.539909 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:01.589078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1cdcae-5f0e-4fcb-b62d-6c1afda5dd36 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:01.625475 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20677cb5-e9d2-472a-a21f-a16a82920b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:01.626027 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20677cb5-e9d2-472a-a21f-a16a82920b82 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:01.626308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20677cb5-e9d2-472a-a21f-a16a82920b82 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:01.626579 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20677cb5-e9d2-472a-a21f-a16a82920b82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:01.637440 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20677cb5-e9d2-472a-a21f-a16a82920b82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:01.638895 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20677cb5-e9d2-472a-a21f-a16a82920b82 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:01.653776 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-20677cb5-e9d2-472a-a21f-a16a82920b82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:36:01.653776 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:01.653776 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:36:01.653776 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:36:01.653776 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:36:01.653776 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:36:01.653776 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:36:01.653776 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:36:01.653776 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:36:01.653776 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:36:01.653776 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:36:01.653776 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:36:01.653776 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:36:01.653776 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:36:01.653776 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:36:01.653776 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:36:01.654738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:36:01.654738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:36:01.654738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:36:01.654738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:36:01.654738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:36:01.654738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:36:01.654738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:36:01.654738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:36:01.654738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:36:01.654738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:36:01.654738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:36:01.654738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:36:01.654738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:36:01.654738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:36:01.654738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:36:01.654738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:36:01.654738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:36:01.655679 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:36:01.655679 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:36:01.655679 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:36:01.659619 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 514/1030] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:36:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:36:01.660605 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd18614-19db-456c-a651-ed8256d7870c None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:01.765883 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd18614-19db-456c-a651-ed8256d7870c None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:01.799200 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52326523-9b3a-4ad0-a87e-d662b14c6403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:01.799839 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52326523-9b3a-4ad0-a87e-d662b14c6403 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:01.800119 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52326523-9b3a-4ad0-a87e-d662b14c6403 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:01.800389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52326523-9b3a-4ad0-a87e-d662b14c6403 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:01.801024 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52326523-9b3a-4ad0-a87e-d662b14c6403 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:01.801834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52326523-9b3a-4ad0-a87e-d662b14c6403 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:01.803228 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52326523-9b3a-4ad0-a87e-d662b14c6403 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:01.814467 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 517/1031] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:36:01.820852 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20677cb5-e9d2-472a-a21f-a16a82920b82 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:01.845809 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67089925-9413-4cae-a54b-523a905f250f None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:01.846095 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67089925-9413-4cae-a54b-523a905f250f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:01.846376 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67089925-9413-4cae-a54b-523a905f250f None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:01.847993 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 518/1032] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:36:01.853516 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f04a8-2aab-4a4f-ad4e-cbf9473f2ef9 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:01.853788 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f04a8-2aab-4a4f-ad4e-cbf9473f2ef9 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:01.854061 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f04a8-2aab-4a4f-ad4e-cbf9473f2ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:01.872849 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-1d2f04a8-2aab-4a4f-ad4e-cbf9473f2ef9 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:36:01.874028 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-1d2f04a8-2aab-4a4f-ad4e-cbf9473f2ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:36:01.876392 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:01.931912 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20677cb5-e9d2-472a-a21f-a16a82920b82 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:01.934293 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:01.951816 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 519/1033] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:36:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:36:01.972865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf4dd2-7701-4a09-89c0-437b7cb0a93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:01.973497 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf4dd2-7701-4a09-89c0-437b7cb0a93f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:01.973778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf4dd2-7701-4a09-89c0-437b7cb0a93f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:01.974054 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf4dd2-7701-4a09-89c0-437b7cb0a93f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:01.981183 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf4dd2-7701-4a09-89c0-437b7cb0a93f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:01.982626 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf4dd2-7701-4a09-89c0-437b7cb0a93f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:01.994686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-f7bf4dd2-7701-4a09-89c0-437b7cb0a93f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:36:01.994686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:01.994686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:36:01.994686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:36:01.994686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:36:01.994686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:36:01.994686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:36:01.994686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:36:01.994686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:36:01.994686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:36:01.994686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:36:01.994686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:36:01.994686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:36:01.994686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:36:01.994686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:36:01.995653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:36:01.995653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:36:01.995653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:36:01.995653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:36:01.995653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:36:01.995653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:36:01.995653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:36:01.995653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:36:01.995653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:36:01.995653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:36:01.995653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:36:01.995653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:36:01.995653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:36:01.995653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:36:01.995653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:36:01.995653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:36:01.995653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:36:01.996550 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:36:01.996550 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:36:01.996550 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:36:01.996550 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:36:01.996550 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:36:01.996550 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:36:01.996550 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:36:01.996550 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:36:01.996550 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 515/1034] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:36:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:36:02.001842 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f04a8-2aab-4a4f-ad4e-cbf9473f2ef9 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:02.101876 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f04a8-2aab-4a4f-ad4e-cbf9473f2ef9 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:02.137413 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fbd05-de83-46a9-85b7-c29d39bc001c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:02.137949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fbd05-de83-46a9-85b7-c29d39bc001c None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:02.138229 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fbd05-de83-46a9-85b7-c29d39bc001c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:02.138500 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fbd05-de83-46a9-85b7-c29d39bc001c None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:02.139190 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fbd05-de83-46a9-85b7-c29d39bc001c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:02.139527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fbd05-de83-46a9-85b7-c29d39bc001c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:02.140954 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fbd05-de83-46a9-85b7-c29d39bc001c None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:02.148388 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:02.159101 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 520/1035] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:36:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:36:02.160574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf4dd2-7701-4a09-89c0-437b7cb0a93f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:02.226923 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fbd05-de83-46a9-85b7-c29d39bc001c None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:02.266894 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf4dd2-7701-4a09-89c0-437b7cb0a93f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:02.303256 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8ec8c-2642-46dc-80f4-6fb4e9516e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:02.303893 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8ec8c-2642-46dc-80f4-6fb4e9516e3d None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:02.304180 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8ec8c-2642-46dc-80f4-6fb4e9516e3d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:02.304453 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8ec8c-2642-46dc-80f4-6fb4e9516e3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:02.305182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8ec8c-2642-46dc-80f4-6fb4e9516e3d None admin] RBAC: Adding query filter params (role.id=802471bc911e46a6b7ad1f122b1a9e9e, scope.project.id=6283121e17814cd792df9d0edf81bf2d, user.id=2d231136bcd44d9a97efe6c257f936ed) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:02.305492 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8ec8c-2642-46dc-80f4-6fb4e9516e3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:02.306942 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8ec8c-2642-46dc-80f4-6fb4e9516e3d None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:02.312805 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 516/1036] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:36:02 2022] GET /identity/v3/role_assignments?user.id=2d231136bcd44d9a97efe6c257f936ed&scope.project.id=6283121e17814cd792df9d0edf81bf2d&role.id=802471bc911e46a6b7ad1f122b1a9e9e => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:02.353040 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fbd05-de83-46a9-85b7-c29d39bc001c None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:02.391732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157241a7-fe23-412a-91b7-16b2582c8da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:02.392297 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157241a7-fe23-412a-91b7-16b2582c8da5 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:02.392575 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157241a7-fe23-412a-91b7-16b2582c8da5 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:02.392840 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157241a7-fe23-412a-91b7-16b2582c8da5 None admin] PATH_INFO: `/v3/services/image` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:02.393429 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157241a7-fe23-412a-91b7-16b2582c8da5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:02.394851 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157241a7-fe23-412a-91b7-16b2582c8da5 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:02.404490 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-157241a7-fe23-412a-91b7-16b2582c8da5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 13:36:02.404490 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:02.404490 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:36:02.404490 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:36:02.404490 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:36:02.404490 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:36:02.404490 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:36:02.404490 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:36:02.404490 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 13:36:02.404490 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:36:02.404490 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:36:02.404490 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:36:02.404490 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:02.404490 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:36:02.404490 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:36:02.404490 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:36:02.404490 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:36:02.405565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:36:02.405565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:36:02.405565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:36:02.405565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:36:02.405565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:36:02.405565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:36:02.405565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:36:02.405565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:36:02.405565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:36:02.405565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:36:02.405565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:36:02.405565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:36:02.405565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:36:02.405565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:36:02.405565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:36:02.405565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:36:02.406393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:36:02.406393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:36:02.406393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:36:02.406393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:36:02.406393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:36:02.406393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:36:02.406393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:36:02.406393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:36:02.406393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:36:02.406393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:36:02.406393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:36:02.406393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:36:02.406393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 13:36:02.406393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:36:02.406393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 521/1037] 10.222.0.50 () {56 vars in 1105 bytes} [Thu Sep 1 13:36:02 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:36:02.411721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8ec8c-2642-46dc-80f4-6fb4e9516e3d None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:02.445950 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:02.520500 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8ec8c-2642-46dc-80f4-6fb4e9516e3d None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:02.554661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916712b-28d3-4a1c-8fd2-67191c2a6ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:02.555266 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916712b-28d3-4a1c-8fd2-67191c2a6ad5 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:02.555570 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916712b-28d3-4a1c-8fd2-67191c2a6ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:02.555840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916712b-28d3-4a1c-8fd2-67191c2a6ad5 None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:02.556460 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916712b-28d3-4a1c-8fd2-67191c2a6ad5 None admin] RBAC: Adding query filter params (name=image) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:02.556757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916712b-28d3-4a1c-8fd2-67191c2a6ad5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:02.558128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916712b-28d3-4a1c-8fd2-67191c2a6ad5 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:02.567571 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 517/1038] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:36:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:36:02.569796 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157241a7-fe23-412a-91b7-16b2582c8da5 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:02.633477 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:02.673261 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157241a7-fe23-412a-91b7-16b2582c8da5 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:02.707983 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9d043-0848-4948-ac3b-3678ca0306f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:02.708590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9d043-0848-4948-ac3b-3678ca0306f0 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:02.708865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9d043-0848-4948-ac3b-3678ca0306f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:02.709136 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9d043-0848-4948-ac3b-3678ca0306f0 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:02.709761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9d043-0848-4948-ac3b-3678ca0306f0 None admin] RBAC: Adding query filter params (type=image) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:02.710057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9d043-0848-4948-ac3b-3678ca0306f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:02.711438 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9d043-0848-4948-ac3b-3678ca0306f0 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:02.721296 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 522/1039] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:36:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:02.722631 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916712b-28d3-4a1c-8fd2-67191c2a6ad5 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:02.820544 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:02.829678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916712b-28d3-4a1c-8fd2-67191c2a6ad5 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:02.870970 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c1842-c9b1-4647-b4c4-0c104b5c6bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:02.871620 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c1842-c9b1-4647-b4c4-0c104b5c6bf5 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:02.871904 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c1842-c9b1-4647-b4c4-0c104b5c6bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:02.872177 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c1842-c9b1-4647-b4c4-0c104b5c6bf5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:02.872881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c1842-c9b1-4647-b4c4-0c104b5c6bf5 None admin] RBAC: Adding query filter params (interface=public, service_id=bee73f0c09b34d1db87f8cedb8c7d5c4, region_id=RegionOne) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:02.873189 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c1842-c9b1-4647-b4c4-0c104b5c6bf5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:02.874580 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c1842-c9b1-4647-b4c4-0c104b5c6bf5 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:02.884626 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 518/1040] 10.222.0.50 () {56 vars in 1251 bytes} [Thu Sep 1 13:36:02 2022] GET /identity/v3/endpoints?service_id=bee73f0c09b34d1db87f8cedb8c7d5c4&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:02.885937 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9d043-0848-4948-ac3b-3678ca0306f0 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:02.999548 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9d043-0848-4948-ac3b-3678ca0306f0 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:03.028373 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:03.038264 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4ac4f-c688-4a06-a804-0b4be40a08a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:03.041027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4ac4f-c688-4a06-a804-0b4be40a08a2 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:03.041027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4ac4f-c688-4a06-a804-0b4be40a08a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:03.041027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4ac4f-c688-4a06-a804-0b4be40a08a2 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:03.041027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4ac4f-c688-4a06-a804-0b4be40a08a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:03.041504 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4ac4f-c688-4a06-a804-0b4be40a08a2 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:03.055405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 523/1041] 10.222.0.50 () {56 vars in 1087 bytes} [Thu Sep 1 13:36:02 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:36:03.190733 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93f00c-eb16-4be7-957f-b74dbb94cfcc None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:03.191018 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93f00c-eb16-4be7-957f-b74dbb94cfcc None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:03.191294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93f00c-eb16-4be7-957f-b74dbb94cfcc None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:03.192738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 519/1042] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:36:03.198204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858bcdb-18b3-4087-8c99-d750e295664f None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:03.198492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858bcdb-18b3-4087-8c99-d750e295664f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:03.198771 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858bcdb-18b3-4087-8c99-d750e295664f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:03.218046 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-7858bcdb-18b3-4087-8c99-d750e295664f None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:36:03.219241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-7858bcdb-18b3-4087-8c99-d750e295664f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:36:03.293677 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 524/1043] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:36:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:36:03.562031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93f00c-eb16-4be7-957f-b74dbb94cfcc None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:03.667126 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93f00c-eb16-4be7-957f-b74dbb94cfcc None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:03.701533 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61f9c3-bcdc-4827-99ac-a9034adb6895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:03.702166 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61f9c3-bcdc-4827-99ac-a9034adb6895 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:03.702445 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61f9c3-bcdc-4827-99ac-a9034adb6895 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:03.702715 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61f9c3-bcdc-4827-99ac-a9034adb6895 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:03.703866 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61f9c3-bcdc-4827-99ac-a9034adb6895 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:03.705305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61f9c3-bcdc-4827-99ac-a9034adb6895 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:03.707058 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 520/1044] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:36:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:03.713302 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858bcdb-18b3-4087-8c99-d750e295664f None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:03.814460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858bcdb-18b3-4087-8c99-d750e295664f None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:03.837441 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:03.857540 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fabee94-bdfe-4512-9da7-04596e8871ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:03.858154 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabee94-bdfe-4512-9da7-04596e8871ca None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:03.860564 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabee94-bdfe-4512-9da7-04596e8871ca None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:03.860564 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabee94-bdfe-4512-9da7-04596e8871ca None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:03.860564 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fabee94-bdfe-4512-9da7-04596e8871ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:03.860952 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fabee94-bdfe-4512-9da7-04596e8871ca None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:03.964495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 525/1045] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 1 13:36:03 2022] POST /identity/v3/users => generated 285 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:36:04.213904 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc1756-deec-4ad9-b4ee-504ce28c1ac3 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:04.214255 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc1756-deec-4ad9-b4ee-504ce28c1ac3 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:04.214363 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc1756-deec-4ad9-b4ee-504ce28c1ac3 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:04.215889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 521/1046] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:36:04.220985 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011830a8-0102-4ba5-adfe-b610824d0762 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:04.221272 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011830a8-0102-4ba5-adfe-b610824d0762 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:04.221543 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011830a8-0102-4ba5-adfe-b610824d0762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:04.240247 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-011830a8-0102-4ba5-adfe-b610824d0762 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:36:04.241422 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-011830a8-0102-4ba5-adfe-b610824d0762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:36:04.309337 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 526/1047] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:36:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:36:04.576727 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc1756-deec-4ad9-b4ee-504ce28c1ac3 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:04.603228 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:04.682186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc1756-deec-4ad9-b4ee-504ce28c1ac3 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:04.716599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a037b2b-4bf0-4c8f-b036-7746a7a46f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:04.717219 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a037b2b-4bf0-4c8f-b036-7746a7a46f56 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:04.717494 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a037b2b-4bf0-4c8f-b036-7746a7a46f56 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:04.717762 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a037b2b-4bf0-4c8f-b036-7746a7a46f56 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:04.727996 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a037b2b-4bf0-4c8f-b036-7746a7a46f56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:36:04.733006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-1a037b2b-4bf0-4c8f-b036-7746a7a46f56 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 13:36:04.733006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:04.733006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:36:04.733006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:36:04.733006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:36:04.733006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:36:04.733006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:36:04.733006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:36:04.733006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:36:04.733006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:36:04.733006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:36:04.733006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:36:04.733006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:36:04.733006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:36:04.733006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:36:04.733006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:36:04.733949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:36:04.733949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:36:04.733949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:36:04.733949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:36:04.733949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:36:04.733949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:36:04.733949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:36:04.733949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:36:04.733949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:36:04.733949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:36:04.733949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:36:04.733949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:36:04.733949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:36:04.733949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:36:04.733949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:36:04.733949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:36:04.734790 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:36:04.734790 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:36:04.734790 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:36:04.734790 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:36:04.734790 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:36:04.734790 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:36:04.734790 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:36:04.734790 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:36:04.734790 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:36:04.734790 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:36:04.734790 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 13:36:04.734790 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:36:04.739271 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 522/1048] 10.222.0.50 () {56 vars in 1120 bytes} [Thu Sep 1 13:36:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:36:04.740800 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011830a8-0102-4ba5-adfe-b610824d0762 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:04.847412 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011830a8-0102-4ba5-adfe-b610824d0762 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:04.855731 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:04.883121 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be0370-b319-44dc-b1f2-ba6d38ca3897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:04.883753 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be0370-b319-44dc-b1f2-ba6d38ca3897 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:04.884030 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be0370-b319-44dc-b1f2-ba6d38ca3897 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:04.884299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be0370-b319-44dc-b1f2-ba6d38ca3897 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:04.884958 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be0370-b319-44dc-b1f2-ba6d38ca3897 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:04.885256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be0370-b319-44dc-b1f2-ba6d38ca3897 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:04.886672 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be0370-b319-44dc-b1f2-ba6d38ca3897 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:04.899432 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 527/1049] 10.222.0.50 () {56 vars in 1115 bytes} [Thu Sep 1 13:36:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:04.901535 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a037b2b-4bf0-4c8f-b036-7746a7a46f56 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:04.963045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa066a-1965-4f19-bdda-f45603e75e74 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:04.963415 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa066a-1965-4f19-bdda-f45603e75e74 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:04.963697 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa066a-1965-4f19-bdda-f45603e75e74 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:04.965027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 528/1050] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:36:04.969771 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646dfa9-d14d-49a6-b3e3-9712e441b2d6 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:04.970060 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646dfa9-d14d-49a6-b3e3-9712e441b2d6 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:04.970342 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646dfa9-d14d-49a6-b3e3-9712e441b2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:04.988803 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-5646dfa9-d14d-49a6-b3e3-9712e441b2d6 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:36:04.989989 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-5646dfa9-d14d-49a6-b3e3-9712e441b2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:36:04.996563 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:05.018273 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a037b2b-4bf0-4c8f-b036-7746a7a46f56 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:05.060393 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fa360-e87e-4efa-bfe8-afbbfcb06855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:05.061177 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fa360-e87e-4efa-bfe8-afbbfcb06855 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:05.061459 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fa360-e87e-4efa-bfe8-afbbfcb06855 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:05.062042 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fa360-e87e-4efa-bfe8-afbbfcb06855 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:05.071859 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 529/1051] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:36:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:36:05.073788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fa360-e87e-4efa-bfe8-afbbfcb06855 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:05.075272 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fa360-e87e-4efa-bfe8-afbbfcb06855 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:05.092503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-657fa360-e87e-4efa-bfe8-afbbfcb06855 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:36:05.092503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:05.092503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:36:05.092503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:36:05.092503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:36:05.092503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:36:05.092503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:36:05.092503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:36:05.092503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:36:05.092503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:36:05.092503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:36:05.092503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:36:05.092503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:36:05.092503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:36:05.092503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:36:05.092503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:36:05.093491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:36:05.093491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:36:05.093491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:36:05.093491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:36:05.093491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:36:05.093491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:36:05.093491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:36:05.093491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:36:05.093491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:36:05.093491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:36:05.093491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:36:05.093491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:36:05.093491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:36:05.093491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:36:05.093491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:36:05.093491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:36:05.093491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:36:05.094387 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:36:05.094387 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:36:05.094387 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:36:05.095194 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 523/1052] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:36:05.100078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646dfa9-d14d-49a6-b3e3-9712e441b2d6 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:05.202079 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:05.206304 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646dfa9-d14d-49a6-b3e3-9712e441b2d6 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:05.241080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ccd95-c1c8-4fe4-b3d5-72729f1cd5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:05.241688 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ccd95-c1c8-4fe4-b3d5-72729f1cd5fe None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:05.241971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ccd95-c1c8-4fe4-b3d5-72729f1cd5fe None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:05.242244 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ccd95-c1c8-4fe4-b3d5-72729f1cd5fe None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:05.242883 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ccd95-c1c8-4fe4-b3d5-72729f1cd5fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:05.243186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ccd95-c1c8-4fe4-b3d5-72729f1cd5fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:05.244577 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ccd95-c1c8-4fe4-b3d5-72729f1cd5fe None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:05.256146 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 530/1053] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:05.261555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fa360-e87e-4efa-bfe8-afbbfcb06855 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:05.338518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ccd95-c1c8-4fe4-b3d5-72729f1cd5fe None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:05.365581 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fa360-e87e-4efa-bfe8-afbbfcb06855 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:05.400497 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c58c5-5e3d-4632-8371-7c1e4dcbe4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:05.401131 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c58c5-5e3d-4632-8371-7c1e4dcbe4a4 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:05.401414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c58c5-5e3d-4632-8371-7c1e4dcbe4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:05.401688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c58c5-5e3d-4632-8371-7c1e4dcbe4a4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:05.404543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:05.410282 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c58c5-5e3d-4632-8371-7c1e4dcbe4a4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:05.412428 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c58c5-5e3d-4632-8371-7c1e4dcbe4a4 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:05.424339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-aa0c58c5-5e3d-4632-8371-7c1e4dcbe4a4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:36:05.424339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:05.424339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:36:05.424339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:36:05.424339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:36:05.424339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:36:05.424339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:36:05.424339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:36:05.424339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:36:05.424339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:36:05.424339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:36:05.424339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:36:05.424339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:36:05.424339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:36:05.424339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:36:05.424339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:36:05.425599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:36:05.425599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:36:05.425599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:36:05.425599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:36:05.425599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:36:05.425599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:36:05.425599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:36:05.425599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:36:05.425599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:36:05.425599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:36:05.425599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:36:05.425599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:36:05.425599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:36:05.425599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:36:05.425599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:36:05.425599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:36:05.425599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:36:05.425599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:36:05.426967 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:36:05.426967 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:36:05.426967 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:36:05.426967 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:36:05.426967 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:36:05.426967 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:36:05.426967 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:36:05.426967 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:36:05.426967 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:36:05.426967 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:36:05.426967 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 524/1054] 10.222.0.50 () {56 vars in 1093 bytes} [Thu Sep 1 13:36:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:36:05.431220 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c58c5-5e3d-4632-8371-7c1e4dcbe4a4 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:05.448515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ccd95-c1c8-4fe4-b3d5-72729f1cd5fe None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:05.487332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7cddd-1d08-4dfa-83b9-8d689e1bf223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:05.487977 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7cddd-1d08-4dfa-83b9-8d689e1bf223 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:05.488254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7cddd-1d08-4dfa-83b9-8d689e1bf223 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:05.488527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7cddd-1d08-4dfa-83b9-8d689e1bf223 None admin] PATH_INFO: `/v3/services/image` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:05.489628 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7cddd-1d08-4dfa-83b9-8d689e1bf223 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:05.491064 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7cddd-1d08-4dfa-83b9-8d689e1bf223 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:05.500612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-3cc7cddd-1d08-4dfa-83b9-8d689e1bf223 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 13:36:05.500612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:05.500612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:36:05.500612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:36:05.500612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:36:05.500612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:36:05.500612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:36:05.500612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:36:05.500612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 13:36:05.500612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:36:05.500612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:36:05.500612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:36:05.500612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:05.500612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:36:05.500612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:36:05.500612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:36:05.500612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:36:05.501584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:36:05.501584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:36:05.501584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:36:05.501584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:36:05.501584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:36:05.501584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:36:05.501584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:36:05.501584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:36:05.501584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:36:05.501584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:36:05.501584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:36:05.501584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:36:05.501584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:36:05.501584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:36:05.501584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:36:05.501584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:36:05.502409 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:36:05.502409 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:36:05.502409 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:36:05.502409 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:36:05.502409 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:36:05.502409 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:36:05.502409 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:36:05.502409 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:36:05.502409 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:36:05.502409 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:36:05.502409 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:36:05.502409 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:36:05.502409 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 13:36:05.502409 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:36:05.506732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 531/1055] 10.222.0.50 () {56 vars in 1105 bytes} [Thu Sep 1 13:36:05 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:36:05.507596 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7cddd-1d08-4dfa-83b9-8d689e1bf223 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:05.533536 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:05.542420 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c58c5-5e3d-4632-8371-7c1e4dcbe4a4 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:05.578151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3ca41-6014-424c-91c1-40c2e772c896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:05.578913 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3ca41-6014-424c-91c1-40c2e772c896 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:05.579140 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3ca41-6014-424c-91c1-40c2e772c896 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:05.579435 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3ca41-6014-424c-91c1-40c2e772c896 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:05.580161 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3ca41-6014-424c-91c1-40c2e772c896 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:05.580577 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3ca41-6014-424c-91c1-40c2e772c896 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:05.582009 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3ca41-6014-424c-91c1-40c2e772c896 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:05.607177 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 525/1056] 10.222.0.50 () {56 vars in 1133 bytes} [Thu Sep 1 13:36:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:36:05.608501 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3ca41-6014-424c-91c1-40c2e772c896 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:05.617850 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7cddd-1d08-4dfa-83b9-8d689e1bf223 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:05.653025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08529d-0727-4322-9deb-975fd0c8c0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:05.653623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08529d-0727-4322-9deb-975fd0c8c0b1 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:05.653905 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08529d-0727-4322-9deb-975fd0c8c0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:05.654179 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08529d-0727-4322-9deb-975fd0c8c0b1 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:05.654809 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08529d-0727-4322-9deb-975fd0c8c0b1 None admin] RBAC: Adding query filter params (name=image) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:05.655111 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08529d-0727-4322-9deb-975fd0c8c0b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:05.656512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08529d-0727-4322-9deb-975fd0c8c0b1 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:05.661506 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 532/1057] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:36:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:05.667153 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08529d-0727-4322-9deb-975fd0c8c0b1 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:05.669116 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:05.718351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3ca41-6014-424c-91c1-40c2e772c896 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:05.758050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfeb82e-179a-4fe1-b14a-d44cc2547460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:05.758330 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:05.758826 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfeb82e-179a-4fe1-b14a-d44cc2547460 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:05.758934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfeb82e-179a-4fe1-b14a-d44cc2547460 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:05.759201 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfeb82e-179a-4fe1-b14a-d44cc2547460 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:05.771069 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfeb82e-179a-4fe1-b14a-d44cc2547460 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:05.773777 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfeb82e-179a-4fe1-b14a-d44cc2547460 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:05.774110 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08529d-0727-4322-9deb-975fd0c8c0b1 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:05.788385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-9cfeb82e-179a-4fe1-b14a-d44cc2547460 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:36:05.788385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:05.788385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:36:05.788385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:36:05.788385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:36:05.788385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:36:05.788385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:36:05.788385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:36:05.788385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:36:05.788385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:36:05.788385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:36:05.788385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:36:05.788385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:36:05.788385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:36:05.788385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:36:05.788385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:36:05.789383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:36:05.789383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:36:05.789383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:36:05.789383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:36:05.789383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:36:05.789383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:36:05.789383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:36:05.789383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:36:05.789383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:36:05.789383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:36:05.789383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:36:05.789383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:36:05.789383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:36:05.789383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:36:05.789383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:36:05.789383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:36:05.789383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:36:05.790287 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:36:05.790287 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:36:05.790287 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:36:05.790287 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 526/1058] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:36:05.795136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfeb82e-179a-4fe1-b14a-d44cc2547460 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:05.813177 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10b5e7-f3b1-493b-beb6-d58d489e2c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:05.813794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10b5e7-f3b1-493b-beb6-d58d489e2c0d None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:05.814073 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10b5e7-f3b1-493b-beb6-d58d489e2c0d None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:05.814344 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10b5e7-f3b1-493b-beb6-d58d489e2c0d None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:05.814975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10b5e7-f3b1-493b-beb6-d58d489e2c0d None admin] RBAC: Adding query filter params (type=image) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:05.815277 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10b5e7-f3b1-493b-beb6-d58d489e2c0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:05.817248 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10b5e7-f3b1-493b-beb6-d58d489e2c0d None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:05.822674 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 533/1059] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:36:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:05.828131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10b5e7-f3b1-493b-beb6-d58d489e2c0d None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:05.918659 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfeb82e-179a-4fe1-b14a-d44cc2547460 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:05.927054 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:05.936662 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10b5e7-f3b1-493b-beb6-d58d489e2c0d None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:05.955032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689bf9b-1be9-4398-ac37-b4cff500f9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:05.955667 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689bf9b-1be9-4398-ac37-b4cff500f9a5 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:05.955999 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689bf9b-1be9-4398-ac37-b4cff500f9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:05.956273 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689bf9b-1be9-4398-ac37-b4cff500f9a5 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:05.956911 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689bf9b-1be9-4398-ac37-b4cff500f9a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:05.957210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689bf9b-1be9-4398-ac37-b4cff500f9a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:05.958596 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689bf9b-1be9-4398-ac37-b4cff500f9a5 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:05.972068 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 527/1060] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:36:05.973837 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825434f-c10a-4884-8be3-5ca8b7c3bf13 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:05.974118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825434f-c10a-4884-8be3-5ca8b7c3bf13 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:05.974387 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825434f-c10a-4884-8be3-5ca8b7c3bf13 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:05.974987 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba883f58-555b-441e-8f6a-f438b7274e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:05.975736 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba883f58-555b-441e-8f6a-f438b7274e5b None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:05.975842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 528/1061] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:36:05.975918 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba883f58-555b-441e-8f6a-f438b7274e5b None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:05.976142 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba883f58-555b-441e-8f6a-f438b7274e5b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:05.976802 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba883f58-555b-441e-8f6a-f438b7274e5b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:05.978151 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba883f58-555b-441e-8f6a-f438b7274e5b None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:05.980084 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825434f-c10a-4884-8be3-5ca8b7c3bf13 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:06.062224 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 534/1062] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:36:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:36:06.063395 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb247ec-6986-45a8-860a-11bbcc40b78f None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:06.063690 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb247ec-6986-45a8-860a-11bbcc40b78f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:06.063969 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb247ec-6986-45a8-860a-11bbcc40b78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:06.079215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:06.093704 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-6fb247ec-6986-45a8-860a-11bbcc40b78f None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:36:06.094992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-6fb247ec-6986-45a8-860a-11bbcc40b78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:36:06.096500 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825434f-c10a-4884-8be3-5ca8b7c3bf13 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:06.134995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3de0b-e5d4-467e-a6ad-6bf5be133920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:06.135815 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3de0b-e5d4-467e-a6ad-6bf5be133920 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:06.136004 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3de0b-e5d4-467e-a6ad-6bf5be133920 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:06.136278 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3de0b-e5d4-467e-a6ad-6bf5be133920 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:06.143834 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3de0b-e5d4-467e-a6ad-6bf5be133920 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:06.145436 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3de0b-e5d4-467e-a6ad-6bf5be133920 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:06.158025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-76b3de0b-e5d4-467e-a6ad-6bf5be133920 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:36:06.158025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:06.158025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:36:06.158025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:36:06.158025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:36:06.158025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:36:06.158025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:36:06.158025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:36:06.158025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:36:06.158025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:36:06.158025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:36:06.158025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:36:06.158025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:36:06.158025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:36:06.158025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:36:06.159023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:36:06.159023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:36:06.159023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:36:06.159023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:36:06.159023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:36:06.159023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:36:06.159023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:36:06.159023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:36:06.159023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:36:06.159023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:36:06.159023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:36:06.159023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:36:06.159023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:36:06.159023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:36:06.159023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:36:06.159023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:36:06.159023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:36:06.159991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:36:06.159991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:36:06.159991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:36:06.159991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:36:06.159991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:36:06.159991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:36:06.159991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:36:06.159991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:36:06.159991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 529/1063] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:36:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:36:06.166193 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3de0b-e5d4-467e-a6ad-6bf5be133920 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:06.174415 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 535/1064] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:36:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:36:06.196414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:06.288570 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3de0b-e5d4-467e-a6ad-6bf5be133920 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:06.328663 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783cd4e-264b-4fb3-b924-feb6e62f2417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:06.329271 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783cd4e-264b-4fb3-b924-feb6e62f2417 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:06.329543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783cd4e-264b-4fb3-b924-feb6e62f2417 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:06.329813 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783cd4e-264b-4fb3-b924-feb6e62f2417 None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:06.331160 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783cd4e-264b-4fb3-b924-feb6e62f2417 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:06.331160 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783cd4e-264b-4fb3-b924-feb6e62f2417 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:06.332289 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783cd4e-264b-4fb3-b924-feb6e62f2417 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:06.349322 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 530/1065] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:36:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:06.352447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb247ec-6986-45a8-860a-11bbcc40b78f None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:06.445042 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783cd4e-264b-4fb3-b924-feb6e62f2417 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:06.467253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb247ec-6986-45a8-860a-11bbcc40b78f None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:06.517419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d450a47-62b3-4f15-a8c3-098add81f642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:06.518080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d450a47-62b3-4f15-a8c3-098add81f642 None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:06.518358 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d450a47-62b3-4f15-a8c3-098add81f642 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:06.518627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d450a47-62b3-4f15-a8c3-098add81f642 None admin] PATH_INFO: `/v3/projects/6283121e17814cd792df9d0edf81bf2d/users/2d231136bcd44d9a97efe6c257f936ed/roles/802471bc911e46a6b7ad1f122b1a9e9e` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:06.520861 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d450a47-62b3-4f15-a8c3-098add81f642 None admin] RBAC: Authorizing `identity:create_grant(project_id=6283121e17814cd792df9d0edf81bf2d, user_id=2d231136bcd44d9a97efe6c257f936ed, role_id=802471bc911e46a6b7ad1f122b1a9e9e)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:06.522283 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d450a47-62b3-4f15-a8c3-098add81f642 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:06.526359 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:06.547661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:06.569677 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783cd4e-264b-4fb3-b924-feb6e62f2417 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:06.589194 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 536/1066] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 1 13:36:06 2022] PUT /identity/v3/projects/6283121e17814cd792df9d0edf81bf2d/users/2d231136bcd44d9a97efe6c257f936ed/roles/802471bc911e46a6b7ad1f122b1a9e9e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:36:06.623538 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8046f37-a3eb-4e2f-82c4-ab4568da357b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:06.624322 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8046f37-a3eb-4e2f-82c4-ab4568da357b None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:06.624495 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8046f37-a3eb-4e2f-82c4-ab4568da357b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:06.624741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8046f37-a3eb-4e2f-82c4-ab4568da357b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:06.637273 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8046f37-a3eb-4e2f-82c4-ab4568da357b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:36:06.643010 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-a8046f37-a3eb-4e2f-82c4-ab4568da357b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:36:06.643010 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:06.643010 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:36:06.643010 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:36:06.643010 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:36:06.643010 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:36:06.643010 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:36:06.643010 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:36:06.643010 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:36:06.643010 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:36:06.643010 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:36:06.643010 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:36:06.643010 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:36:06.643010 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:36:06.643010 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:36:06.643010 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:36:06.644342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:36:06.644342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:36:06.644342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:36:06.644342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:36:06.644342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:36:06.644342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:36:06.644342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:36:06.644342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:36:06.644342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:36:06.644342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:36:06.644342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:36:06.644342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:36:06.644342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:36:06.644342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:36:06.644342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:36:06.644342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:36:06.645987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:36:06.645987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:36:06.645987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:36:06.645987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:36:06.645987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:36:06.645987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:36:06.645987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:36:06.645987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:36:06.645987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:36:06.645987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:36:06.645987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:36:06.645987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:36:06.651548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 531/1067] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:36:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:36:06.654839 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d450a47-62b3-4f15-a8c3-098add81f642 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:06.786538 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d450a47-62b3-4f15-a8c3-098add81f642 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:06.825522 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b890a-f21d-4b06-933c-6c340788fb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:06.826305 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b890a-f21d-4b06-933c-6c340788fb97 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:06.826423 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b890a-f21d-4b06-933c-6c340788fb97 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:06.826672 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b890a-f21d-4b06-933c-6c340788fb97 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:06.827721 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b890a-f21d-4b06-933c-6c340788fb97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:06.827721 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b890a-f21d-4b06-933c-6c340788fb97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:06.829046 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b890a-f21d-4b06-933c-6c340788fb97 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:06.841005 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 537/1068] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:36:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:06.848786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8046f37-a3eb-4e2f-82c4-ab4568da357b None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:06.970603 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8046f37-a3eb-4e2f-82c4-ab4568da357b None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:07.018499 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079da4f1-8151-411f-8e58-934cc989f9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:07.019133 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079da4f1-8151-411f-8e58-934cc989f9ec None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:07.019611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079da4f1-8151-411f-8e58-934cc989f9ec None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:07.019813 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079da4f1-8151-411f-8e58-934cc989f9ec None admin] PATH_INFO: `/v3/users/54f058b66f7e493680759e8d6e42c272` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:07.035756 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:07.038715 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079da4f1-8151-411f-8e58-934cc989f9ec None admin] RBAC: Authorizing `identity:get_user(user_id=54f058b66f7e493680759e8d6e42c272)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:07.040149 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079da4f1-8151-411f-8e58-934cc989f9ec None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:07.042025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 532/1069] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:36:06 2022] GET /identity/v3/users/54f058b66f7e493680759e8d6e42c272 => generated 285 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:07.048007 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b890a-f21d-4b06-933c-6c340788fb97 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:07.125024 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:07.178083 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b890a-f21d-4b06-933c-6c340788fb97 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:07.218264 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59856a5-e59a-4095-92a9-c3d5d060c90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:07.218882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59856a5-e59a-4095-92a9-c3d5d060c90d None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:07.219162 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59856a5-e59a-4095-92a9-c3d5d060c90d None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:07.219468 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59856a5-e59a-4095-92a9-c3d5d060c90d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:07.309871 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59856a5-e59a-4095-92a9-c3d5d060c90d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:07.311225 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59856a5-e59a-4095-92a9-c3d5d060c90d None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:07.372837 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:07.424614 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 538/1070] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:36:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:36:07.430786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079da4f1-8151-411f-8e58-934cc989f9ec None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:07.542363 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079da4f1-8151-411f-8e58-934cc989f9ec None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:07.584947 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee9dc0-c0b1-483a-bd12-03662097be6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:07.585522 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee9dc0-c0b1-483a-bd12-03662097be6d None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:07.585798 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee9dc0-c0b1-483a-bd12-03662097be6d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:07.586064 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee9dc0-c0b1-483a-bd12-03662097be6d None admin] PATH_INFO: `/v3/projects/e5968892a2964f8f8c98aae0480fbb20` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:07.587182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee9dc0-c0b1-483a-bd12-03662097be6d None admin] RBAC: Authorizing `identity:get_project(project_id=e5968892a2964f8f8c98aae0480fbb20)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:07.588678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee9dc0-c0b1-483a-bd12-03662097be6d None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:07.590524 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 533/1071] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:36:07 2022] GET /identity/v3/projects/e5968892a2964f8f8c98aae0480fbb20 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:07.598660 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59856a5-e59a-4095-92a9-c3d5d060c90d None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:07.715852 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59856a5-e59a-4095-92a9-c3d5d060c90d None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:07.755229 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986eb9f6-4bba-409a-a6bc-f06a2bc8e1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:07.755856 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986eb9f6-4bba-409a-a6bc-f06a2bc8e1d1 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:07.756191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986eb9f6-4bba-409a-a6bc-f06a2bc8e1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:07.756451 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986eb9f6-4bba-409a-a6bc-f06a2bc8e1d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:07.757180 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986eb9f6-4bba-409a-a6bc-f06a2bc8e1d1 None admin] RBAC: Adding query filter params (role.id=98ffd3c114804da292d7cb33721e9085, scope.project.id=e5968892a2964f8f8c98aae0480fbb20, user.id=54f058b66f7e493680759e8d6e42c272) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:07.757553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986eb9f6-4bba-409a-a6bc-f06a2bc8e1d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:07.759710 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986eb9f6-4bba-409a-a6bc-f06a2bc8e1d1 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:07.765376 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 539/1072] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:36:07 2022] GET /identity/v3/role_assignments?user.id=54f058b66f7e493680759e8d6e42c272&scope.project.id=e5968892a2964f8f8c98aae0480fbb20&role.id=98ffd3c114804da292d7cb33721e9085 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:08.035674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6106d75-575e-40d3-bd7e-546428a0d84c None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:08.036234 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6106d75-575e-40d3-bd7e-546428a0d84c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:08.036454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6106d75-575e-40d3-bd7e-546428a0d84c None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:08.038064 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 534/1073] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:36:08.043503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc5091-61bc-49e5-84bd-ef539eb42ae8 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:08.043979 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc5091-61bc-49e5-84bd-ef539eb42ae8 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:08.044276 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc5091-61bc-49e5-84bd-ef539eb42ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:08.063129 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-d4cc5091-61bc-49e5-84bd-ef539eb42ae8 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:36:08.064523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-d4cc5091-61bc-49e5-84bd-ef539eb42ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:36:08.087457 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:08.151148 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 540/1074] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:36:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:36:08.410920 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6106d75-575e-40d3-bd7e-546428a0d84c None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:08.495167 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:08.533717 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6106d75-575e-40d3-bd7e-546428a0d84c None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:08.539481 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2e795-942d-40e1-9071-6fac89db6134 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:08.540078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2e795-942d-40e1-9071-6fac89db6134 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:08.540620 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2e795-942d-40e1-9071-6fac89db6134 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:08.542325 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 541/1075] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:36:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:36:08.547614 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e541d-bb55-4a55-ab11-8f454ba1ba97 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:08.547897 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e541d-bb55-4a55-ab11-8f454ba1ba97 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:08.548179 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e541d-bb55-4a55-ab11-8f454ba1ba97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:08.568097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-6f7e541d-bb55-4a55-ab11-8f454ba1ba97 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:36:08.569356 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-6f7e541d-bb55-4a55-ab11-8f454ba1ba97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:36:08.579562 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d9e12-a66e-4068-9100-88f4219ccec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:08.580178 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d9e12-a66e-4068-9100-88f4219ccec6 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:08.580455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d9e12-a66e-4068-9100-88f4219ccec6 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:08.580725 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d9e12-a66e-4068-9100-88f4219ccec6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:08.640758 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 542/1076] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:36:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:36:08.654902 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d9e12-a66e-4068-9100-88f4219ccec6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:08.656497 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d9e12-a66e-4068-9100-88f4219ccec6 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:08.743729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:08.795391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 535/1077] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:36:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:36:08.801863 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e541d-bb55-4a55-ab11-8f454ba1ba97 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:08.909013 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:08.913243 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d9e12-a66e-4068-9100-88f4219ccec6 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:08.932170 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e541d-bb55-4a55-ab11-8f454ba1ba97 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:08.972048 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19464e7-9d65-4aa7-8500-2b21add15dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:08.973201 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19464e7-9d65-4aa7-8500-2b21add15dcc None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:08.973480 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19464e7-9d65-4aa7-8500-2b21add15dcc None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:08.973748 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19464e7-9d65-4aa7-8500-2b21add15dcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:08.987164 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19464e7-9d65-4aa7-8500-2b21add15dcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:08.989192 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19464e7-9d65-4aa7-8500-2b21add15dcc None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:09.006896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-d19464e7-9d65-4aa7-8500-2b21add15dcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:36:09.006896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:09.006896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:36:09.006896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:36:09.006896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:36:09.006896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:36:09.006896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:36:09.006896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:36:09.006896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:36:09.006896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:36:09.006896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:36:09.006896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:36:09.006896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:36:09.006896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:36:09.006896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:36:09.006896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:36:09.009049 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:36:09.009049 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:36:09.009049 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:36:09.009049 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:36:09.009049 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:36:09.009049 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:36:09.009049 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:36:09.009049 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:36:09.009049 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:36:09.009049 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:36:09.009049 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:36:09.009049 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:36:09.009049 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:36:09.009049 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:36:09.009049 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:36:09.009049 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:36:09.009049 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:36:09.010144 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:36:09.010144 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:36:09.010144 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:36:09.010144 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 543/1078] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:36:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:36:09.013498 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19464e7-9d65-4aa7-8500-2b21add15dcc None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:09.054368 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d9e12-a66e-4068-9100-88f4219ccec6 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:09.098316 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607111cf-700d-40ed-856b-6cc5e3ec5183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:09.099110 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607111cf-700d-40ed-856b-6cc5e3ec5183 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:09.099488 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607111cf-700d-40ed-856b-6cc5e3ec5183 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:09.099828 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607111cf-700d-40ed-856b-6cc5e3ec5183 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:09.111702 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607111cf-700d-40ed-856b-6cc5e3ec5183 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:36:09.116403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-607111cf-700d-40ed-856b-6cc5e3ec5183 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 13:36:09.116403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:09.116403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:36:09.116403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:36:09.116403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:36:09.116403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:36:09.116403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:36:09.116403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:36:09.116403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:36:09.116403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:36:09.116403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:36:09.116403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:36:09.116403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:36:09.116403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:36:09.116403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:36:09.116403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:36:09.117788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:36:09.117788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:36:09.117788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:36:09.117788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:36:09.117788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:36:09.117788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:36:09.117788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:36:09.117788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:36:09.117788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:36:09.117788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:36:09.117788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:36:09.117788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:36:09.117788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:36:09.117788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:36:09.117788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:36:09.117788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:36:09.119891 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:36:09.119891 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:36:09.119891 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:36:09.119891 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:36:09.119891 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:36:09.119891 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:36:09.119891 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:36:09.119891 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:36:09.119891 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:36:09.119891 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:36:09.119891 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 13:36:09.119891 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:36:09.119891 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 536/1079] 10.222.0.50 () {56 vars in 1120 bytes} [Thu Sep 1 13:36:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:36:09.123671 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607111cf-700d-40ed-856b-6cc5e3ec5183 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:09.135494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19464e7-9d65-4aa7-8500-2b21add15dcc None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:09.165440 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:09.175397 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ce3f7-0623-423a-8f02-c4490ad410a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:09.175593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ce3f7-0623-423a-8f02-c4490ad410a5 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:09.175877 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ce3f7-0623-423a-8f02-c4490ad410a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:09.176132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ce3f7-0623-423a-8f02-c4490ad410a5 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:09.180198 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ce3f7-0623-423a-8f02-c4490ad410a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:09.180198 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ce3f7-0623-423a-8f02-c4490ad410a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:09.180198 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ce3f7-0623-423a-8f02-c4490ad410a5 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:09.181363 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:09.211588 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 544/1080] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:36:09.276786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607111cf-700d-40ed-856b-6cc5e3ec5183 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:09.324642 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11457c5-9a20-4da7-bf0a-178ca7dd5e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:09.325264 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11457c5-9a20-4da7-bf0a-178ca7dd5e98 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:09.325545 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11457c5-9a20-4da7-bf0a-178ca7dd5e98 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:09.325819 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11457c5-9a20-4da7-bf0a-178ca7dd5e98 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:09.326519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11457c5-9a20-4da7-bf0a-178ca7dd5e98 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:09.326821 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11457c5-9a20-4da7-bf0a-178ca7dd5e98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:09.328304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11457c5-9a20-4da7-bf0a-178ca7dd5e98 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:09.340965 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 537/1081] 10.222.0.50 () {56 vars in 1115 bytes} [Thu Sep 1 13:36:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:36:09.346795 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ce3f7-0623-423a-8f02-c4490ad410a5 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:09.467872 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ce3f7-0623-423a-8f02-c4490ad410a5 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:09.503041 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78a07e-019e-4fe4-8f8f-71dc271a2046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:09.503713 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78a07e-019e-4fe4-8f8f-71dc271a2046 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:09.504496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78a07e-019e-4fe4-8f8f-71dc271a2046 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:09.504769 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78a07e-019e-4fe4-8f8f-71dc271a2046 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:09.515867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d78a07e-019e-4fe4-8f8f-71dc271a2046 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:09.517358 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d78a07e-019e-4fe4-8f8f-71dc271a2046 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:09.532878 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-1d78a07e-019e-4fe4-8f8f-71dc271a2046 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:36:09.532878 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:09.532878 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:36:09.532878 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:36:09.532878 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:36:09.532878 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:36:09.532878 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:36:09.532878 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:36:09.532878 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:36:09.532878 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:36:09.532878 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:36:09.532878 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:36:09.532878 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:36:09.532878 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:36:09.532878 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:36:09.532878 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:36:09.534057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:36:09.534057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:36:09.534057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:36:09.534057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:36:09.534057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:36:09.534057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:36:09.534057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:36:09.534057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:36:09.534057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:36:09.534057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:36:09.534057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:36:09.534057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:36:09.534057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:36:09.534057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:36:09.534057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:36:09.534057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:36:09.534057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:36:09.535339 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:36:09.535339 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:36:09.535339 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:36:09.535339 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 545/1082] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:36:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:36:09.540200 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11457c5-9a20-4da7-bf0a-178ca7dd5e98 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:09.644279 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:09.653544 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11457c5-9a20-4da7-bf0a-178ca7dd5e98 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:09.694372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eaf9e9-fbcd-44fe-a1b5-d179bbf44913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:09.694989 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eaf9e9-fbcd-44fe-a1b5-d179bbf44913 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:09.695259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eaf9e9-fbcd-44fe-a1b5-d179bbf44913 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:09.695555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eaf9e9-fbcd-44fe-a1b5-d179bbf44913 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:09.696210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eaf9e9-fbcd-44fe-a1b5-d179bbf44913 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:09.696511 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eaf9e9-fbcd-44fe-a1b5-d179bbf44913 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:09.697877 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eaf9e9-fbcd-44fe-a1b5-d179bbf44913 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:09.710628 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 538/1083] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:09.717159 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78a07e-019e-4fe4-8f8f-71dc271a2046 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:09.735608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4571b-3717-4477-87cf-c980eed11d5c None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:09.736147 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4571b-3717-4477-87cf-c980eed11d5c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:09.736419 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4571b-3717-4477-87cf-c980eed11d5c None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:09.737762 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 539/1084] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:36:09.744401 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55ef77-90d0-474d-a01f-91bd6f1b8e31 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:09.744401 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55ef77-90d0-474d-a01f-91bd6f1b8e31 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:09.744722 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55ef77-90d0-474d-a01f-91bd6f1b8e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:09.767459 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:09.769839 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-bf55ef77-90d0-474d-a01f-91bd6f1b8e31 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:36:09.771084 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-bf55ef77-90d0-474d-a01f-91bd6f1b8e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:36:09.825104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78a07e-019e-4fe4-8f8f-71dc271a2046 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:09.844303 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 540/1085] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:36:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:36:09.861480 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eccd13-d070-4bca-89ce-ccbf07921162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:09.862104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eccd13-d070-4bca-89ce-ccbf07921162 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:09.862378 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eccd13-d070-4bca-89ce-ccbf07921162 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:09.862644 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eccd13-d070-4bca-89ce-ccbf07921162 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:09.870146 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eccd13-d070-4bca-89ce-ccbf07921162 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:09.871610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eccd13-d070-4bca-89ce-ccbf07921162 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:09.883717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-57eccd13-d070-4bca-89ce-ccbf07921162 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:36:09.883717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:09.883717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:36:09.883717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:36:09.883717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:36:09.883717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:36:09.883717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:36:09.883717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:36:09.883717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:36:09.883717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:36:09.883717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:36:09.883717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:36:09.883717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:36:09.883717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:36:09.883717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:36:09.883717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:36:09.884827 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:36:09.884827 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:36:09.884827 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:36:09.884827 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:36:09.884827 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:36:09.884827 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:36:09.884827 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:36:09.884827 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:36:09.884827 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:36:09.884827 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:36:09.884827 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:36:09.884827 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:36:09.884827 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:36:09.884827 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:36:09.884827 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:36:09.884827 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:36:09.884827 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:36:09.884827 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:36:09.885833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:36:09.885833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:36:09.885833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:36:09.885833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:36:09.885833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:36:09.885833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:36:09.885833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:36:09.885833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:36:09.885833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:36:09.885833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:36:09.885833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 546/1086] 10.222.0.50 () {56 vars in 1093 bytes} [Thu Sep 1 13:36:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:36:09.890741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55ef77-90d0-474d-a01f-91bd6f1b8e31 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:09.974645 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:09.993952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55ef77-90d0-474d-a01f-91bd6f1b8e31 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:10.034417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbbdc1-1a7d-41a8-9559-004a4dd5c3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:10.035032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbbdc1-1a7d-41a8-9559-004a4dd5c3ed None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:10.035924 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbbdc1-1a7d-41a8-9559-004a4dd5c3ed None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:10.036204 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbbdc1-1a7d-41a8-9559-004a4dd5c3ed None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:10.036946 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbbdc1-1a7d-41a8-9559-004a4dd5c3ed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:10.037255 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbbdc1-1a7d-41a8-9559-004a4dd5c3ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:10.038717 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbbdc1-1a7d-41a8-9559-004a4dd5c3ed None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:10.056836 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 541/1087] 10.222.0.50 () {56 vars in 1133 bytes} [Thu Sep 1 13:36:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:10.062576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eccd13-d070-4bca-89ce-ccbf07921162 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:10.116701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbbdc1-1a7d-41a8-9559-004a4dd5c3ed None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:10.169654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eccd13-d070-4bca-89ce-ccbf07921162 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:10.177824 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:10.208520 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60cb62-0621-4e40-8313-b815dc3b15d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:10.209123 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60cb62-0621-4e40-8313-b815dc3b15d1 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:10.209404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60cb62-0621-4e40-8313-b815dc3b15d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:10.209673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60cb62-0621-4e40-8313-b815dc3b15d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:10.222834 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbbdc1-1a7d-41a8-9559-004a4dd5c3ed None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:10.260280 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96cf29-705b-4be6-b611-c102e92304b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:10.260914 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96cf29-705b-4be6-b611-c102e92304b0 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:10.261198 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96cf29-705b-4be6-b611-c102e92304b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:10.261465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96cf29-705b-4be6-b611-c102e92304b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:10.268493 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:10.272914 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a96cf29-705b-4be6-b611-c102e92304b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:36:10.277700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-5a96cf29-705b-4be6-b611-c102e92304b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:36:10.277700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:10.277700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:36:10.277700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:36:10.277700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:36:10.277700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:36:10.277700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:36:10.277700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:36:10.277700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:36:10.277700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:36:10.277700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:36:10.277700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:36:10.277700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:36:10.277700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:36:10.277700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:36:10.277700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:36:10.278778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:36:10.278778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:36:10.278778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:36:10.278778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:36:10.278778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:36:10.278778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:36:10.278778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:36:10.278778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:36:10.278778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:36:10.278778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:36:10.278778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:36:10.278778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:36:10.278778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:36:10.278778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:36:10.278778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:36:10.278778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:36:10.279707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:36:10.279707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:36:10.279707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:36:10.279707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:36:10.279707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:36:10.279707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:36:10.279707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:36:10.279707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:36:10.279707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:36:10.279707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:36:10.279707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:36:10.279707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:36:10.279707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 542/1088] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:36:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:36:10.285106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60cb62-0621-4e40-8313-b815dc3b15d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:10.286247 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96cf29-705b-4be6-b611-c102e92304b0 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:10.286559 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60cb62-0621-4e40-8313-b815dc3b15d1 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:10.384398 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 547/1089] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:36:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 13:36:10.384604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96cf29-705b-4be6-b611-c102e92304b0 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:10.390263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60cb62-0621-4e40-8313-b815dc3b15d1 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:10.398085 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:10.419245 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a877e9-5e74-452d-a358-b608f93260de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:10.419879 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a877e9-5e74-452d-a358-b608f93260de None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:10.420158 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a877e9-5e74-452d-a358-b608f93260de None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:10.420430 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a877e9-5e74-452d-a358-b608f93260de None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:10.421090 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a877e9-5e74-452d-a358-b608f93260de None admin] RBAC: Adding query filter params (name=admin) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:10.421391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a877e9-5e74-452d-a358-b608f93260de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:10.422789 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a877e9-5e74-452d-a358-b608f93260de None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:10.431746 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 543/1090] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:36:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:36:10.437681 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a877e9-5e74-452d-a358-b608f93260de None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:10.487636 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60cb62-0621-4e40-8313-b815dc3b15d1 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:10.495426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:10.521207 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e3cf1-2f1f-4b3e-b50b-a11c21bfadb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:10.521828 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e3cf1-2f1f-4b3e-b50b-a11c21bfadb3 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:10.522105 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e3cf1-2f1f-4b3e-b50b-a11c21bfadb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:10.522374 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e3cf1-2f1f-4b3e-b50b-a11c21bfadb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:10.533529 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e3cf1-2f1f-4b3e-b50b-a11c21bfadb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:10.534961 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e3cf1-2f1f-4b3e-b50b-a11c21bfadb3 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:10.538512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a877e9-5e74-452d-a358-b608f93260de None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:10.550232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-a93e3cf1-2f1f-4b3e-b50b-a11c21bfadb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:36:10.550232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:10.550232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:36:10.550232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:36:10.550232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:36:10.550232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:36:10.550232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:36:10.550232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:36:10.550232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:36:10.550232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:36:10.550232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:36:10.550232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:36:10.550232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:36:10.550232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:36:10.550232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:36:10.550232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:36:10.551278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:36:10.551278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:36:10.551278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:36:10.551278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:36:10.551278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:36:10.551278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:36:10.551278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:36:10.551278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:36:10.551278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:36:10.551278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:36:10.551278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:36:10.551278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:36:10.551278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:36:10.551278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:36:10.551278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:36:10.551278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:36:10.551278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:36:10.552199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:36:10.552199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:36:10.552199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:36:10.552199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 548/1091] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:36:10.557099 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e3cf1-2f1f-4b3e-b50b-a11c21bfadb3 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:10.574128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2adaf-45d4-4ba3-a687-e14f469364d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:10.574753 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2adaf-45d4-4ba3-a687-e14f469364d2 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:10.575031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2adaf-45d4-4ba3-a687-e14f469364d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:10.575306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2adaf-45d4-4ba3-a687-e14f469364d2 None admin] PATH_INFO: `/v3/users/54f058b66f7e493680759e8d6e42c272` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:10.576463 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2adaf-45d4-4ba3-a687-e14f469364d2 None admin] RBAC: Authorizing `identity:get_user(user_id=54f058b66f7e493680759e8d6e42c272)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:10.577888 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2adaf-45d4-4ba3-a687-e14f469364d2 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:10.579775 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 544/1092] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:36:10 2022] GET /identity/v3/users/54f058b66f7e493680759e8d6e42c272 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:36:10.585698 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2adaf-45d4-4ba3-a687-e14f469364d2 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:10.615540 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:10.657019 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e3cf1-2f1f-4b3e-b50b-a11c21bfadb3 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:10.686700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2adaf-45d4-4ba3-a687-e14f469364d2 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:10.689829 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981eb90-728e-4ea9-86e5-b7a4017614b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:10.690430 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981eb90-728e-4ea9-86e5-b7a4017614b5 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:10.690711 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981eb90-728e-4ea9-86e5-b7a4017614b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:10.690981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981eb90-728e-4ea9-86e5-b7a4017614b5 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:10.692223 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981eb90-728e-4ea9-86e5-b7a4017614b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:10.692525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981eb90-728e-4ea9-86e5-b7a4017614b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:10.693883 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981eb90-728e-4ea9-86e5-b7a4017614b5 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:10.705508 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 549/1093] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:36:10.711565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981eb90-728e-4ea9-86e5-b7a4017614b5 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:10.713554 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:10.721299 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f889c70-1bb8-47c9-b6eb-6ee7deac6a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:10.725278 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f889c70-1bb8-47c9-b6eb-6ee7deac6a4a None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:10.725278 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f889c70-1bb8-47c9-b6eb-6ee7deac6a4a None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:10.725278 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f889c70-1bb8-47c9-b6eb-6ee7deac6a4a None admin] PATH_INFO: `/v3/projects/e5968892a2964f8f8c98aae0480fbb20` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:10.725278 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f889c70-1bb8-47c9-b6eb-6ee7deac6a4a None admin] RBAC: Authorizing `identity:get_project(project_id=e5968892a2964f8f8c98aae0480fbb20)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:10.725278 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f889c70-1bb8-47c9-b6eb-6ee7deac6a4a None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:10.727187 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 545/1094] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:36:10 2022] GET /identity/v3/projects/e5968892a2964f8f8c98aae0480fbb20 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:36:10.733043 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f889c70-1bb8-47c9-b6eb-6ee7deac6a4a None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:10.813270 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981eb90-728e-4ea9-86e5-b7a4017614b5 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:10.831116 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:10.833281 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f889c70-1bb8-47c9-b6eb-6ee7deac6a4a None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:10.850369 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c098f-f86d-42d2-8d05-2000b04e5c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:10.851001 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c098f-f86d-42d2-8d05-2000b04e5c67 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:10.851279 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c098f-f86d-42d2-8d05-2000b04e5c67 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:10.851581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c098f-f86d-42d2-8d05-2000b04e5c67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:10.858493 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c098f-f86d-42d2-8d05-2000b04e5c67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:10.860061 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c098f-f86d-42d2-8d05-2000b04e5c67 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:10.868052 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fd422-8755-4e8b-9c60-f54610fbf33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:10.868701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fd422-8755-4e8b-9c60-f54610fbf33d None admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:10.868979 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fd422-8755-4e8b-9c60-f54610fbf33d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:10.869252 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fd422-8755-4e8b-9c60-f54610fbf33d None admin] PATH_INFO: `/v3/projects/e5968892a2964f8f8c98aae0480fbb20/users/54f058b66f7e493680759e8d6e42c272/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:10.871120 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fd422-8755-4e8b-9c60-f54610fbf33d None admin] RBAC: Authorizing `identity:create_grant(project_id=e5968892a2964f8f8c98aae0480fbb20, user_id=54f058b66f7e493680759e8d6e42c272, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:10.872393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-872c098f-f86d-42d2-8d05-2000b04e5c67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:36:10.872393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:10.872393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:36:10.872393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:36:10.872393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:36:10.872393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:36:10.872393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:36:10.872393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:36:10.872393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:36:10.872393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:36:10.872393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:36:10.872393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:36:10.872393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:36:10.872393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:36:10.872393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:36:10.873263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:36:10.873263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:36:10.873263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:36:10.873263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:36:10.873263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:36:10.873263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:36:10.873263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:36:10.873263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:36:10.873263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:36:10.873263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:36:10.873263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:36:10.873263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:36:10.873263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:36:10.873263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:36:10.873263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:36:10.873263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:36:10.873263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:36:10.874324 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:36:10.874324 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:36:10.874324 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:36:10.874324 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:36:10.874324 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:36:10.874324 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:36:10.874324 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:36:10.874324 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:36:10.875418 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fd422-8755-4e8b-9c60-f54610fbf33d None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:10.875509 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 550/1095] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:36:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:36:10.880099 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c098f-f86d-42d2-8d05-2000b04e5c67 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:10.945628 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 546/1096] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 1 13:36:10 2022] PUT /identity/v3/projects/e5968892a2964f8f8c98aae0480fbb20/users/54f058b66f7e493680759e8d6e42c272/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:36:11.000557 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c098f-f86d-42d2-8d05-2000b04e5c67 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:11.036772 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b1609-c04b-491b-98e8-8300eab27e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:11.037393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b1609-c04b-491b-98e8-8300eab27e87 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:11.037672 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b1609-c04b-491b-98e8-8300eab27e87 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:11.037941 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b1609-c04b-491b-98e8-8300eab27e87 None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:11.038644 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b1609-c04b-491b-98e8-8300eab27e87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:11.038951 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b1609-c04b-491b-98e8-8300eab27e87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:11.040433 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b1609-c04b-491b-98e8-8300eab27e87 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:11.055210 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 551/1097] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:36:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:36:11.061540 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fd422-8755-4e8b-9c60-f54610fbf33d None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:11.122732 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:11.166940 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fd422-8755-4e8b-9c60-f54610fbf33d None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:11.200871 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5eb1d7-8265-4a67-9f0b-804d34bb9f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:11.201396 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5eb1d7-8265-4a67-9f0b-804d34bb9f84 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:11.201676 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5eb1d7-8265-4a67-9f0b-804d34bb9f84 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:11.201950 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5eb1d7-8265-4a67-9f0b-804d34bb9f84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:11.202669 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5eb1d7-8265-4a67-9f0b-804d34bb9f84 None admin] RBAC: Adding query filter params (role.id=802471bc911e46a6b7ad1f122b1a9e9e, scope.project.id=6283121e17814cd792df9d0edf81bf2d, user.id=2d231136bcd44d9a97efe6c257f936ed) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:11.202978 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5eb1d7-8265-4a67-9f0b-804d34bb9f84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:11.204444 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5eb1d7-8265-4a67-9f0b-804d34bb9f84 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:11.210372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 547/1098] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:36:11 2022] GET /identity/v3/role_assignments?user.id=2d231136bcd44d9a97efe6c257f936ed&scope.project.id=6283121e17814cd792df9d0edf81bf2d&role.id=802471bc911e46a6b7ad1f122b1a9e9e => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:12.890947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b9dfd-1bf9-4fde-b197-961d150f12ff None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:12.891534 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b9dfd-1bf9-4fde-b197-961d150f12ff None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:12.891534 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b9dfd-1bf9-4fde-b197-961d150f12ff None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:12.892885 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 552/1099] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:36:12.899142 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafddd8d-2151-437f-9b49-bd54674ab7c5 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:12.899680 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafddd8d-2151-437f-9b49-bd54674ab7c5 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:12.899791 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafddd8d-2151-437f-9b49-bd54674ab7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:12.918304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-eafddd8d-2151-437f-9b49-bd54674ab7c5 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:36:12.919527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-eafddd8d-2151-437f-9b49-bd54674ab7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:36:12.985762 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 548/1100] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:36:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:36:13.254728 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b9dfd-1bf9-4fde-b197-961d150f12ff None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:13.294469 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:13.352565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b9dfd-1bf9-4fde-b197-961d150f12ff None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:13.394066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6cde02-cd3f-47f7-8a50-4e9cc3ab6ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:13.395221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cde02-cd3f-47f7-8a50-4e9cc3ab6ee0 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:13.395529 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cde02-cd3f-47f7-8a50-4e9cc3ab6ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:13.395802 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cde02-cd3f-47f7-8a50-4e9cc3ab6ee0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:13.405517 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6cde02-cd3f-47f7-8a50-4e9cc3ab6ee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:36:13.410204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-ba6cde02-cd3f-47f7-8a50-4e9cc3ab6ee0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:36:13.410204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:13.410204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:36:13.410204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:36:13.410204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:36:13.410204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:36:13.410204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:36:13.410204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:36:13.410204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:36:13.410204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:36:13.410204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:36:13.410204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:36:13.410204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:36:13.410204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:36:13.410204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:36:13.410204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:36:13.411237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:36:13.411237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:36:13.411237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:36:13.411237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:36:13.411237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:36:13.411237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:36:13.411237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:36:13.411237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:36:13.411237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:36:13.411237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:36:13.411237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:36:13.411237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:36:13.411237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:36:13.411237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:36:13.411237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:36:13.411237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:36:13.412270 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:36:13.412270 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:36:13.412270 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:36:13.412270 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:36:13.412270 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:36:13.412270 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:36:13.412270 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:36:13.412270 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:36:13.412270 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:36:13.412270 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:36:13.412270 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:36:13.412270 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:36:13.412270 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 553/1101] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:36:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:36:13.417332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafddd8d-2151-437f-9b49-bd54674ab7c5 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:13.470097 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:13.518401 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafddd8d-2151-437f-9b49-bd54674ab7c5 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:13.551138 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e2864-0db5-411c-858b-19f202e26818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:13.551763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e2864-0db5-411c-858b-19f202e26818 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:13.552047 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e2864-0db5-411c-858b-19f202e26818 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:13.552322 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e2864-0db5-411c-858b-19f202e26818 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:13.552995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e2864-0db5-411c-858b-19f202e26818 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:13.553282 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e2864-0db5-411c-858b-19f202e26818 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:13.554654 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e2864-0db5-411c-858b-19f202e26818 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:13.562472 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 549/1102] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:36:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:13.568816 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6cde02-cd3f-47f7-8a50-4e9cc3ab6ee0 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:13.662808 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:13.666234 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6cde02-cd3f-47f7-8a50-4e9cc3ab6ee0 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:13.699284 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69b49b-d8c7-419f-8452-235b541a78c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:13.699926 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69b49b-d8c7-419f-8452-235b541a78c8 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:13.700207 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69b49b-d8c7-419f-8452-235b541a78c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:13.700482 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69b49b-d8c7-419f-8452-235b541a78c8 None admin] PATH_INFO: `/v3/users/54f058b66f7e493680759e8d6e42c272` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:13.701580 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd69b49b-d8c7-419f-8452-235b541a78c8 None admin] RBAC: Authorizing `identity:get_user(user_id=54f058b66f7e493680759e8d6e42c272)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:13.702997 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd69b49b-d8c7-419f-8452-235b541a78c8 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:13.704595 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 554/1103] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:36:13 2022] GET /identity/v3/users/54f058b66f7e493680759e8d6e42c272 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:13.710632 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e2864-0db5-411c-858b-19f202e26818 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:13.810674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e2864-0db5-411c-858b-19f202e26818 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:13.823545 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:13.843822 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb6365-78f4-4e26-886b-6323450ee346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:13.844415 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb6365-78f4-4e26-886b-6323450ee346 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:13.844697 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb6365-78f4-4e26-886b-6323450ee346 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:13.844970 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb6365-78f4-4e26-886b-6323450ee346 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:13.912673 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb6365-78f4-4e26-886b-6323450ee346 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:13.914128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb6365-78f4-4e26-886b-6323450ee346 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:14.009878 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 550/1104] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:36:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:36:14.016048 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69b49b-d8c7-419f-8452-235b541a78c8 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:14.113958 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69b49b-d8c7-419f-8452-235b541a78c8 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:14.148988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102166fd-5759-4893-8c68-c4a24515bbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:14.149634 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102166fd-5759-4893-8c68-c4a24515bbfe None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:14.149910 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102166fd-5759-4893-8c68-c4a24515bbfe None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:14.150176 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102166fd-5759-4893-8c68-c4a24515bbfe None admin] PATH_INFO: `/v3/projects/e5968892a2964f8f8c98aae0480fbb20` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:14.151294 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102166fd-5759-4893-8c68-c4a24515bbfe None admin] RBAC: Authorizing `identity:get_project(project_id=e5968892a2964f8f8c98aae0480fbb20)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:14.152739 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102166fd-5759-4893-8c68-c4a24515bbfe None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:14.154338 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 555/1105] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:36:14 2022] GET /identity/v3/projects/e5968892a2964f8f8c98aae0480fbb20 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:14.160532 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb6365-78f4-4e26-886b-6323450ee346 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:14.175053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:14.257222 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb6365-78f4-4e26-886b-6323450ee346 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:14.290189 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e537134-a1d6-4366-bdbb-3314f9f3a8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:14.290783 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e537134-a1d6-4366-bdbb-3314f9f3a8b0 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:14.291061 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e537134-a1d6-4366-bdbb-3314f9f3a8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:14.291332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e537134-a1d6-4366-bdbb-3314f9f3a8b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:14.292084 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e537134-a1d6-4366-bdbb-3314f9f3a8b0 None admin] RBAC: Adding query filter params (role.id=98ffd3c114804da292d7cb33721e9085, scope.project.id=e5968892a2964f8f8c98aae0480fbb20, user.id=54f058b66f7e493680759e8d6e42c272) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:14.292392 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e537134-a1d6-4366-bdbb-3314f9f3a8b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:14.293818 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e537134-a1d6-4366-bdbb-3314f9f3a8b0 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:14.299425 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 551/1106] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:36:14 2022] GET /identity/v3/role_assignments?user.id=54f058b66f7e493680759e8d6e42c272&scope.project.id=e5968892a2964f8f8c98aae0480fbb20&role.id=98ffd3c114804da292d7cb33721e9085 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:16.195060 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bfe32-8dac-4969-8b52-3886108cbb51 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:16.195604 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bfe32-8dac-4969-8b52-3886108cbb51 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:16.195604 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bfe32-8dac-4969-8b52-3886108cbb51 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:16.196877 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 556/1107] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:36:16.202145 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f393083-8de9-4a41-8316-8a44340cf093 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:16.202564 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f393083-8de9-4a41-8316-8a44340cf093 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:16.202682 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f393083-8de9-4a41-8316-8a44340cf093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:16.220657 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-6f393083-8de9-4a41-8316-8a44340cf093 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:36:16.221826 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-6f393083-8de9-4a41-8316-8a44340cf093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:36:16.287309 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 552/1108] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:36:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:36:16.555138 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bfe32-8dac-4969-8b52-3886108cbb51 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:16.590073 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:16.654504 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bfe32-8dac-4969-8b52-3886108cbb51 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:16.687242 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50ab8e-bf90-445d-8471-b479a6f5fe55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:16.687883 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50ab8e-bf90-445d-8471-b479a6f5fe55 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:16.688164 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50ab8e-bf90-445d-8471-b479a6f5fe55 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:16.688439 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50ab8e-bf90-445d-8471-b479a6f5fe55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:16.689533 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50ab8e-bf90-445d-8471-b479a6f5fe55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:16.691523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50ab8e-bf90-445d-8471-b479a6f5fe55 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:16.693068 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 557/1109] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:36:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:16.698777 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f393083-8de9-4a41-8316-8a44340cf093 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:16.706850 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:16.798920 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f393083-8de9-4a41-8316-8a44340cf093 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:16.834612 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1752f-a445-496e-a75e-79c6d8eddbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:16.835142 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1752f-a445-496e-a75e-79c6d8eddbed None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:16.835515 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1752f-a445-496e-a75e-79c6d8eddbed None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:16.835792 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1752f-a445-496e-a75e-79c6d8eddbed None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:16.836445 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1752f-a445-496e-a75e-79c6d8eddbed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:16.837896 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1752f-a445-496e-a75e-79c6d8eddbed None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:16.923258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 553/1110] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 1 13:36:16 2022] POST /identity/v3/users => generated 286 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:36:18.842055 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ec73a-b089-4d99-9144-151f89bb84de None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:18.842573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ec73a-b089-4d99-9144-151f89bb84de None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:18.842573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ec73a-b089-4d99-9144-151f89bb84de None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:18.843962 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 558/1111] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:36:18.849331 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7272de-f7b2-4381-b1e8-2392c111f7eb None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:18.849721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7272de-f7b2-4381-b1e8-2392c111f7eb None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:18.849878 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7272de-f7b2-4381-b1e8-2392c111f7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:18.868414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-3d7272de-f7b2-4381-b1e8-2392c111f7eb None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:36:18.869571 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-3d7272de-f7b2-4381-b1e8-2392c111f7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:36:18.923442 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:18.933694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 554/1112] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:36:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:36:19.202467 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ec73a-b089-4d99-9144-151f89bb84de None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:19.300921 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ec73a-b089-4d99-9144-151f89bb84de None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:19.302457 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:19.334865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47945a-4735-4416-8681-9cc26ba0f52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:19.335509 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47945a-4735-4416-8681-9cc26ba0f52e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:19.335790 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47945a-4735-4416-8681-9cc26ba0f52e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:19.336060 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47945a-4735-4416-8681-9cc26ba0f52e None admin] PATH_INFO: `/v3/roles/f0d2493c03664449802df928b8e8fa53` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:19.337431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47945a-4735-4416-8681-9cc26ba0f52e None admin] RBAC: Authorizing `identity:get_role(role_id=f0d2493c03664449802df928b8e8fa53)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:19.338928 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47945a-4735-4416-8681-9cc26ba0f52e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:19.340271 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 559/1113] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:36:19 2022] GET /identity/v3/roles/f0d2493c03664449802df928b8e8fa53 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:19.346180 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7272de-f7b2-4381-b1e8-2392c111f7eb None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:19.443326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7272de-f7b2-4381-b1e8-2392c111f7eb None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:19.476570 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e92bfb-4bab-4119-9da3-82fcf64332c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:19.477116 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e92bfb-4bab-4119-9da3-82fcf64332c4 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:19.477388 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e92bfb-4bab-4119-9da3-82fcf64332c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:19.477655 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e92bfb-4bab-4119-9da3-82fcf64332c4 None admin] PATH_INFO: `/v3/users/1488f3854d2d4965ad9423f2407d8327` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:19.491013 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e92bfb-4bab-4119-9da3-82fcf64332c4 None admin] RBAC: Authorizing `identity:get_user(user_id=1488f3854d2d4965ad9423f2407d8327)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:19.492480 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e92bfb-4bab-4119-9da3-82fcf64332c4 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:19.494089 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 555/1114] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:36:19 2022] GET /identity/v3/users/1488f3854d2d4965ad9423f2407d8327 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:19.499966 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47945a-4735-4416-8681-9cc26ba0f52e None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:19.594616 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47945a-4735-4416-8681-9cc26ba0f52e None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:19.629197 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f151f5-6147-4550-8cdd-2b9a90a798c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:19.629790 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f151f5-6147-4550-8cdd-2b9a90a798c8 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:19.630066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f151f5-6147-4550-8cdd-2b9a90a798c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:19.630336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f151f5-6147-4550-8cdd-2b9a90a798c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:19.668436 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:19.695408 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f151f5-6147-4550-8cdd-2b9a90a798c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:19.696846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f151f5-6147-4550-8cdd-2b9a90a798c8 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:19.792552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 560/1115] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:36:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:36:19.798518 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e92bfb-4bab-4119-9da3-82fcf64332c4 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:19.847709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:19.895948 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e92bfb-4bab-4119-9da3-82fcf64332c4 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:19.928991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6f930-2c08-44b9-ba48-356d32f1b0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:19.929607 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6f930-2c08-44b9-ba48-356d32f1b0a2 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:19.929884 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6f930-2c08-44b9-ba48-356d32f1b0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:19.930154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6f930-2c08-44b9-ba48-356d32f1b0a2 None admin] PATH_INFO: `/v3/projects/e5968892a2964f8f8c98aae0480fbb20` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:19.931262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d6f930-2c08-44b9-ba48-356d32f1b0a2 None admin] RBAC: Authorizing `identity:get_project(project_id=e5968892a2964f8f8c98aae0480fbb20)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:19.932716 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d6f930-2c08-44b9-ba48-356d32f1b0a2 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:19.934326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 556/1116] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:36:19 2022] GET /identity/v3/projects/e5968892a2964f8f8c98aae0480fbb20 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:19.941138 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f151f5-6147-4550-8cdd-2b9a90a798c8 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:20.008120 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:20.038533 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f151f5-6147-4550-8cdd-2b9a90a798c8 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:20.071550 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98630db5-58b5-4fe8-82c2-5a026208012c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:20.072077 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630db5-58b5-4fe8-82c2-5a026208012c None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:20.072358 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630db5-58b5-4fe8-82c2-5a026208012c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:20.072632 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630db5-58b5-4fe8-82c2-5a026208012c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:20.073348 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98630db5-58b5-4fe8-82c2-5a026208012c None admin] RBAC: Adding query filter params (role.id=f0d2493c03664449802df928b8e8fa53, scope.project.id=e5968892a2964f8f8c98aae0480fbb20, user.id=1488f3854d2d4965ad9423f2407d8327) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:20.073658 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98630db5-58b5-4fe8-82c2-5a026208012c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:20.075096 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98630db5-58b5-4fe8-82c2-5a026208012c None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:20.080405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 561/1117] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:36:19 2022] GET /identity/v3/role_assignments?user.id=1488f3854d2d4965ad9423f2407d8327&scope.project.id=e5968892a2964f8f8c98aae0480fbb20&role.id=f0d2493c03664449802df928b8e8fa53 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:21.920218 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc86006-8f63-4fc9-828f-2fffc0511811 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:21.920762 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc86006-8f63-4fc9-828f-2fffc0511811 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:21.920762 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc86006-8f63-4fc9-828f-2fffc0511811 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:21.922079 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 557/1118] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:36:21.927157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffe470-503d-4fcc-be82-74226a947301 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:21.927548 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffe470-503d-4fcc-be82-74226a947301 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:21.927750 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffe470-503d-4fcc-be82-74226a947301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:21.946315 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-a5ffe470-503d-4fcc-be82-74226a947301 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:36:21.947539 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a5ffe470-503d-4fcc-be82-74226a947301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:36:22.021077 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 562/1119] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:36:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:36:22.282907 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc86006-8f63-4fc9-828f-2fffc0511811 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:22.380415 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc86006-8f63-4fc9-828f-2fffc0511811 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:22.396975 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:22.413424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bafa0-d437-47d0-86df-65dad8aca32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:22.420890 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bafa0-d437-47d0-86df-65dad8aca32f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:22.420890 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bafa0-d437-47d0-86df-65dad8aca32f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:22.420890 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bafa0-d437-47d0-86df-65dad8aca32f None admin] PATH_INFO: `/v3/roles/f0d2493c03664449802df928b8e8fa53` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:22.420890 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bafa0-d437-47d0-86df-65dad8aca32f None admin] RBAC: Authorizing `identity:get_role(role_id=f0d2493c03664449802df928b8e8fa53)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:22.420890 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bafa0-d437-47d0-86df-65dad8aca32f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:22.420890 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 558/1120] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:36:22 2022] GET /identity/v3/roles/f0d2493c03664449802df928b8e8fa53 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:22.424366 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffe470-503d-4fcc-be82-74226a947301 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:22.483062 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:22.519108 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffe470-503d-4fcc-be82-74226a947301 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:22.551681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba848a-6939-47e7-bf44-df4797cfbbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:22.552238 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba848a-6939-47e7-bf44-df4797cfbbae None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:22.552515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba848a-6939-47e7-bf44-df4797cfbbae None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:22.552786 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba848a-6939-47e7-bf44-df4797cfbbae None admin] PATH_INFO: `/v3/users/1488f3854d2d4965ad9423f2407d8327` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:22.553876 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba848a-6939-47e7-bf44-df4797cfbbae None admin] RBAC: Authorizing `identity:get_user(user_id=1488f3854d2d4965ad9423f2407d8327)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:22.555309 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba848a-6939-47e7-bf44-df4797cfbbae None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:22.556885 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 563/1121] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:36:22 2022] GET /identity/v3/users/1488f3854d2d4965ad9423f2407d8327 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:22.562649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bafa0-d437-47d0-86df-65dad8aca32f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:22.662377 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bafa0-d437-47d0-86df-65dad8aca32f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:22.708664 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944ae75-e09a-4109-b0d3-e00e008e3e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:22.709286 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944ae75-e09a-4109-b0d3-e00e008e3e80 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:22.709560 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944ae75-e09a-4109-b0d3-e00e008e3e80 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:22.709828 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944ae75-e09a-4109-b0d3-e00e008e3e80 None admin] PATH_INFO: `/v3/projects/e5968892a2964f8f8c98aae0480fbb20` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:22.710916 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944ae75-e09a-4109-b0d3-e00e008e3e80 None admin] RBAC: Authorizing `identity:get_project(project_id=e5968892a2964f8f8c98aae0480fbb20)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:22.712372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944ae75-e09a-4109-b0d3-e00e008e3e80 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:22.713994 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 559/1122] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:36:22 2022] GET /identity/v3/projects/e5968892a2964f8f8c98aae0480fbb20 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:22.719953 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba848a-6939-47e7-bf44-df4797cfbbae None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:22.818163 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba848a-6939-47e7-bf44-df4797cfbbae None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:22.846461 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:22.852226 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312308c7-72f7-4bb4-8848-45680f2259ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:22.852887 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312308c7-72f7-4bb4-8848-45680f2259ab None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:22.853169 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312308c7-72f7-4bb4-8848-45680f2259ab None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:22.853445 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312308c7-72f7-4bb4-8848-45680f2259ab None admin] PATH_INFO: `/v3/projects/e5968892a2964f8f8c98aae0480fbb20/users/1488f3854d2d4965ad9423f2407d8327/roles/f0d2493c03664449802df928b8e8fa53` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:22.855930 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312308c7-72f7-4bb4-8848-45680f2259ab None admin] RBAC: Authorizing `identity:create_grant(project_id=e5968892a2964f8f8c98aae0480fbb20, user_id=1488f3854d2d4965ad9423f2407d8327, role_id=f0d2493c03664449802df928b8e8fa53)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:22.857502 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312308c7-72f7-4bb4-8848-45680f2259ab None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:22.943174 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 564/1123] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 1 13:36:22 2022] PUT /identity/v3/projects/e5968892a2964f8f8c98aae0480fbb20/users/1488f3854d2d4965ad9423f2407d8327/roles/f0d2493c03664449802df928b8e8fa53 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:36:24.805337 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe565e-0a05-467a-ad60-b83d50899d89 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:24.805906 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe565e-0a05-467a-ad60-b83d50899d89 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:24.805906 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe565e-0a05-467a-ad60-b83d50899d89 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:24.807209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 560/1124] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:36:24.812284 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab7bef-b42c-426f-a9ea-f21613f2b8d3 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:24.812659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab7bef-b42c-426f-a9ea-f21613f2b8d3 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:24.812836 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab7bef-b42c-426f-a9ea-f21613f2b8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:24.830811 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-eaab7bef-b42c-426f-a9ea-f21613f2b8d3 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:36:24.832633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-eaab7bef-b42c-426f-a9ea-f21613f2b8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:36:24.902332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 565/1125] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:36:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:36:25.170456 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe565e-0a05-467a-ad60-b83d50899d89 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:25.229020 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:25.275621 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe565e-0a05-467a-ad60-b83d50899d89 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:25.311595 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de481d-65dc-4bb0-a840-e68e36ab3e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:25.312226 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de481d-65dc-4bb0-a840-e68e36ab3e7b None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:25.312504 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de481d-65dc-4bb0-a840-e68e36ab3e7b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:25.312777 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de481d-65dc-4bb0-a840-e68e36ab3e7b None admin] PATH_INFO: `/v3/roles/f0d2493c03664449802df928b8e8fa53` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:25.314152 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de481d-65dc-4bb0-a840-e68e36ab3e7b None admin] RBAC: Authorizing `identity:get_role(role_id=f0d2493c03664449802df928b8e8fa53)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:25.316130 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de481d-65dc-4bb0-a840-e68e36ab3e7b None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:25.317462 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 561/1126] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:36:25 2022] GET /identity/v3/roles/f0d2493c03664449802df928b8e8fa53 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:25.323263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab7bef-b42c-426f-a9ea-f21613f2b8d3 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:25.418712 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab7bef-b42c-426f-a9ea-f21613f2b8d3 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:25.441220 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:25.452464 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55d0fb-e8d8-402d-b414-fb9b4ffc0060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:25.454872 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55d0fb-e8d8-402d-b414-fb9b4ffc0060 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:25.454872 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55d0fb-e8d8-402d-b414-fb9b4ffc0060 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:25.454872 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55d0fb-e8d8-402d-b414-fb9b4ffc0060 None admin] PATH_INFO: `/v3/users/1488f3854d2d4965ad9423f2407d8327` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:25.454872 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55d0fb-e8d8-402d-b414-fb9b4ffc0060 None admin] RBAC: Authorizing `identity:get_user(user_id=1488f3854d2d4965ad9423f2407d8327)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:25.456228 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55d0fb-e8d8-402d-b414-fb9b4ffc0060 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:25.457795 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 566/1127] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:36:25 2022] GET /identity/v3/users/1488f3854d2d4965ad9423f2407d8327 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:25.463652 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de481d-65dc-4bb0-a840-e68e36ab3e7b None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:25.561490 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de481d-65dc-4bb0-a840-e68e36ab3e7b None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:25.583727 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:25.594865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8f3f6-0c17-4a45-b8df-6dd5a381c22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:25.595494 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8f3f6-0c17-4a45-b8df-6dd5a381c22c None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:25.595779 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8f3f6-0c17-4a45-b8df-6dd5a381c22c None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:25.596055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8f3f6-0c17-4a45-b8df-6dd5a381c22c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:25.664649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8f3f6-0c17-4a45-b8df-6dd5a381c22c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:25.666099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8f3f6-0c17-4a45-b8df-6dd5a381c22c None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:25.760093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 562/1128] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:36:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:36:25.765992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55d0fb-e8d8-402d-b414-fb9b4ffc0060 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:25.864470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55d0fb-e8d8-402d-b414-fb9b4ffc0060 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:25.897658 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c13816-f420-4960-a181-3865cf182744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:25.898276 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c13816-f420-4960-a181-3865cf182744 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:25.898558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c13816-f420-4960-a181-3865cf182744 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:25.898832 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c13816-f420-4960-a181-3865cf182744 None admin] PATH_INFO: `/v3/projects/e5968892a2964f8f8c98aae0480fbb20` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:25.899951 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c13816-f420-4960-a181-3865cf182744 None admin] RBAC: Authorizing `identity:get_project(project_id=e5968892a2964f8f8c98aae0480fbb20)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:25.901374 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c13816-f420-4960-a181-3865cf182744 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:25.902993 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 567/1129] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:36:25 2022] GET /identity/v3/projects/e5968892a2964f8f8c98aae0480fbb20 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:25.909755 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8f3f6-0c17-4a45-b8df-6dd5a381c22c None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:25.932660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:26.005147 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8f3f6-0c17-4a45-b8df-6dd5a381c22c None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:26.037478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a89e5-6da7-4446-9aba-5881d4d8c2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:26.038064 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a89e5-6da7-4446-9aba-5881d4d8c2ae None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:26.038340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a89e5-6da7-4446-9aba-5881d4d8c2ae None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:26.038608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a89e5-6da7-4446-9aba-5881d4d8c2ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:26.039313 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a89e5-6da7-4446-9aba-5881d4d8c2ae None admin] RBAC: Adding query filter params (role.id=f0d2493c03664449802df928b8e8fa53, scope.project.id=e5968892a2964f8f8c98aae0480fbb20, user.id=1488f3854d2d4965ad9423f2407d8327) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:26.039649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a89e5-6da7-4446-9aba-5881d4d8c2ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:26.041060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a89e5-6da7-4446-9aba-5881d4d8c2ae None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:26.046564 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 563/1130] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:36:25 2022] GET /identity/v3/role_assignments?user.id=1488f3854d2d4965ad9423f2407d8327&scope.project.id=e5968892a2964f8f8c98aae0480fbb20&role.id=f0d2493c03664449802df928b8e8fa53 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:27.961176 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41300d-bcbd-4627-8e77-a7e0ef79c718 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:27.961695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41300d-bcbd-4627-8e77-a7e0ef79c718 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:27.962005 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41300d-bcbd-4627-8e77-a7e0ef79c718 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:27.963505 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 568/1131] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:36:27.968645 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93635aec-0da6-46c9-8cda-534644cd3dd6 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:27.969029 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93635aec-0da6-46c9-8cda-534644cd3dd6 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:27.969185 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93635aec-0da6-46c9-8cda-534644cd3dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:27.987760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-93635aec-0da6-46c9-8cda-534644cd3dd6 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:36:27.988950 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-93635aec-0da6-46c9-8cda-534644cd3dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:36:28.052478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 564/1132] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:36:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:36:28.317401 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41300d-bcbd-4627-8e77-a7e0ef79c718 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:28.376583 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:28.418109 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41300d-bcbd-4627-8e77-a7e0ef79c718 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:28.450382 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca777e-a29b-40aa-8ec3-c1a985af0b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:28.450996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca777e-a29b-40aa-8ec3-c1a985af0b1e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:28.451277 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca777e-a29b-40aa-8ec3-c1a985af0b1e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:28.451574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca777e-a29b-40aa-8ec3-c1a985af0b1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:28.452670 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca777e-a29b-40aa-8ec3-c1a985af0b1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:28.454093 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca777e-a29b-40aa-8ec3-c1a985af0b1e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:28.455727 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 569/1133] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:36:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:28.461601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93635aec-0da6-46c9-8cda-534644cd3dd6 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:28.479126 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:28.559631 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93635aec-0da6-46c9-8cda-534644cd3dd6 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:28.592406 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684452df-e08b-4c9b-b5b8-613873c3dd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:28.592966 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684452df-e08b-4c9b-b5b8-613873c3dd31 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:28.593245 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684452df-e08b-4c9b-b5b8-613873c3dd31 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:28.593517 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684452df-e08b-4c9b-b5b8-613873c3dd31 None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:28.594152 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684452df-e08b-4c9b-b5b8-613873c3dd31 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:28.595599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684452df-e08b-4c9b-b5b8-613873c3dd31 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:28.713510 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 565/1134] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Sep 1 13:36:28 2022] POST /identity/v3/projects => generated 311 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:36:30.642470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d77127-aa5c-4f80-9520-590cd3ba0ca3 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:30.643007 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d77127-aa5c-4f80-9520-590cd3ba0ca3 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:30.643116 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d77127-aa5c-4f80-9520-590cd3ba0ca3 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:30.644932 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 570/1135] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:36:30.650106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8f877-8fea-49ed-8a8c-b918455b58aa None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:30.650527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8f877-8fea-49ed-8a8c-b918455b58aa None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:30.650637 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8f877-8fea-49ed-8a8c-b918455b58aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:30.668490 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-c5e8f877-8fea-49ed-8a8c-b918455b58aa None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:36:30.669654 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c5e8f877-8fea-49ed-8a8c-b918455b58aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:36:30.729294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:30.734825 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 566/1136] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:36:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:36:31.000028 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d77127-aa5c-4f80-9520-590cd3ba0ca3 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:31.099611 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d77127-aa5c-4f80-9520-590cd3ba0ca3 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:31.124688 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:31.133033 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b119f9c-2993-40bf-a45b-2e599e47550a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:31.133678 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b119f9c-2993-40bf-a45b-2e599e47550a None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:31.137936 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b119f9c-2993-40bf-a45b-2e599e47550a None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:31.137936 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b119f9c-2993-40bf-a45b-2e599e47550a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:31.137936 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b119f9c-2993-40bf-a45b-2e599e47550a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:31.137936 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b119f9c-2993-40bf-a45b-2e599e47550a None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:31.138283 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 571/1137] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:36:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:31.144566 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8f877-8fea-49ed-8a8c-b918455b58aa None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:31.241331 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8f877-8fea-49ed-8a8c-b918455b58aa None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:31.275268 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf360e5-3216-4ced-a399-edc8d40cadf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:31.275820 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf360e5-3216-4ced-a399-edc8d40cadf2 None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:31.276093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf360e5-3216-4ced-a399-edc8d40cadf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:31.276362 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf360e5-3216-4ced-a399-edc8d40cadf2 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:31.276997 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf360e5-3216-4ced-a399-edc8d40cadf2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:31.278425 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf360e5-3216-4ced-a399-edc8d40cadf2 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:31.357653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 567/1138] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 1 13:36:31 2022] POST /identity/v3/users => generated 286 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:36:33.309865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b90b1-e1ea-4c68-91c6-c26c5f590630 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:33.310389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b90b1-e1ea-4c68-91c6-c26c5f590630 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:33.310389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b90b1-e1ea-4c68-91c6-c26c5f590630 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:33.311761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 572/1139] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:36:33.317027 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95450876-2267-4dd5-845c-7d48317c8706 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:33.317404 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95450876-2267-4dd5-845c-7d48317c8706 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:33.317577 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95450876-2267-4dd5-845c-7d48317c8706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:33.336056 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-95450876-2267-4dd5-845c-7d48317c8706 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:36:33.337244 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-95450876-2267-4dd5-845c-7d48317c8706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:36:33.385723 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:33.403080 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 568/1140] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:36:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:36:33.676231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b90b1-e1ea-4c68-91c6-c26c5f590630 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:33.776575 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b90b1-e1ea-4c68-91c6-c26c5f590630 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:33.810612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89816024-0725-4443-9eda-ede087f5cbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:33.811232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89816024-0725-4443-9eda-ede087f5cbac None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:33.811537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89816024-0725-4443-9eda-ede087f5cbac None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:33.811807 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89816024-0725-4443-9eda-ede087f5cbac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:33.821867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89816024-0725-4443-9eda-ede087f5cbac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:36:33.826545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-89816024-0725-4443-9eda-ede087f5cbac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:36:33.826545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:33.826545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:36:33.826545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:36:33.826545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:36:33.826545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:36:33.826545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:36:33.826545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:36:33.826545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:36:33.826545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:36:33.826545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:36:33.826545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:36:33.826545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:36:33.826545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:36:33.826545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:36:33.826545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:36:33.827629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:36:33.827629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:36:33.827629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:36:33.827629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:36:33.827629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:36:33.827629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:36:33.827629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:36:33.827629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:36:33.827629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:36:33.827629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:36:33.827629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:36:33.827629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:36:33.827629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:36:33.827629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:36:33.827629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:36:33.827629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:36:33.828515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:36:33.828515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:36:33.828515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:36:33.828515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:36:33.828515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:36:33.828515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:36:33.828515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:36:33.828515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:36:33.828515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:36:33.828515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:36:33.828515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:36:33.828515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:36:33.828515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 573/1141] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:36:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:36:33.834323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95450876-2267-4dd5-845c-7d48317c8706 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:33.933548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95450876-2267-4dd5-845c-7d48317c8706 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:33.966743 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf59031-f819-4029-9bd5-08a08d62915f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:33.967390 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf59031-f819-4029-9bd5-08a08d62915f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:33.967653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf59031-f819-4029-9bd5-08a08d62915f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:33.967924 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf59031-f819-4029-9bd5-08a08d62915f None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:33.968581 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf59031-f819-4029-9bd5-08a08d62915f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:33.968883 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf59031-f819-4029-9bd5-08a08d62915f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:33.970258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf59031-f819-4029-9bd5-08a08d62915f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:33.978942 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 569/1142] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:36:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:33.985047 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89816024-0725-4443-9eda-ede087f5cbac None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:34.039171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:34.081879 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89816024-0725-4443-9eda-ede087f5cbac None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:34.114475 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da933a0b-396d-4d32-928a-796b43ab64f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:34.115083 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da933a0b-396d-4d32-928a-796b43ab64f0 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:34.115373 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da933a0b-396d-4d32-928a-796b43ab64f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:34.115657 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da933a0b-396d-4d32-928a-796b43ab64f0 None admin] PATH_INFO: `/v3/users/4a2f5ec8427644a1b5eeb6e6dc8cf134` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:34.128404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da933a0b-396d-4d32-928a-796b43ab64f0 None admin] RBAC: Authorizing `identity:get_user(user_id=4a2f5ec8427644a1b5eeb6e6dc8cf134)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:34.129841 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da933a0b-396d-4d32-928a-796b43ab64f0 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:34.131471 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 574/1143] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:36:33 2022] GET /identity/v3/users/4a2f5ec8427644a1b5eeb6e6dc8cf134 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:34.137479 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf59031-f819-4029-9bd5-08a08d62915f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:34.183951 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:34.238014 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf59031-f819-4029-9bd5-08a08d62915f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:34.271293 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617447a-3d01-4e36-988e-244fa47e32c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:34.271924 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617447a-3d01-4e36-988e-244fa47e32c5 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:34.272205 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617447a-3d01-4e36-988e-244fa47e32c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:34.272486 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617447a-3d01-4e36-988e-244fa47e32c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:34.338402 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617447a-3d01-4e36-988e-244fa47e32c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:34.339897 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617447a-3d01-4e36-988e-244fa47e32c5 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:34.383537 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:34.435296 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 570/1144] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:36:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:36:34.441660 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da933a0b-396d-4d32-928a-796b43ab64f0 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:34.539734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da933a0b-396d-4d32-928a-796b43ab64f0 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:34.554056 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:34.574199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d412ef-99cf-4f86-85fb-133aad446e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:34.579384 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d412ef-99cf-4f86-85fb-133aad446e64 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:34.579384 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d412ef-99cf-4f86-85fb-133aad446e64 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:34.579384 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d412ef-99cf-4f86-85fb-133aad446e64 None admin] PATH_INFO: `/v3/projects/9e362b44e3b3447c909ce51c91366468` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:34.579384 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d412ef-99cf-4f86-85fb-133aad446e64 None admin] RBAC: Authorizing `identity:get_project(project_id=9e362b44e3b3447c909ce51c91366468)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:34.579384 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d412ef-99cf-4f86-85fb-133aad446e64 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:34.579882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 575/1145] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:36:34 2022] GET /identity/v3/projects/9e362b44e3b3447c909ce51c91366468 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:34.586248 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617447a-3d01-4e36-988e-244fa47e32c5 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:34.683593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617447a-3d01-4e36-988e-244fa47e32c5 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:34.716779 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a3d3f-8113-4853-bb39-697b914ae704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:34.717302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a3d3f-8113-4853-bb39-697b914ae704 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:34.717577 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a3d3f-8113-4853-bb39-697b914ae704 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:34.717845 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a3d3f-8113-4853-bb39-697b914ae704 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:34.718557 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a3d3f-8113-4853-bb39-697b914ae704 None admin] RBAC: Adding query filter params (role.id=98ffd3c114804da292d7cb33721e9085, scope.project.id=9e362b44e3b3447c909ce51c91366468, user.id=4a2f5ec8427644a1b5eeb6e6dc8cf134) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:34.718860 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a3d3f-8113-4853-bb39-697b914ae704 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:34.720315 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a3d3f-8113-4853-bb39-697b914ae704 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:34.726105 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 571/1146] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:36:34 2022] GET /identity/v3/role_assignments?user.id=4a2f5ec8427644a1b5eeb6e6dc8cf134&scope.project.id=9e362b44e3b3447c909ce51c91366468&role.id=98ffd3c114804da292d7cb33721e9085 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:36.575914 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb174a1-fb2c-437d-8105-81393da51666 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:36.576461 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb174a1-fb2c-437d-8105-81393da51666 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:36.576461 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb174a1-fb2c-437d-8105-81393da51666 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:36.577779 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 576/1147] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:36:36.583130 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321e10a-1df6-497d-982a-193736a951a6 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:36.583591 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321e10a-1df6-497d-982a-193736a951a6 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:36.583689 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321e10a-1df6-497d-982a-193736a951a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:36.601875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-9321e10a-1df6-497d-982a-193736a951a6 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:36:36.603038 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-9321e10a-1df6-497d-982a-193736a951a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:36:36.606021 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:36.667988 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 572/1148] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:36:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:36:36.936144 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb174a1-fb2c-437d-8105-81393da51666 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:37.036317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb174a1-fb2c-437d-8105-81393da51666 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:37.068072 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde4d83-4b00-4412-bb33-7d1c22a8a80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:37.068685 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde4d83-4b00-4412-bb33-7d1c22a8a80e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:37.068963 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde4d83-4b00-4412-bb33-7d1c22a8a80e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:37.069232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde4d83-4b00-4412-bb33-7d1c22a8a80e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:37.078825 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde4d83-4b00-4412-bb33-7d1c22a8a80e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:36:37.084066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-adde4d83-4b00-4412-bb33-7d1c22a8a80e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:36:37.084066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:37.084066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:36:37.084066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:36:37.084066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:36:37.084066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:36:37.084066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:36:37.084066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:36:37.084066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:36:37.084066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:36:37.084066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:36:37.084066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:36:37.084066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:36:37.084066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:36:37.084066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:36:37.084066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:36:37.085131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:36:37.085131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:36:37.085131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:36:37.085131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:36:37.085131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:36:37.085131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:36:37.085131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:36:37.085131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:36:37.085131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:36:37.085131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:36:37.085131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:36:37.085131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:36:37.085131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:36:37.085131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:36:37.085131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:36:37.085131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:36:37.086133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:36:37.086133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:36:37.086133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:36:37.086133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:36:37.086133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:36:37.086133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:36:37.086133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:36:37.086133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:36:37.086133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:36:37.086133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:36:37.086133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:36:37.086133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:36:37.086133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 577/1149] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:36:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:36:37.091228 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321e10a-1df6-497d-982a-193736a951a6 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:37.187086 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321e10a-1df6-497d-982a-193736a951a6 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:37.220377 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b49200-f995-4df4-afeb-8edca57e7131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:37.221003 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b49200-f995-4df4-afeb-8edca57e7131 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:37.221281 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b49200-f995-4df4-afeb-8edca57e7131 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:37.221552 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b49200-f995-4df4-afeb-8edca57e7131 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:37.222212 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b49200-f995-4df4-afeb-8edca57e7131 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:37.222513 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b49200-f995-4df4-afeb-8edca57e7131 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:37.223924 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b49200-f995-4df4-afeb-8edca57e7131 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:37.232109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 573/1150] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:36:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:37.237895 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde4d83-4b00-4412-bb33-7d1c22a8a80e None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:37.281813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:37.340338 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde4d83-4b00-4412-bb33-7d1c22a8a80e None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:37.378191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa112608-617d-4c8a-a469-56b025d6405b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:37.378805 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa112608-617d-4c8a-a469-56b025d6405b None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:37.379088 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa112608-617d-4c8a-a469-56b025d6405b None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:37.379441 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa112608-617d-4c8a-a469-56b025d6405b None admin] PATH_INFO: `/v3/users/4a2f5ec8427644a1b5eeb6e6dc8cf134` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:37.380488 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa112608-617d-4c8a-a469-56b025d6405b None admin] RBAC: Authorizing `identity:get_user(user_id=4a2f5ec8427644a1b5eeb6e6dc8cf134)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:37.381933 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa112608-617d-4c8a-a469-56b025d6405b None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:37.383521 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 578/1151] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:36:37 2022] GET /identity/v3/users/4a2f5ec8427644a1b5eeb6e6dc8cf134 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:37.389481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b49200-f995-4df4-afeb-8edca57e7131 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:37.392366 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:37.492281 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b49200-f995-4df4-afeb-8edca57e7131 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:37.526739 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1412c5-3cb0-4fa9-80fd-8430799ab970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:37.527418 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1412c5-3cb0-4fa9-80fd-8430799ab970 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:37.527744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1412c5-3cb0-4fa9-80fd-8430799ab970 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:37.528045 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1412c5-3cb0-4fa9-80fd-8430799ab970 None admin] PATH_INFO: `/v3/projects/9e362b44e3b3447c909ce51c91366468` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:37.529162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1412c5-3cb0-4fa9-80fd-8430799ab970 None admin] RBAC: Authorizing `identity:get_project(project_id=9e362b44e3b3447c909ce51c91366468)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:37.530603 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1412c5-3cb0-4fa9-80fd-8430799ab970 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:37.532286 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 574/1152] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:36:37 2022] GET /identity/v3/projects/9e362b44e3b3447c909ce51c91366468 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:37.538788 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa112608-617d-4c8a-a469-56b025d6405b None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:37.639548 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa112608-617d-4c8a-a469-56b025d6405b None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:37.648116 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:37.672027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c415d1-dffd-4125-9aa9-384cff82b750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:37.672661 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c415d1-dffd-4125-9aa9-384cff82b750 None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:37.672940 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c415d1-dffd-4125-9aa9-384cff82b750 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:37.673213 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c415d1-dffd-4125-9aa9-384cff82b750 None admin] PATH_INFO: `/v3/projects/9e362b44e3b3447c909ce51c91366468/users/4a2f5ec8427644a1b5eeb6e6dc8cf134/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:37.675628 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c415d1-dffd-4125-9aa9-384cff82b750 None admin] RBAC: Authorizing `identity:create_grant(project_id=9e362b44e3b3447c909ce51c91366468, user_id=4a2f5ec8427644a1b5eeb6e6dc8cf134, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:37.677044 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c415d1-dffd-4125-9aa9-384cff82b750 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:37.764490 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 579/1153] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 1 13:36:37 2022] PUT /identity/v3/projects/9e362b44e3b3447c909ce51c91366468/users/4a2f5ec8427644a1b5eeb6e6dc8cf134/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:36:39.650948 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26556d3b-86df-4697-bb3d-e6a48f3b8c8f None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:39.651500 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26556d3b-86df-4697-bb3d-e6a48f3b8c8f None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:39.651612 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26556d3b-86df-4697-bb3d-e6a48f3b8c8f None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:39.652946 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 575/1154] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:36:39.658676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9f35a-dc3a-42ae-972f-2442689dbe0d None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:39.659084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9f35a-dc3a-42ae-972f-2442689dbe0d None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:39.659218 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9f35a-dc3a-42ae-972f-2442689dbe0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:39.677363 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-b3d9f35a-dc3a-42ae-972f-2442689dbe0d None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:36:39.678528 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b3d9f35a-dc3a-42ae-972f-2442689dbe0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:36:39.744037 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 580/1155] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:36:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:36:40.010082 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26556d3b-86df-4697-bb3d-e6a48f3b8c8f None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:40.083298 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:40.117078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26556d3b-86df-4697-bb3d-e6a48f3b8c8f None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:40.149852 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ac210-03a3-4ef7-9e84-1dcd438c172f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:40.150465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ac210-03a3-4ef7-9e84-1dcd438c172f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:40.150745 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ac210-03a3-4ef7-9e84-1dcd438c172f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:40.151012 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ac210-03a3-4ef7-9e84-1dcd438c172f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:40.161369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ac210-03a3-4ef7-9e84-1dcd438c172f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:36:40.166483 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-d29ac210-03a3-4ef7-9e84-1dcd438c172f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:36:40.166483 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:40.166483 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:36:40.166483 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:36:40.166483 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:36:40.166483 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:36:40.166483 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:36:40.166483 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:36:40.166483 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:36:40.166483 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:36:40.166483 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:36:40.166483 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:36:40.166483 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:36:40.166483 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:36:40.166483 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:36:40.166483 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:36:40.167662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:36:40.167662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:36:40.167662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:36:40.167662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:36:40.167662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:36:40.167662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:36:40.167662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:36:40.167662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:36:40.167662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:36:40.167662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:36:40.167662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:36:40.167662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:36:40.167662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:36:40.167662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:36:40.167662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:36:40.167662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:36:40.168658 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:36:40.168658 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:36:40.168658 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:36:40.168658 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:36:40.168658 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:36:40.168658 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:36:40.168658 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:36:40.168658 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:36:40.168658 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:36:40.168658 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:36:40.168658 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:36:40.168658 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:36:40.168658 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 576/1156] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:36:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:36:40.173713 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9f35a-dc3a-42ae-972f-2442689dbe0d None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:40.269284 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:40.272816 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9f35a-dc3a-42ae-972f-2442689dbe0d None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:40.305487 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c44e8-82e2-494e-8806-94d8668d152b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:40.306084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c44e8-82e2-494e-8806-94d8668d152b None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:40.306359 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c44e8-82e2-494e-8806-94d8668d152b None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:40.306628 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c44e8-82e2-494e-8806-94d8668d152b None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:40.307288 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c44e8-82e2-494e-8806-94d8668d152b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:40.307616 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c44e8-82e2-494e-8806-94d8668d152b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:40.309007 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c44e8-82e2-494e-8806-94d8668d152b None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:40.318771 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 581/1157] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:36:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:40.327441 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ac210-03a3-4ef7-9e84-1dcd438c172f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:40.421289 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ac210-03a3-4ef7-9e84-1dcd438c172f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:40.448132 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:40.453633 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573974f-665a-4528-a8f9-dcb506a449b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:40.454245 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573974f-665a-4528-a8f9-dcb506a449b3 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:40.454519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573974f-665a-4528-a8f9-dcb506a449b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:40.454843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573974f-665a-4528-a8f9-dcb506a449b3 None admin] PATH_INFO: `/v3/users/4a2f5ec8427644a1b5eeb6e6dc8cf134` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:40.467978 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573974f-665a-4528-a8f9-dcb506a449b3 None admin] RBAC: Authorizing `identity:get_user(user_id=4a2f5ec8427644a1b5eeb6e6dc8cf134)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:40.467978 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573974f-665a-4528-a8f9-dcb506a449b3 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:40.467978 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 577/1158] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:36:40 2022] GET /identity/v3/users/4a2f5ec8427644a1b5eeb6e6dc8cf134 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:40.468236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c44e8-82e2-494e-8806-94d8668d152b None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:40.561692 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c44e8-82e2-494e-8806-94d8668d152b None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:40.594260 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb6ddb-5d25-4f0d-8d23-0ee6910fd89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:40.594850 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb6ddb-5d25-4f0d-8d23-0ee6910fd89a None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:40.595123 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb6ddb-5d25-4f0d-8d23-0ee6910fd89a None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:40.595446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb6ddb-5d25-4f0d-8d23-0ee6910fd89a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:40.622274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:40.660800 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb6ddb-5d25-4f0d-8d23-0ee6910fd89a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:40.662236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb6ddb-5d25-4f0d-8d23-0ee6910fd89a None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:40.755044 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 582/1159] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:36:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:36:40.761060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573974f-665a-4528-a8f9-dcb506a449b3 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:40.864110 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573974f-665a-4528-a8f9-dcb506a449b3 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:40.897485 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dc00f-e3e8-4b0c-9650-da975433e739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:40.898113 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dc00f-e3e8-4b0c-9650-da975433e739 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:40.898392 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dc00f-e3e8-4b0c-9650-da975433e739 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:40.898662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dc00f-e3e8-4b0c-9650-da975433e739 None admin] PATH_INFO: `/v3/projects/9e362b44e3b3447c909ce51c91366468` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:40.899784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17dc00f-e3e8-4b0c-9650-da975433e739 None admin] RBAC: Authorizing `identity:get_project(project_id=9e362b44e3b3447c909ce51c91366468)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:40.901217 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17dc00f-e3e8-4b0c-9650-da975433e739 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:40.902833 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 578/1160] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:36:40 2022] GET /identity/v3/projects/9e362b44e3b3447c909ce51c91366468 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:40.909066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb6ddb-5d25-4f0d-8d23-0ee6910fd89a None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:40.965445 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:41.005192 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb6ddb-5d25-4f0d-8d23-0ee6910fd89a None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:41.037798 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc217dcb-ce3d-4740-b882-0a6d278e213b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:41.038394 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc217dcb-ce3d-4740-b882-0a6d278e213b None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:41.038672 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc217dcb-ce3d-4740-b882-0a6d278e213b None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:41.038944 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc217dcb-ce3d-4740-b882-0a6d278e213b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:41.039689 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc217dcb-ce3d-4740-b882-0a6d278e213b None admin] RBAC: Adding query filter params (role.id=98ffd3c114804da292d7cb33721e9085, scope.project.id=9e362b44e3b3447c909ce51c91366468, user.id=4a2f5ec8427644a1b5eeb6e6dc8cf134) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:41.039995 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc217dcb-ce3d-4740-b882-0a6d278e213b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:41.041411 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc217dcb-ce3d-4740-b882-0a6d278e213b None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:41.047176 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 583/1161] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:36:40 2022] GET /identity/v3/role_assignments?user.id=4a2f5ec8427644a1b5eeb6e6dc8cf134&scope.project.id=9e362b44e3b3447c909ce51c91366468&role.id=98ffd3c114804da292d7cb33721e9085 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:42.940696 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7026f-22ea-4c44-8f04-3f3ce4a5f37b None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:42.941229 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7026f-22ea-4c44-8f04-3f3ce4a5f37b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:42.941229 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7026f-22ea-4c44-8f04-3f3ce4a5f37b None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:42.942583 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 579/1162] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:36:42.947642 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d847f-c911-4ac0-b409-325cc00cc521 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:42.948067 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d847f-c911-4ac0-b409-325cc00cc521 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:42.948189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d847f-c911-4ac0-b409-325cc00cc521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:42.966962 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-910d847f-c911-4ac0-b409-325cc00cc521 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:36:42.968170 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-910d847f-c911-4ac0-b409-325cc00cc521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:36:43.032368 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 584/1163] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:36:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:36:43.298851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7026f-22ea-4c44-8f04-3f3ce4a5f37b None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:43.363627 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:43.397702 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7026f-22ea-4c44-8f04-3f3ce4a5f37b None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:43.431242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234c8ea-171c-419e-bf0b-67f74bc92ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:43.431911 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234c8ea-171c-419e-bf0b-67f74bc92ff5 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:43.432193 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234c8ea-171c-419e-bf0b-67f74bc92ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:43.432464 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234c8ea-171c-419e-bf0b-67f74bc92ff5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:43.497983 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234c8ea-171c-419e-bf0b-67f74bc92ff5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:43.499461 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234c8ea-171c-419e-bf0b-67f74bc92ff5 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:43.566477 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:43.602278 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 580/1164] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:36:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:36:43.608552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d847f-c911-4ac0-b409-325cc00cc521 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:43.662207 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:43.706579 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d847f-c911-4ac0-b409-325cc00cc521 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:43.739585 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402edf9c-04fc-44ef-8b4c-323d31e6c3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:43.740210 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402edf9c-04fc-44ef-8b4c-323d31e6c3c8 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:43.740489 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402edf9c-04fc-44ef-8b4c-323d31e6c3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:43.740760 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402edf9c-04fc-44ef-8b4c-323d31e6c3c8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:43.747218 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402edf9c-04fc-44ef-8b4c-323d31e6c3c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:43.748685 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402edf9c-04fc-44ef-8b4c-323d31e6c3c8 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:43.759834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-402edf9c-04fc-44ef-8b4c-323d31e6c3c8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 13:36:43.759834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:43.759834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 01 13:36:43.759834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 01 13:36:43.759834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:36:43.759834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:36:43.759834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:36:43.759834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:36:43.759834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 01 13:36:43.759834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:36:43.759834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:36:43.759834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:36:43.759834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:43.759834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:36:43.759834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:36:43.759834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:36:43.759834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:36:43.760988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:36:43.760988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:36:43.760988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:36:43.760988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:36:43.760988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:36:43.760988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:36:43.760988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:36:43.760988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:36:43.760988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:36:43.760988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:36:43.760988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:36:43.760988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:36:43.760988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:36:43.760988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:36:43.760988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:36:43.760988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:36:43.761847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:36:43.761847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:36:43.761847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:36:43.761847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:36:43.761847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:36:43.761847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:36:43.761847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:36:43.761847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:36:43.761847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:36:43.761847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:36:43.761847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 01 13:36:43.761847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:36:43.761847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 13:36:43.761847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:36:43.761847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 585/1165] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Sep 1 13:36:43 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:36:43.767474 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234c8ea-171c-419e-bf0b-67f74bc92ff5 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:43.867861 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234c8ea-171c-419e-bf0b-67f74bc92ff5 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:43.901461 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d2d12-ad5e-4332-a081-04b58af5f58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:43.902055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d2d12-ad5e-4332-a081-04b58af5f58c None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:43.902331 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d2d12-ad5e-4332-a081-04b58af5f58c None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:43.902603 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d2d12-ad5e-4332-a081-04b58af5f58c None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:43.903233 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d2d12-ad5e-4332-a081-04b58af5f58c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:43.903573 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d2d12-ad5e-4332-a081-04b58af5f58c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:43.904949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d2d12-ad5e-4332-a081-04b58af5f58c None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:43.912802 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 581/1166] 10.222.0.50 () {56 vars in 1115 bytes} [Thu Sep 1 13:36:43 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:45.792204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79846beb-12c6-46a1-8a56-115b0af4925c None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:45.792767 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79846beb-12c6-46a1-8a56-115b0af4925c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:45.792767 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79846beb-12c6-46a1-8a56-115b0af4925c None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:45.794073 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 586/1167] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:36:45.799961 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc564d3-8eec-4262-8cc4-0c31edb46985 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:45.800419 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc564d3-8eec-4262-8cc4-0c31edb46985 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:45.800506 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc564d3-8eec-4262-8cc4-0c31edb46985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:45.818878 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-fbc564d3-8eec-4262-8cc4-0c31edb46985 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:36:45.820093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-fbc564d3-8eec-4262-8cc4-0c31edb46985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:36:45.843451 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:45.887684 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 582/1168] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:36:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:36:46.152579 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79846beb-12c6-46a1-8a56-115b0af4925c None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:46.253018 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79846beb-12c6-46a1-8a56-115b0af4925c None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:46.266419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:46.286325 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18466f4-a6a0-4127-ae6e-c914dc944261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:46.286936 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18466f4-a6a0-4127-ae6e-c914dc944261 None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:46.287219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18466f4-a6a0-4127-ae6e-c914dc944261 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:46.287529 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18466f4-a6a0-4127-ae6e-c914dc944261 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:46.288218 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18466f4-a6a0-4127-ae6e-c914dc944261 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:46.289594 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18466f4-a6a0-4127-ae6e-c914dc944261 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:46.355191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 587/1169] 10.222.0.50 () {60 vars in 1138 bytes} [Thu Sep 1 13:36:46 2022] POST /identity/v3/domains => generated 267 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:36:48.257945 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616facd-0c55-42ed-a28f-cd2bad5e0003 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:48.258463 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616facd-0c55-42ed-a28f-cd2bad5e0003 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:48.258463 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616facd-0c55-42ed-a28f-cd2bad5e0003 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:48.259787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 583/1170] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:36:48.264855 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e692811-3e05-437a-a27f-e627bf8842dc None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:48.265245 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e692811-3e05-437a-a27f-e627bf8842dc None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:48.265399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e692811-3e05-437a-a27f-e627bf8842dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:48.284094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-7e692811-3e05-437a-a27f-e627bf8842dc None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:36:48.285254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-7e692811-3e05-437a-a27f-e627bf8842dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:36:48.349860 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 588/1171] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:36:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:36:48.620005 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616facd-0c55-42ed-a28f-cd2bad5e0003 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:48.722773 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616facd-0c55-42ed-a28f-cd2bad5e0003 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:48.755882 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ae7f9-8647-4efc-932a-4b7f44b4687b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:48.756501 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ae7f9-8647-4efc-932a-4b7f44b4687b None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:48.756781 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ae7f9-8647-4efc-932a-4b7f44b4687b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:48.757054 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ae7f9-8647-4efc-932a-4b7f44b4687b None admin] PATH_INFO: `/v3/domains/a131fbcdb88a4e2f97a76d0a085c37d1` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:48.768312 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ae7f9-8647-4efc-932a-4b7f44b4687b None admin] RBAC: Authorizing `identity:get_domain(domain_id=a131fbcdb88a4e2f97a76d0a085c37d1)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:48.769769 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ae7f9-8647-4efc-932a-4b7f44b4687b None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:48.771406 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 584/1172] 10.222.0.50 () {56 vars in 1183 bytes} [Thu Sep 1 13:36:48 2022] GET /identity/v3/domains/a131fbcdb88a4e2f97a76d0a085c37d1 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:48.777272 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e692811-3e05-437a-a27f-e627bf8842dc None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:48.874521 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e692811-3e05-437a-a27f-e627bf8842dc None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:48.877280 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:48.908050 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43b0fa-f2c2-46f2-acfa-f6fd7c6ec3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:48.908765 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43b0fa-f2c2-46f2-acfa-f6fd7c6ec3f9 None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:48.909048 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43b0fa-f2c2-46f2-acfa-f6fd7c6ec3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:48.909314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43b0fa-f2c2-46f2-acfa-f6fd7c6ec3f9 None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:48.909959 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43b0fa-f2c2-46f2-acfa-f6fd7c6ec3f9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:48.911392 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43b0fa-f2c2-46f2-acfa-f6fd7c6ec3f9 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:49.009095 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 589/1173] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Sep 1 13:36:48 2022] POST /identity/v3/projects => generated 361 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:36:50.937606 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d27e6c-907b-42a3-9f2b-62b2c19559cc None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:50.938150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d27e6c-907b-42a3-9f2b-62b2c19559cc None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:50.938150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d27e6c-907b-42a3-9f2b-62b2c19559cc None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:50.940013 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 585/1174] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:36:50.945108 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44da9d-306b-48d3-bea5-c5b90efcee55 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:50.945548 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44da9d-306b-48d3-bea5-c5b90efcee55 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:50.945672 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44da9d-306b-48d3-bea5-c5b90efcee55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:50.964419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-4e44da9d-306b-48d3-bea5-c5b90efcee55 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:36:50.965650 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-4e44da9d-306b-48d3-bea5-c5b90efcee55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:36:51.034911 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 590/1175] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:36:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:36:51.304807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d27e6c-907b-42a3-9f2b-62b2c19559cc None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:51.327471 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:51.410173 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d27e6c-907b-42a3-9f2b-62b2c19559cc None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:51.445331 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f212b-9d06-47ac-9588-885190c40cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:51.445956 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f212b-9d06-47ac-9588-885190c40cce None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:51.446229 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f212b-9d06-47ac-9588-885190c40cce None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:51.446496 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f212b-9d06-47ac-9588-885190c40cce None admin] PATH_INFO: `/v3/domains/a131fbcdb88a4e2f97a76d0a085c37d1` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:51.447613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f212b-9d06-47ac-9588-885190c40cce None admin] RBAC: Authorizing `identity:get_domain(domain_id=a131fbcdb88a4e2f97a76d0a085c37d1)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:51.449145 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f212b-9d06-47ac-9588-885190c40cce None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:51.450710 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 586/1176] 10.222.0.50 () {56 vars in 1183 bytes} [Thu Sep 1 13:36:51 2022] GET /identity/v3/domains/a131fbcdb88a4e2f97a76d0a085c37d1 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:51.456635 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44da9d-306b-48d3-bea5-c5b90efcee55 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:51.543218 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:51.558739 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44da9d-306b-48d3-bea5-c5b90efcee55 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:51.591906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c9283-e540-4f15-aecc-ba7612827323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:51.592769 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c9283-e540-4f15-aecc-ba7612827323 None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:51.593097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c9283-e540-4f15-aecc-ba7612827323 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:51.593512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c9283-e540-4f15-aecc-ba7612827323 None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:51.594515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c9283-e540-4f15-aecc-ba7612827323 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:51.596473 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c9283-e540-4f15-aecc-ba7612827323 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:51.693598 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 591/1177] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 1 13:36:51 2022] POST /identity/v3/users => generated 311 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:36:53.637034 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7dc7d1-6a09-4e61-a169-fde6bfbca5d9 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:53.637630 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7dc7d1-6a09-4e61-a169-fde6bfbca5d9 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:53.637630 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7dc7d1-6a09-4e61-a169-fde6bfbca5d9 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:53.638896 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 587/1178] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:36:53.644641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385c965-548a-4c6a-b328-4848b2e98184 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:53.645062 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385c965-548a-4c6a-b328-4848b2e98184 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:53.645178 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385c965-548a-4c6a-b328-4848b2e98184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:53.663786 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-3385c965-548a-4c6a-b328-4848b2e98184 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:36:53.664970 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-3385c965-548a-4c6a-b328-4848b2e98184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:36:53.730579 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 592/1179] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:36:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:36:53.995686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7dc7d1-6a09-4e61-a169-fde6bfbca5d9 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:54.085600 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:54.097819 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7dc7d1-6a09-4e61-a169-fde6bfbca5d9 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:54.133430 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cc8a0-55b1-4ad7-a0a8-d7d02842563f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:54.134055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cc8a0-55b1-4ad7-a0a8-d7d02842563f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:54.134335 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cc8a0-55b1-4ad7-a0a8-d7d02842563f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:54.134608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cc8a0-55b1-4ad7-a0a8-d7d02842563f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:54.144714 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2cc8a0-55b1-4ad7-a0a8-d7d02842563f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:36:54.149446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-1a2cc8a0-55b1-4ad7-a0a8-d7d02842563f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:36:54.149446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:54.149446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:36:54.149446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:36:54.149446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:36:54.149446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:36:54.149446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:36:54.149446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:36:54.149446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:36:54.149446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:36:54.149446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:36:54.149446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:36:54.149446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:36:54.149446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:36:54.149446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:36:54.149446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:36:54.154096 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:36:54.154096 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:36:54.154096 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:36:54.154096 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:36:54.154096 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:36:54.154096 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:36:54.154096 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:36:54.154096 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:36:54.154096 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:36:54.154096 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:36:54.154096 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:36:54.154096 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:36:54.154096 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:36:54.154096 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:36:54.154096 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:36:54.154096 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:36:54.155122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:36:54.155122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:36:54.155122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:36:54.155122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:36:54.155122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:36:54.155122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:36:54.155122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:36:54.155122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:36:54.155122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:36:54.155122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:36:54.155122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:36:54.155122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:36:54.155122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 588/1180] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:36:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:36:54.156793 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385c965-548a-4c6a-b328-4848b2e98184 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:54.227585 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:54.258488 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385c965-548a-4c6a-b328-4848b2e98184 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:54.290919 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed533dd-8e9e-43f3-adf6-83de9ef1baa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:54.291545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed533dd-8e9e-43f3-adf6-83de9ef1baa2 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:54.291822 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed533dd-8e9e-43f3-adf6-83de9ef1baa2 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:54.292090 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed533dd-8e9e-43f3-adf6-83de9ef1baa2 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:54.292800 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed533dd-8e9e-43f3-adf6-83de9ef1baa2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:54.293102 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed533dd-8e9e-43f3-adf6-83de9ef1baa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:54.294450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed533dd-8e9e-43f3-adf6-83de9ef1baa2 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:54.304510 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 593/1181] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:36:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:54.310409 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cc8a0-55b1-4ad7-a0a8-d7d02842563f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:54.410807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cc8a0-55b1-4ad7-a0a8-d7d02842563f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:54.444970 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6cce0-88be-429e-a15b-a99e2e48c2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:54.445593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6cce0-88be-429e-a15b-a99e2e48c2b7 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:54.445874 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6cce0-88be-429e-a15b-a99e2e48c2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:54.446148 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6cce0-88be-429e-a15b-a99e2e48c2b7 None admin] PATH_INFO: `/v3/users/bfa5267f41b04585bbafa37b06c4d1f1` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:54.459528 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6cce0-88be-429e-a15b-a99e2e48c2b7 None admin] RBAC: Authorizing `identity:get_user(user_id=bfa5267f41b04585bbafa37b06c4d1f1)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:54.460986 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6cce0-88be-429e-a15b-a99e2e48c2b7 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:54.462651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 589/1182] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:36:54 2022] GET /identity/v3/users/bfa5267f41b04585bbafa37b06c4d1f1 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:54.468590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed533dd-8e9e-43f3-adf6-83de9ef1baa2 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:54.565620 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed533dd-8e9e-43f3-adf6-83de9ef1baa2 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:54.597836 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089962b-d531-4a57-a106-21b38f691e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:54.598438 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089962b-d531-4a57-a106-21b38f691e88 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:54.598713 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089962b-d531-4a57-a106-21b38f691e88 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:54.598978 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089962b-d531-4a57-a106-21b38f691e88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:54.601603 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:54.666424 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089962b-d531-4a57-a106-21b38f691e88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:54.667910 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089962b-d531-4a57-a106-21b38f691e88 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:54.763028 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 594/1183] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:36:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:36:54.768970 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6cce0-88be-429e-a15b-a99e2e48c2b7 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:54.777677 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:54.868469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6cce0-88be-429e-a15b-a99e2e48c2b7 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:54.902118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e4ea0-28b3-4b0c-a307-3070fc90a81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:54.902741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e4ea0-28b3-4b0c-a307-3070fc90a81f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:54.903020 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e4ea0-28b3-4b0c-a307-3070fc90a81f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:54.903292 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e4ea0-28b3-4b0c-a307-3070fc90a81f None admin] PATH_INFO: `/v3/projects/32c80d290d854cef98be7de6eb98bb2d` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:54.904425 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e4ea0-28b3-4b0c-a307-3070fc90a81f None admin] RBAC: Authorizing `identity:get_project(project_id=32c80d290d854cef98be7de6eb98bb2d)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:54.905856 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e4ea0-28b3-4b0c-a307-3070fc90a81f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:54.907551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 590/1184] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:36:54 2022] GET /identity/v3/projects/32c80d290d854cef98be7de6eb98bb2d => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:54.914292 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089962b-d531-4a57-a106-21b38f691e88 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:54.947409 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:55.012271 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089962b-d531-4a57-a106-21b38f691e88 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:55.046729 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ed56e-3c94-4f0d-a270-b3517ad2eecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:55.047385 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ed56e-3c94-4f0d-a270-b3517ad2eecf None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:55.047662 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ed56e-3c94-4f0d-a270-b3517ad2eecf None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:55.047933 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ed56e-3c94-4f0d-a270-b3517ad2eecf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:55.048655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ed56e-3c94-4f0d-a270-b3517ad2eecf None admin] RBAC: Adding query filter params (role.id=98ffd3c114804da292d7cb33721e9085, scope.project.id=32c80d290d854cef98be7de6eb98bb2d, user.id=bfa5267f41b04585bbafa37b06c4d1f1) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:55.048964 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ed56e-3c94-4f0d-a270-b3517ad2eecf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:55.050410 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ed56e-3c94-4f0d-a270-b3517ad2eecf None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:55.055815 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 595/1185] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:36:54 2022] GET /identity/v3/role_assignments?user.id=bfa5267f41b04585bbafa37b06c4d1f1&scope.project.id=32c80d290d854cef98be7de6eb98bb2d&role.id=98ffd3c114804da292d7cb33721e9085 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:56.941610 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfb343-f54f-4203-8987-797154428cb7 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:56.942195 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfb343-f54f-4203-8987-797154428cb7 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:56.942195 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfb343-f54f-4203-8987-797154428cb7 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:56.943514 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 591/1186] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:36:56.948591 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04543fda-3d31-4caa-a87f-d5f942db9482 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:56.948995 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04543fda-3d31-4caa-a87f-d5f942db9482 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:56.949137 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04543fda-3d31-4caa-a87f-d5f942db9482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:56.967451 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-04543fda-3d31-4caa-a87f-d5f942db9482 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:36:56.968639 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-04543fda-3d31-4caa-a87f-d5f942db9482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:36:57.034770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 596/1187] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:36:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:36:57.297645 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfb343-f54f-4203-8987-797154428cb7 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:57.373505 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:57.399387 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfb343-f54f-4203-8987-797154428cb7 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:57.434612 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a801ac6-dd60-45a6-81fe-b67de619893f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:57.435234 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a801ac6-dd60-45a6-81fe-b67de619893f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:57.435544 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a801ac6-dd60-45a6-81fe-b67de619893f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:57.435820 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a801ac6-dd60-45a6-81fe-b67de619893f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:57.446416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a801ac6-dd60-45a6-81fe-b67de619893f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:36:57.451197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-6a801ac6-dd60-45a6-81fe-b67de619893f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:36:57.451197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:36:57.451197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:36:57.451197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:36:57.451197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:36:57.451197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:36:57.451197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:36:57.451197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:36:57.451197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:36:57.451197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:36:57.451197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:36:57.451197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:36:57.451197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:36:57.451197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:36:57.451197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:36:57.451197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:36:57.452415 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:36:57.452415 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:36:57.452415 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:36:57.452415 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:36:57.452415 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:36:57.452415 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:36:57.452415 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:36:57.452415 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:36:57.452415 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:36:57.452415 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:36:57.452415 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:36:57.452415 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:36:57.452415 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:36:57.452415 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:36:57.452415 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:36:57.452415 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:36:57.453353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:36:57.453353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:36:57.453353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:36:57.453353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:36:57.453353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:36:57.453353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:36:57.453353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:36:57.453353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:36:57.453353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:36:57.453353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:36:57.453353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:36:57.453353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:36:57.453353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 592/1188] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:36:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:36:57.458455 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04543fda-3d31-4caa-a87f-d5f942db9482 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:57.486515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:57.557047 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04543fda-3d31-4caa-a87f-d5f942db9482 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:57.589173 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e858686-51e1-4927-838b-8b5d914b0de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:57.589775 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e858686-51e1-4927-838b-8b5d914b0de7 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:57.590053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e858686-51e1-4927-838b-8b5d914b0de7 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:57.590323 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e858686-51e1-4927-838b-8b5d914b0de7 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:57.593910 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e858686-51e1-4927-838b-8b5d914b0de7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:36:57.593910 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e858686-51e1-4927-838b-8b5d914b0de7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:57.593910 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e858686-51e1-4927-838b-8b5d914b0de7 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:57.601295 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 597/1189] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:36:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:57.607348 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a801ac6-dd60-45a6-81fe-b67de619893f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:57.711914 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a801ac6-dd60-45a6-81fe-b67de619893f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:57.745641 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fbd65-0b80-4568-98ef-1802942b8a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:57.746262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fbd65-0b80-4568-98ef-1802942b8a23 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:57.746593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fbd65-0b80-4568-98ef-1802942b8a23 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:57.746871 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fbd65-0b80-4568-98ef-1802942b8a23 None admin] PATH_INFO: `/v3/users/bfa5267f41b04585bbafa37b06c4d1f1` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:57.747986 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fbd65-0b80-4568-98ef-1802942b8a23 None admin] RBAC: Authorizing `identity:get_user(user_id=bfa5267f41b04585bbafa37b06c4d1f1)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:57.749415 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fbd65-0b80-4568-98ef-1802942b8a23 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:57.751024 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 593/1190] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:36:57 2022] GET /identity/v3/users/bfa5267f41b04585bbafa37b06c4d1f1 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:57.756804 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e858686-51e1-4927-838b-8b5d914b0de7 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:57.843786 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:57.852901 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e858686-51e1-4927-838b-8b5d914b0de7 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:57.890661 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce6116-2c0f-45bb-a03d-41bc82342785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:57.891286 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce6116-2c0f-45bb-a03d-41bc82342785 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:57.891663 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce6116-2c0f-45bb-a03d-41bc82342785 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:57.891934 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce6116-2c0f-45bb-a03d-41bc82342785 None admin] PATH_INFO: `/v3/projects/32c80d290d854cef98be7de6eb98bb2d` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:57.893025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce6116-2c0f-45bb-a03d-41bc82342785 None admin] RBAC: Authorizing `identity:get_project(project_id=32c80d290d854cef98be7de6eb98bb2d)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:57.894444 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce6116-2c0f-45bb-a03d-41bc82342785 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:57.896091 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 598/1191] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:36:57 2022] GET /identity/v3/projects/32c80d290d854cef98be7de6eb98bb2d => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:36:57.902209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fbd65-0b80-4568-98ef-1802942b8a23 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:36:57.905072 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:36:58.002887 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fbd65-0b80-4568-98ef-1802942b8a23 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:36:58.035262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fd591-c4bd-482a-b017-37709c606ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:36:58.035939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fd591-c4bd-482a-b017-37709c606ca1 None admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:58.036215 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fd591-c4bd-482a-b017-37709c606ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:58.036482 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fd591-c4bd-482a-b017-37709c606ca1 None admin] PATH_INFO: `/v3/projects/32c80d290d854cef98be7de6eb98bb2d/users/bfa5267f41b04585bbafa37b06c4d1f1/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:58.038348 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fd591-c4bd-482a-b017-37709c606ca1 None admin] RBAC: Authorizing `identity:create_grant(project_id=32c80d290d854cef98be7de6eb98bb2d, user_id=bfa5267f41b04585bbafa37b06c4d1f1, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:36:58.039816 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fd591-c4bd-482a-b017-37709c606ca1 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:36:58.116360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 594/1192] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 1 13:36:57 2022] PUT /identity/v3/projects/32c80d290d854cef98be7de6eb98bb2d/users/bfa5267f41b04585bbafa37b06c4d1f1/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:36:59.997290 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4f01e-34a3-48c0-b71f-d6389c4c4b56 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:36:59.997814 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4f01e-34a3-48c0-b71f-d6389c4c4b56 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:36:59.997814 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4f01e-34a3-48c0-b71f-d6389c4c4b56 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:36:59.999134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 599/1193] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:37:00.004838 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe54d28-8789-4045-bf4e-53430f9d1ac4 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:37:00.005280 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe54d28-8789-4045-bf4e-53430f9d1ac4 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:37:00.005397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe54d28-8789-4045-bf4e-53430f9d1ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:37:00.024832 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-6fe54d28-8789-4045-bf4e-53430f9d1ac4 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:37:00.026025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-6fe54d28-8789-4045-bf4e-53430f9d1ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:37:00.082389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:37:00.092484 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 595/1194] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:37:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:37:00.356723 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4f01e-34a3-48c0-b71f-d6389c4c4b56 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:37:00.459054 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4f01e-34a3-48c0-b71f-d6389c4c4b56 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:37:00.495170 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72fd8d-5771-4c6a-8ea5-d9bfff70eb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:37:00.495813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72fd8d-5771-4c6a-8ea5-d9bfff70eb69 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:37:00.496090 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72fd8d-5771-4c6a-8ea5-d9bfff70eb69 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:37:00.496357 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72fd8d-5771-4c6a-8ea5-d9bfff70eb69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:37:00.507269 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72fd8d-5771-4c6a-8ea5-d9bfff70eb69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:37:00.511971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-dd72fd8d-5771-4c6a-8ea5-d9bfff70eb69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:37:00.511971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:37:00.511971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:37:00.511971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:37:00.511971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:37:00.511971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:37:00.511971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:37:00.511971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:37:00.511971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:37:00.511971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:37:00.511971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:37:00.511971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:37:00.511971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:37:00.511971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:37:00.511971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:37:00.511971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:37:00.513069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:37:00.513069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:37:00.513069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:37:00.513069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:37:00.513069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:37:00.513069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:37:00.513069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:37:00.513069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:37:00.513069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:37:00.513069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:37:00.513069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:37:00.513069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:37:00.513069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:37:00.513069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:37:00.513069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:37:00.513069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:37:00.514083 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:37:00.514083 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:37:00.514083 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:37:00.514083 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:37:00.514083 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:37:00.514083 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:37:00.514083 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:37:00.514083 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:37:00.514083 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:37:00.514083 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:37:00.514083 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:37:00.514083 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:37:00.514083 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 600/1195] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:37:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:37:00.519542 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe54d28-8789-4045-bf4e-53430f9d1ac4 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:37:00.621717 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe54d28-8789-4045-bf4e-53430f9d1ac4 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:37:00.657568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92799494-af26-4f5c-8a76-95bac2374de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:37:00.658176 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92799494-af26-4f5c-8a76-95bac2374de5 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:37:00.658456 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92799494-af26-4f5c-8a76-95bac2374de5 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:37:00.658729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92799494-af26-4f5c-8a76-95bac2374de5 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:37:00.659417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92799494-af26-4f5c-8a76-95bac2374de5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:37:00.659727 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92799494-af26-4f5c-8a76-95bac2374de5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:37:00.661109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92799494-af26-4f5c-8a76-95bac2374de5 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:37:00.669327 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 596/1196] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:37:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:37:00.675926 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72fd8d-5771-4c6a-8ea5-d9bfff70eb69 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:37:00.695115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:37:00.775870 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72fd8d-5771-4c6a-8ea5-d9bfff70eb69 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:37:00.810736 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8375b77-b1fa-40b2-a961-9fd6efcbfd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:37:00.811384 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8375b77-b1fa-40b2-a961-9fd6efcbfd76 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:37:00.811661 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8375b77-b1fa-40b2-a961-9fd6efcbfd76 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:37:00.811931 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8375b77-b1fa-40b2-a961-9fd6efcbfd76 None admin] PATH_INFO: `/v3/users/bfa5267f41b04585bbafa37b06c4d1f1` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:37:00.813038 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8375b77-b1fa-40b2-a961-9fd6efcbfd76 None admin] RBAC: Authorizing `identity:get_user(user_id=bfa5267f41b04585bbafa37b06c4d1f1)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:37:00.814496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8375b77-b1fa-40b2-a961-9fd6efcbfd76 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:37:00.816263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 601/1197] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Sep 1 13:37:00 2022] GET /identity/v3/users/bfa5267f41b04585bbafa37b06c4d1f1 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:37:00.822494 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92799494-af26-4f5c-8a76-95bac2374de5 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:37:00.881392 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:37:00.929017 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92799494-af26-4f5c-8a76-95bac2374de5 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:37:00.962394 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec34d96-b4da-4071-8c7a-f27ec7acc4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:37:00.962994 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec34d96-b4da-4071-8c7a-f27ec7acc4ee None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:37:00.963271 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec34d96-b4da-4071-8c7a-f27ec7acc4ee None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:37:00.963704 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec34d96-b4da-4071-8c7a-f27ec7acc4ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:37:01.030389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec34d96-b4da-4071-8c7a-f27ec7acc4ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:37:01.031878 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec34d96-b4da-4071-8c7a-f27ec7acc4ee None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:37:01.087615 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:37:01.132356 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 597/1198] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:37:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:37:01.138262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8375b77-b1fa-40b2-a961-9fd6efcbfd76 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:37:01.223544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:37:01.237989 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8375b77-b1fa-40b2-a961-9fd6efcbfd76 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:37:01.273543 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee593c3-f652-4b66-bb09-366ea9ee9bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:37:01.274155 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee593c3-f652-4b66-bb09-366ea9ee9bd5 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:37:01.274432 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee593c3-f652-4b66-bb09-366ea9ee9bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:37:01.274700 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee593c3-f652-4b66-bb09-366ea9ee9bd5 None admin] PATH_INFO: `/v3/projects/32c80d290d854cef98be7de6eb98bb2d` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:37:01.275837 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee593c3-f652-4b66-bb09-366ea9ee9bd5 None admin] RBAC: Authorizing `identity:get_project(project_id=32c80d290d854cef98be7de6eb98bb2d)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:37:01.277287 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee593c3-f652-4b66-bb09-366ea9ee9bd5 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:37:01.278904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 602/1199] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Sep 1 13:37:01 2022] GET /identity/v3/projects/32c80d290d854cef98be7de6eb98bb2d => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:37:01.285305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec34d96-b4da-4071-8c7a-f27ec7acc4ee None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:37:01.390819 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec34d96-b4da-4071-8c7a-f27ec7acc4ee None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:37:01.424090 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e7d25-c768-465b-bd0e-1eda2d913307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:37:01.424685 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e7d25-c768-465b-bd0e-1eda2d913307 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:37:01.424960 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e7d25-c768-465b-bd0e-1eda2d913307 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:37:01.425228 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e7d25-c768-465b-bd0e-1eda2d913307 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:37:01.425944 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e7d25-c768-465b-bd0e-1eda2d913307 None admin] RBAC: Adding query filter params (role.id=98ffd3c114804da292d7cb33721e9085, scope.project.id=32c80d290d854cef98be7de6eb98bb2d, user.id=bfa5267f41b04585bbafa37b06c4d1f1) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:37:01.426245 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e7d25-c768-465b-bd0e-1eda2d913307 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:37:01.427709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e7d25-c768-465b-bd0e-1eda2d913307 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:37:01.433363 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 598/1200] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:37:01 2022] GET /identity/v3/role_assignments?user.id=bfa5267f41b04585bbafa37b06c4d1f1&scope.project.id=32c80d290d854cef98be7de6eb98bb2d&role.id=98ffd3c114804da292d7cb33721e9085 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:37:11.269253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=23 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:37:11.430804 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=91 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:14.899482 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8490da-8dee-4f13-a663-11d75acd34f6 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:14.900059 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8490da-8dee-4f13-a663-11d75acd34f6 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:14.900059 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8490da-8dee-4f13-a663-11d75acd34f6 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:14.901405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 603/1201] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:38:14.906777 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e1896-7c20-40dc-a86c-a2b2bfafbbda None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:14.907209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e1896-7c20-40dc-a86c-a2b2bfafbbda None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:14.907421 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e1896-7c20-40dc-a86c-a2b2bfafbbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:14.925446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-ba2e1896-7c20-40dc-a86c-a2b2bfafbbda None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:38:14.926683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-ba2e1896-7c20-40dc-a86c-a2b2bfafbbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:38:14.994180 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 599/1202] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:38:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:38:15.270570 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8490da-8dee-4f13-a663-11d75acd34f6 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:15.370288 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8490da-8dee-4f13-a663-11d75acd34f6 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:15.404144 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec71a52-9552-4402-9ac9-e130b7de2459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:15.404763 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec71a52-9552-4402-9ac9-e130b7de2459 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:15.405041 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec71a52-9552-4402-9ac9-e130b7de2459 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:15.405311 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec71a52-9552-4402-9ac9-e130b7de2459 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:15.415045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec71a52-9552-4402-9ac9-e130b7de2459 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:15.416516 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec71a52-9552-4402-9ac9-e130b7de2459 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:15.430930 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-7ec71a52-9552-4402-9ac9-e130b7de2459 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:38:15.430930 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:15.430930 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:15.430930 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:15.430930 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:15.430930 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:15.430930 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:15.430930 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:15.430930 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:15.430930 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:15.430930 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:15.430930 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:15.430930 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:38:15.430930 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:38:15.430930 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:38:15.430930 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:38:15.435671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:15.435671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:15.435671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:15.435671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:15.435671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:15.435671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:15.435671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:15.435671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:15.435671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:15.435671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:15.435671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:15.435671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:15.435671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:15.435671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:15.435671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:15.435671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:15.435671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:38:15.436867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:38:15.436867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:38:15.436867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:38:15.436867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 604/1203] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:15.439059 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e1896-7c20-40dc-a86c-a2b2bfafbbda None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:15.540770 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e1896-7c20-40dc-a86c-a2b2bfafbbda None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:15.568752 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:15.574429 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e3f91-67ed-4179-af87-ea96bd677b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:15.575606 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e3f91-67ed-4179-af87-ea96bd677b87 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:15.575883 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e3f91-67ed-4179-af87-ea96bd677b87 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:15.576149 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e3f91-67ed-4179-af87-ea96bd677b87 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:15.576777 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e3f91-67ed-4179-af87-ea96bd677b87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:15.577073 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e3f91-67ed-4179-af87-ea96bd677b87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:15.578431 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e3f91-67ed-4179-af87-ea96bd677b87 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:15.589430 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 600/1204] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:15.595425 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec71a52-9552-4402-9ac9-e130b7de2459 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:15.649766 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:15.694748 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec71a52-9552-4402-9ac9-e130b7de2459 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:15.728115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00d00f-f8a1-4c2a-a820-05aaa5afc88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:15.728708 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00d00f-f8a1-4c2a-a820-05aaa5afc88b None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:15.728986 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00d00f-f8a1-4c2a-a820-05aaa5afc88b None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:15.729258 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00d00f-f8a1-4c2a-a820-05aaa5afc88b None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:15.729897 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00d00f-f8a1-4c2a-a820-05aaa5afc88b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:15.731323 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00d00f-f8a1-4c2a-a820-05aaa5afc88b None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:15.851244 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 605/1205] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Sep 1 13:38:15 2022] POST /identity/v3/users => generated 251 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:38:17.758741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db8982-6aeb-4e74-9930-9d49f64179b8 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:17.759302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db8982-6aeb-4e74-9930-9d49f64179b8 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:17.759302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db8982-6aeb-4e74-9930-9d49f64179b8 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:17.760638 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 601/1206] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:38:17.766235 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0f268-dad1-4683-a7e7-f2543c4297a6 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:17.766658 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0f268-dad1-4683-a7e7-f2543c4297a6 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:17.766786 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0f268-dad1-4683-a7e7-f2543c4297a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:17.785414 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-a2d0f268-dad1-4683-a7e7-f2543c4297a6 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:38:17.786648 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a2d0f268-dad1-4683-a7e7-f2543c4297a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:38:17.858628 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 606/1207] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:38:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:38:18.141581 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db8982-6aeb-4e74-9930-9d49f64179b8 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:18.245468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db8982-6aeb-4e74-9930-9d49f64179b8 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:18.279324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041f3da-ae3d-4513-9001-a159c213f73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:18.279968 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041f3da-ae3d-4513-9001-a159c213f73d None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:18.280245 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041f3da-ae3d-4513-9001-a159c213f73d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:18.280517 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041f3da-ae3d-4513-9001-a159c213f73d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:18.290495 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041f3da-ae3d-4513-9001-a159c213f73d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:38:18.296109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-3041f3da-ae3d-4513-9001-a159c213f73d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:38:18.296109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:18.296109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:18.296109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:18.296109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:18.296109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:18.296109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:18.296109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:18.296109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:18.296109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:18.296109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:18.296109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:18.296109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:38:18.296109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:38:18.296109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:38:18.296109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:38:18.297302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:38:18.297302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:38:18.297302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:38:18.297302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:38:18.297302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:18.297302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:18.297302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:18.297302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:18.297302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:18.297302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:18.297302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:18.297302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:18.297302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:18.297302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:18.297302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:18.297302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:18.298127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:18.298127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:18.298127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:18.298127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:18.298127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:38:18.298127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:38:18.298127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:38:18.298127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:38:18.298127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:38:18.298127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:38:18.298127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:38:18.298127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:38:18.298127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 602/1208] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 1 13:38:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:18.303768 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0f268-dad1-4683-a7e7-f2543c4297a6 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:18.344855 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:18.403350 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0f268-dad1-4683-a7e7-f2543c4297a6 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:18.437425 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313d407-2e92-4272-b8dc-8c22a4d3d28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:18.438023 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313d407-2e92-4272-b8dc-8c22a4d3d28b None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:18.438299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313d407-2e92-4272-b8dc-8c22a4d3d28b None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:18.438566 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313d407-2e92-4272-b8dc-8c22a4d3d28b None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:18.439219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313d407-2e92-4272-b8dc-8c22a4d3d28b None admin] RBAC: Adding query filter params (name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:18.439551 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313d407-2e92-4272-b8dc-8c22a4d3d28b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:18.440949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313d407-2e92-4272-b8dc-8c22a4d3d28b None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:18.448721 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 607/1209] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 1 13:38:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:18.454842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041f3da-ae3d-4513-9001-a159c213f73d None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:18.505296 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:18.554171 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041f3da-ae3d-4513-9001-a159c213f73d None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:18.586762 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0aa83-d20e-48e0-9bee-68a34c6f7c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:18.587395 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0aa83-d20e-48e0-9bee-68a34c6f7c81 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:18.587681 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0aa83-d20e-48e0-9bee-68a34c6f7c81 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:18.587952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0aa83-d20e-48e0-9bee-68a34c6f7c81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:18.598241 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0aa83-d20e-48e0-9bee-68a34c6f7c81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:18.599712 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0aa83-d20e-48e0-9bee-68a34c6f7c81 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:18.615039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-91e0aa83-d20e-48e0-9bee-68a34c6f7c81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:38:18.615039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:18.615039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:18.615039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:18.615039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:18.615039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:18.615039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:18.615039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:18.615039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:18.615039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:18.615039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:18.615039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:18.615039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:38:18.615039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:38:18.615039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:38:18.615039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:38:18.617544 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:18.617544 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:18.617544 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:18.617544 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:18.617544 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:18.617544 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:18.617544 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:18.617544 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:18.617544 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:18.617544 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:18.617544 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:18.617544 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:18.617544 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:18.617544 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:18.617544 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:18.617544 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:18.617544 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:38:18.618657 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:38:18.618657 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:38:18.618657 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:38:18.618657 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 603/1210] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:38:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:18.622372 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313d407-2e92-4272-b8dc-8c22a4d3d28b None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:18.720959 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:18.723805 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313d407-2e92-4272-b8dc-8c22a4d3d28b None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:18.757006 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab96149-d966-49e0-a033-77c96e2d4d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:18.757600 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab96149-d966-49e0-a033-77c96e2d4d16 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:18.757876 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab96149-d966-49e0-a033-77c96e2d4d16 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:18.758143 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab96149-d966-49e0-a033-77c96e2d4d16 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:18.758767 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab96149-d966-49e0-a033-77c96e2d4d16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:18.759063 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab96149-d966-49e0-a033-77c96e2d4d16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:18.760495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab96149-d966-49e0-a033-77c96e2d4d16 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:18.771721 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 608/1211] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:18.777511 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0aa83-d20e-48e0-9bee-68a34c6f7c81 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:18.880121 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0aa83-d20e-48e0-9bee-68a34c6f7c81 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:18.881670 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:18.915463 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79994e69-5363-4911-90c3-529520457fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:18.916077 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79994e69-5363-4911-90c3-529520457fa9 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:18.916354 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79994e69-5363-4911-90c3-529520457fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:18.916623 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79994e69-5363-4911-90c3-529520457fa9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:18.923461 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79994e69-5363-4911-90c3-529520457fa9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:18.924885 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79994e69-5363-4911-90c3-529520457fa9 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:18.936154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-79994e69-5363-4911-90c3-529520457fa9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 13:38:18.936154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:18.936154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:18.936154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:18.936154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:18.936154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:18.936154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:18.936154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:18.936154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:18.936154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:18.936154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:18.936154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:18.936154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:38:18.936154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:38:18.936154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:38:18.936154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:38:18.937305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:18.937305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:18.937305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:38:18.937305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:38:18.937305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:38:18.937305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:38:18.937305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:18.937305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:18.937305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:18.937305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:18.937305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:18.937305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:18.937305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:18.937305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:18.937305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:18.937305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:18.937305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:18.937305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:18.938332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:18.938332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:18.938332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:38:18.938332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:38:18.938332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:38:18.938332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:38:18.938332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:38:18.938332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:38:18.938332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 13:38:18.938332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:38:18.938332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 604/1212] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:38:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:18.943295 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab96149-d966-49e0-a033-77c96e2d4d16 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:19.044034 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab96149-d966-49e0-a033-77c96e2d4d16 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:19.076498 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dc7bb-9c3f-4df3-ab29-c067c1d5df9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:19.077089 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dc7bb-9c3f-4df3-ab29-c067c1d5df9b None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:19.077365 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dc7bb-9c3f-4df3-ab29-c067c1d5df9b None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:19.077634 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dc7bb-9c3f-4df3-ab29-c067c1d5df9b None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:19.078345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720dc7bb-9c3f-4df3-ab29-c067c1d5df9b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:19.078647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720dc7bb-9c3f-4df3-ab29-c067c1d5df9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:19.080090 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720dc7bb-9c3f-4df3-ab29-c067c1d5df9b None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:19.097326 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 609/1213] 10.222.0.50 () {56 vars in 1143 bytes} [Thu Sep 1 13:38:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:19.103162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79994e69-5363-4911-90c3-529520457fa9 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:19.201193 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79994e69-5363-4911-90c3-529520457fa9 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:19.233758 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20175b92-0cf1-4f13-8d4c-84de336201ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:19.234349 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20175b92-0cf1-4f13-8d4c-84de336201ca None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:19.234622 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20175b92-0cf1-4f13-8d4c-84de336201ca None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:19.234888 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20175b92-0cf1-4f13-8d4c-84de336201ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:19.264859 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:19.300532 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20175b92-0cf1-4f13-8d4c-84de336201ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:19.301903 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20175b92-0cf1-4f13-8d4c-84de336201ca None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:19.395703 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 605/1214] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:38:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:38:19.401587 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dc7bb-9c3f-4df3-ab29-c067c1d5df9b None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:19.422849 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:19.503213 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dc7bb-9c3f-4df3-ab29-c067c1d5df9b None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:19.535978 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3dae9-bf1c-4043-afee-5269d5f5ac93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:19.536590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3dae9-bf1c-4043-afee-5269d5f5ac93 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:19.536867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3dae9-bf1c-4043-afee-5269d5f5ac93 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:19.537136 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3dae9-bf1c-4043-afee-5269d5f5ac93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:19.547470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3dae9-bf1c-4043-afee-5269d5f5ac93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:19.548912 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3dae9-bf1c-4043-afee-5269d5f5ac93 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:19.563904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-01a3dae9-bf1c-4043-afee-5269d5f5ac93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:38:19.563904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:19.563904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:19.563904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:19.563904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:19.563904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:19.563904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:19.563904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:19.563904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:19.563904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:19.563904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:19.563904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:19.563904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:38:19.563904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:38:19.563904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:38:19.563904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:38:19.565022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:19.565022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:19.565022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:19.565022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:19.565022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:19.565022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:19.565022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:19.565022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:19.565022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:19.565022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:19.565022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:19.565022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:19.565022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:19.565022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:19.565022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:19.565022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:19.565022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:38:19.566091 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:38:19.566091 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:38:19.566091 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:38:19.566091 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 610/1215] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:38:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:19.570809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20175b92-0cf1-4f13-8d4c-84de336201ca None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:19.638775 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:19.676457 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20175b92-0cf1-4f13-8d4c-84de336201ca None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:19.709650 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4df4e1-09ed-4c28-b2ba-636a66279969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:19.710253 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4df4e1-09ed-4c28-b2ba-636a66279969 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:19.710527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4df4e1-09ed-4c28-b2ba-636a66279969 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:19.710793 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4df4e1-09ed-4c28-b2ba-636a66279969 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:19.711450 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4df4e1-09ed-4c28-b2ba-636a66279969 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:19.711750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4df4e1-09ed-4c28-b2ba-636a66279969 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:19.713104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4df4e1-09ed-4c28-b2ba-636a66279969 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:19.724835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 606/1216] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:19.733321 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3dae9-bf1c-4043-afee-5269d5f5ac93 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:19.798118 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:19.829621 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3dae9-bf1c-4043-afee-5269d5f5ac93 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:19.863152 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d99da-eb03-4c77-b644-324d72ad1cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:19.863809 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d99da-eb03-4c77-b644-324d72ad1cc4 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:19.864134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d99da-eb03-4c77-b644-324d72ad1cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:19.864362 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d99da-eb03-4c77-b644-324d72ad1cc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:19.871346 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d99da-eb03-4c77-b644-324d72ad1cc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:19.875029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d99da-eb03-4c77-b644-324d72ad1cc4 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:19.883723 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-614d99da-eb03-4c77-b644-324d72ad1cc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:38:19.883723 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:19.883723 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:19.883723 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:19.883723 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:19.883723 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:19.883723 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:19.883723 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:19.883723 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:19.883723 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:19.883723 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:19.883723 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:19.883723 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:38:19.883723 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:38:19.883723 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:38:19.884789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:38:19.884789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:19.884789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:19.884789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:19.884789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:19.884789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:19.884789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:19.884789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:19.884789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:19.884789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:19.884789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:19.884789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:19.884789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:19.884789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:19.884789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:19.884789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:19.884789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:19.885729 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:38:19.885729 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:38:19.885729 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:38:19.885729 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:38:19.885729 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:38:19.885729 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:38:19.885729 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:38:19.885729 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:38:19.885729 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 611/1217] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:38:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:19.890798 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4df4e1-09ed-4c28-b2ba-636a66279969 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:19.988553 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4df4e1-09ed-4c28-b2ba-636a66279969 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:20.010113 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:20.021135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4bbaa-cc4a-4308-a44e-b6ecfa4763a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:20.021766 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4bbaa-cc4a-4308-a44e-b6ecfa4763a3 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:20.022043 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4bbaa-cc4a-4308-a44e-b6ecfa4763a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:20.022313 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4bbaa-cc4a-4308-a44e-b6ecfa4763a3 None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:20.022999 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4bbaa-cc4a-4308-a44e-b6ecfa4763a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:20.023298 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4bbaa-cc4a-4308-a44e-b6ecfa4763a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:20.024740 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4bbaa-cc4a-4308-a44e-b6ecfa4763a3 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:20.036681 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 607/1218] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:38:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:20.042818 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d99da-eb03-4c77-b644-324d72ad1cc4 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:20.142213 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d99da-eb03-4c77-b644-324d72ad1cc4 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:20.172714 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:20.178253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa0213-5d4e-4137-b11b-5442c3f2c66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:20.178846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa0213-5d4e-4137-b11b-5442c3f2c66f None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:20.179131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa0213-5d4e-4137-b11b-5442c3f2c66f None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:20.179421 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa0213-5d4e-4137-b11b-5442c3f2c66f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:20.180145 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa0213-5d4e-4137-b11b-5442c3f2c66f None admin] RBAC: Adding query filter params (role.id=f8c77ddd17fd4bc7af83e8d8905fb404, scope.project.id=6283121e17814cd792df9d0edf81bf2d, user.id=63e675d44d2c49929feb0ec0d2c0d0eb) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:20.180448 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa0213-5d4e-4137-b11b-5442c3f2c66f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:20.181911 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa0213-5d4e-4137-b11b-5442c3f2c66f None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:20.187527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 612/1219] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:38:20 2022] GET /identity/v3/role_assignments?user.id=63e675d44d2c49929feb0ec0d2c0d0eb&scope.project.id=6283121e17814cd792df9d0edf81bf2d&role.id=f8c77ddd17fd4bc7af83e8d8905fb404 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:38:22.078009 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ea0ac-7096-4e99-bd7e-65c7c813647a None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:22.078697 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ea0ac-7096-4e99-bd7e-65c7c813647a None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:22.078697 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ea0ac-7096-4e99-bd7e-65c7c813647a None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:22.079901 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 608/1220] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:38:22.086692 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c309232-c398-470b-b98c-8394c201067e None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:22.087139 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c309232-c398-470b-b98c-8394c201067e None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:22.087232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c309232-c398-470b-b98c-8394c201067e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:22.123419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-7c309232-c398-470b-b98c-8394c201067e None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:38:22.123419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-7c309232-c398-470b-b98c-8394c201067e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:38:22.172710 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 613/1221] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:38:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:38:22.445352 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ea0ac-7096-4e99-bd7e-65c7c813647a None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:22.548708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ea0ac-7096-4e99-bd7e-65c7c813647a None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:22.582768 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2f987-aa18-4622-8d68-907c8c1545e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:22.583436 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2f987-aa18-4622-8d68-907c8c1545e6 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:22.583722 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2f987-aa18-4622-8d68-907c8c1545e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:22.583997 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2f987-aa18-4622-8d68-907c8c1545e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:22.595757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2f987-aa18-4622-8d68-907c8c1545e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:38:22.600443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-c1e2f987-aa18-4622-8d68-907c8c1545e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:38:22.600443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:22.600443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:22.600443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:22.600443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:22.600443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:22.600443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:22.600443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:22.600443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:22.600443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:22.600443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:22.600443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:22.600443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:38:22.600443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:38:22.600443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:38:22.600443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:38:22.601988 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:38:22.601988 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:38:22.601988 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:38:22.601988 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:38:22.601988 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:22.601988 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:22.601988 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:22.601988 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:22.601988 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:22.601988 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:22.601988 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:22.601988 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:22.601988 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:22.601988 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:22.601988 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:22.601988 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:22.603227 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:22.603227 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:22.603227 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:22.603227 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:22.603227 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:38:22.603227 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:38:22.603227 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:38:22.603227 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:38:22.603227 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:38:22.603227 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:38:22.603227 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:38:22.603227 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:38:22.603227 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 609/1222] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 1 13:38:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:22.608373 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c309232-c398-470b-b98c-8394c201067e None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:22.710629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c309232-c398-470b-b98c-8394c201067e None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:22.739542 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:22.754621 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e332a-c73b-4b6d-8330-bf7cfd373297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:22.755223 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e332a-c73b-4b6d-8330-bf7cfd373297 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:22.755536 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e332a-c73b-4b6d-8330-bf7cfd373297 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:22.755802 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e332a-c73b-4b6d-8330-bf7cfd373297 None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:22.756499 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e332a-c73b-4b6d-8330-bf7cfd373297 None admin] RBAC: Adding query filter params (name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:22.756814 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e332a-c73b-4b6d-8330-bf7cfd373297 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:22.758161 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e332a-c73b-4b6d-8330-bf7cfd373297 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:22.766092 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 614/1223] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 1 13:38:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:22.772262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2f987-aa18-4622-8d68-907c8c1545e6 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:22.815815 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:22.872546 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2f987-aa18-4622-8d68-907c8c1545e6 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:22.906895 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d28cb-0c7c-44b1-8487-ad82c264fa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:22.907540 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d28cb-0c7c-44b1-8487-ad82c264fa5a None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:22.907822 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d28cb-0c7c-44b1-8487-ad82c264fa5a None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:22.908090 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d28cb-0c7c-44b1-8487-ad82c264fa5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:22.918495 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d28cb-0c7c-44b1-8487-ad82c264fa5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:22.920489 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d28cb-0c7c-44b1-8487-ad82c264fa5a None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:22.934438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-a07d28cb-0c7c-44b1-8487-ad82c264fa5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:38:22.934438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:22.934438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:22.934438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:22.934438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:22.934438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:22.934438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:22.934438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:22.934438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:22.934438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:22.934438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:22.934438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:22.934438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:38:22.934438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:38:22.934438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:38:22.934438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:38:22.936310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:22.936310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:22.936310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:22.936310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:22.936310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:22.936310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:22.936310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:22.936310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:22.936310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:22.936310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:22.936310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:22.936310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:22.936310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:22.936310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:22.936310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:22.936310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:22.936310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:38:22.937177 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:38:22.937177 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:38:22.937177 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:38:22.937177 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 610/1224] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:38:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:22.942846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e332a-c73b-4b6d-8330-bf7cfd373297 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:23.043854 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e332a-c73b-4b6d-8330-bf7cfd373297 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:23.079626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4b263-8f09-4ff4-a084-99a90c2113fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:23.080225 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4b263-8f09-4ff4-a084-99a90c2113fa None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:23.080557 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4b263-8f09-4ff4-a084-99a90c2113fa None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:23.080832 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4b263-8f09-4ff4-a084-99a90c2113fa None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:23.081467 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4b263-8f09-4ff4-a084-99a90c2113fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:23.081768 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4b263-8f09-4ff4-a084-99a90c2113fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:23.083150 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4b263-8f09-4ff4-a084-99a90c2113fa None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:23.094961 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 615/1225] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:23.100854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d28cb-0c7c-44b1-8487-ad82c264fa5a None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:23.194786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:23.202103 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d28cb-0c7c-44b1-8487-ad82c264fa5a None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:23.236353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac74b6-d8e7-4fbd-bd64-894ae7a8118b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:23.237096 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac74b6-d8e7-4fbd-bd64-894ae7a8118b None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:23.237462 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac74b6-d8e7-4fbd-bd64-894ae7a8118b None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:23.237822 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac74b6-d8e7-4fbd-bd64-894ae7a8118b None admin] PATH_INFO: `/v3/users/placement` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:23.245060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac74b6-d8e7-4fbd-bd64-894ae7a8118b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:23.246496 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac74b6-d8e7-4fbd-bd64-894ae7a8118b None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:23.259031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-adac74b6-d8e7-4fbd-bd64-894ae7a8118b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 13:38:23.259031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:23.259031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:23.259031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:23.259031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:23.259031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:23.259031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:23.259031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:23.259031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:23.259031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:23.259031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:23.259031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:23.259031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:38:23.259031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:38:23.259031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:38:23.259031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:38:23.263618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:23.263618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:23.263618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:38:23.263618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:38:23.263618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:38:23.263618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:38:23.263618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:23.263618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:23.263618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:23.263618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:23.263618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:23.263618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:23.263618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:23.263618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:23.263618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:23.263618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:23.263618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:23.263618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:23.265520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:23.265520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:23.265520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:38:23.265520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:38:23.265520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:38:23.265520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:38:23.265520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:38:23.265520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:38:23.265520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 13:38:23.265520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:38:23.265520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 611/1226] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:38:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:23.266696 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4b263-8f09-4ff4-a084-99a90c2113fa None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:23.314104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:23.365329 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4b263-8f09-4ff4-a084-99a90c2113fa None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:23.399285 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52618ebd-d6d0-4c43-8624-f51887055513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:23.399927 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52618ebd-d6d0-4c43-8624-f51887055513 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:23.400207 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52618ebd-d6d0-4c43-8624-f51887055513 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:23.400480 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52618ebd-d6d0-4c43-8624-f51887055513 None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:23.401214 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52618ebd-d6d0-4c43-8624-f51887055513 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:23.401583 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52618ebd-d6d0-4c43-8624-f51887055513 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:23.403106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52618ebd-d6d0-4c43-8624-f51887055513 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:23.421654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 616/1227] 10.222.0.50 () {56 vars in 1143 bytes} [Thu Sep 1 13:38:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:23.427662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac74b6-d8e7-4fbd-bd64-894ae7a8118b None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:23.546151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac74b6-d8e7-4fbd-bd64-894ae7a8118b None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:23.580700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ec943-a571-473d-8c2c-c18a97eedfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:23.581210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ec943-a571-473d-8c2c-c18a97eedfe2 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:23.581489 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ec943-a571-473d-8c2c-c18a97eedfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:23.581760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ec943-a571-473d-8c2c-c18a97eedfe2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:23.593543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ec943-a571-473d-8c2c-c18a97eedfe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:23.596247 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ec943-a571-473d-8c2c-c18a97eedfe2 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:23.609807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-0f8ec943-a571-473d-8c2c-c18a97eedfe2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:38:23.609807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:23.609807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:23.609807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:23.609807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:23.609807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:23.609807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:23.609807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:23.609807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:23.609807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:23.609807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:23.609807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:23.609807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:38:23.609807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:38:23.609807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:38:23.609807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:38:23.611649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:23.611649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:23.611649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:23.611649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:23.611649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:23.611649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:23.611649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:23.611649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:23.611649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:23.611649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:23.611649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:23.611649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:23.611649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:23.611649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:23.611649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:23.611649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:23.611649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:38:23.613780 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:38:23.613780 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:38:23.613780 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:38:23.613780 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 612/1228] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:38:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:23.618293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52618ebd-d6d0-4c43-8624-f51887055513 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:23.718145 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52618ebd-d6d0-4c43-8624-f51887055513 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:23.720483 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:23.752833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8d3b9-3ee2-4948-9f85-b3cc6612b338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:23.753458 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8d3b9-3ee2-4948-9f85-b3cc6612b338 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:23.753741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8d3b9-3ee2-4948-9f85-b3cc6612b338 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:23.754012 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8d3b9-3ee2-4948-9f85-b3cc6612b338 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:23.754649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8d3b9-3ee2-4948-9f85-b3cc6612b338 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:23.754952 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8d3b9-3ee2-4948-9f85-b3cc6612b338 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:23.756460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8d3b9-3ee2-4948-9f85-b3cc6612b338 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:23.767711 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 617/1229] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:23.774739 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ec943-a571-473d-8c2c-c18a97eedfe2 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:23.785316 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:23.879329 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ec943-a571-473d-8c2c-c18a97eedfe2 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:23.915296 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d546d-a3e8-455e-a983-1d662b836470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:23.915960 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d546d-a3e8-455e-a983-1d662b836470 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:23.916238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d546d-a3e8-455e-a983-1d662b836470 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:23.916509 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d546d-a3e8-455e-a983-1d662b836470 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:23.923899 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d546d-a3e8-455e-a983-1d662b836470 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:23.925396 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d546d-a3e8-455e-a983-1d662b836470 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:23.936343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-384d546d-a3e8-455e-a983-1d662b836470 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:38:23.936343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:23.936343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:23.936343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:23.936343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:23.936343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:23.936343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:23.936343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:23.936343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:23.936343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:23.936343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:23.936343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:23.936343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:38:23.936343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:38:23.936343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:38:23.937431 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:38:23.937431 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:23.937431 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:23.937431 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:23.937431 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:23.937431 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:23.937431 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:23.937431 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:23.937431 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:23.937431 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:23.937431 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:23.937431 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:23.937431 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:23.937431 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:23.937431 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:23.937431 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:23.937431 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:23.938420 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:38:23.938420 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:38:23.938420 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:38:23.938420 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:38:23.938420 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:38:23.938420 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:38:23.938420 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:38:23.938420 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:38:23.938420 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 613/1230] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:38:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:23.943546 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8d3b9-3ee2-4948-9f85-b3cc6612b338 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:24.043132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8d3b9-3ee2-4948-9f85-b3cc6612b338 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:24.075927 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddf015-f139-4a34-9202-7634a84f3fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:24.076521 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddf015-f139-4a34-9202-7634a84f3fc5 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:24.076797 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddf015-f139-4a34-9202-7634a84f3fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:24.077066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddf015-f139-4a34-9202-7634a84f3fc5 None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:24.077744 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ddf015-f139-4a34-9202-7634a84f3fc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:24.078045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ddf015-f139-4a34-9202-7634a84f3fc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:24.079482 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ddf015-f139-4a34-9202-7634a84f3fc5 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:24.091882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 618/1231] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:38:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:24.098071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d546d-a3e8-455e-a983-1d662b836470 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:24.163669 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:24.197624 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d546d-a3e8-455e-a983-1d662b836470 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:24.231807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b097a-3546-4e7a-98d6-180840892259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:24.232467 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b097a-3546-4e7a-98d6-180840892259 None admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:24.232946 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b097a-3546-4e7a-98d6-180840892259 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:24.233399 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b097a-3546-4e7a-98d6-180840892259 None admin] PATH_INFO: `/v3/projects/6283121e17814cd792df9d0edf81bf2d/users/63e675d44d2c49929feb0ec0d2c0d0eb/roles/f8c77ddd17fd4bc7af83e8d8905fb404` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:24.247751 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b097a-3546-4e7a-98d6-180840892259 None admin] RBAC: Authorizing `identity:create_grant(project_id=6283121e17814cd792df9d0edf81bf2d, user_id=63e675d44d2c49929feb0ec0d2c0d0eb, role_id=f8c77ddd17fd4bc7af83e8d8905fb404)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:24.249300 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b097a-3546-4e7a-98d6-180840892259 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:24.325060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 614/1232] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 1 13:38:24 2022] PUT /identity/v3/projects/6283121e17814cd792df9d0edf81bf2d/users/63e675d44d2c49929feb0ec0d2c0d0eb/roles/f8c77ddd17fd4bc7af83e8d8905fb404 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:38:26.220082 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189ba21-7595-4c30-a1eb-45482a9a6cd4 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:26.220596 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189ba21-7595-4c30-a1eb-45482a9a6cd4 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:26.220596 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189ba21-7595-4c30-a1eb-45482a9a6cd4 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:26.221851 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 619/1233] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:38:26.227677 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca11c6d-e35b-48f6-b4e7-cfcae7821320 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:26.228231 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca11c6d-e35b-48f6-b4e7-cfcae7821320 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:26.228231 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca11c6d-e35b-48f6-b4e7-cfcae7821320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:26.247779 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-2ca11c6d-e35b-48f6-b4e7-cfcae7821320 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:38:26.248984 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-2ca11c6d-e35b-48f6-b4e7-cfcae7821320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:38:26.318619 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 615/1234] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:38:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:38:26.585044 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189ba21-7595-4c30-a1eb-45482a9a6cd4 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:26.610422 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:26.688112 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189ba21-7595-4c30-a1eb-45482a9a6cd4 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:26.722872 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c775905-a6c6-4f74-aff6-b04fdb75ae53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:26.723542 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c775905-a6c6-4f74-aff6-b04fdb75ae53 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:26.723827 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c775905-a6c6-4f74-aff6-b04fdb75ae53 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:26.724102 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c775905-a6c6-4f74-aff6-b04fdb75ae53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:26.734770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c775905-a6c6-4f74-aff6-b04fdb75ae53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:38:26.739649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-8c775905-a6c6-4f74-aff6-b04fdb75ae53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:38:26.739649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:26.739649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:26.739649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:26.739649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:26.739649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:26.739649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:26.739649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:26.739649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:26.739649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:26.739649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:26.739649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:26.739649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:38:26.739649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:38:26.739649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:38:26.739649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:38:26.744530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:38:26.744530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:38:26.744530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:38:26.744530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:38:26.744530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:26.744530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:26.744530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:26.744530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:26.744530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:26.744530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:26.744530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:26.744530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:26.744530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:26.744530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:26.744530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:26.744530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:26.745355 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:26.745355 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:26.745355 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:26.745355 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:26.745355 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:38:26.745355 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:38:26.745355 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:38:26.745355 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:38:26.745355 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:38:26.745355 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:38:26.745355 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:38:26.745355 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:38:26.745355 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 620/1235] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Sep 1 13:38:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:26.748106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca11c6d-e35b-48f6-b4e7-cfcae7821320 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:26.794639 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:26.848459 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca11c6d-e35b-48f6-b4e7-cfcae7821320 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:26.883314 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac24951-15ce-48ae-8fbe-1afd57a84925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:26.883948 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac24951-15ce-48ae-8fbe-1afd57a84925 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:26.884227 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac24951-15ce-48ae-8fbe-1afd57a84925 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:26.884500 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac24951-15ce-48ae-8fbe-1afd57a84925 None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:26.885159 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac24951-15ce-48ae-8fbe-1afd57a84925 None admin] RBAC: Adding query filter params (name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:26.885460 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac24951-15ce-48ae-8fbe-1afd57a84925 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:26.886878 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac24951-15ce-48ae-8fbe-1afd57a84925 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:26.896137 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 616/1236] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Sep 1 13:38:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:26.901983 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c775905-a6c6-4f74-aff6-b04fdb75ae53 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:26.988654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:27.005681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c775905-a6c6-4f74-aff6-b04fdb75ae53 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:27.040508 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22f3f7-e6de-46ed-b93c-f862b42ae58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:27.041106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22f3f7-e6de-46ed-b93c-f862b42ae58b None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:27.041385 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22f3f7-e6de-46ed-b93c-f862b42ae58b None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:27.041676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22f3f7-e6de-46ed-b93c-f862b42ae58b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:27.052110 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22f3f7-e6de-46ed-b93c-f862b42ae58b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:27.060069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22f3f7-e6de-46ed-b93c-f862b42ae58b None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:27.068299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-cd22f3f7-e6de-46ed-b93c-f862b42ae58b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:38:27.068299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:27.068299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:27.068299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:27.068299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:27.068299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:27.068299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:27.068299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:27.068299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:27.068299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:27.068299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:27.068299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:27.068299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:38:27.068299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:38:27.068299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:38:27.068299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:38:27.069717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:27.069717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:27.069717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:27.069717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:27.069717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:27.069717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:27.069717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:27.069717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:27.069717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:27.069717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:27.069717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:27.069717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:27.069717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:27.069717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:27.069717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:27.069717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:27.069717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:38:27.070980 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:38:27.070980 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:38:27.070980 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:38:27.070980 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 621/1237] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:38:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:38:27.075427 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac24951-15ce-48ae-8fbe-1afd57a84925 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:27.175442 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac24951-15ce-48ae-8fbe-1afd57a84925 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:27.183930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:27.208395 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426a11c-6f39-4644-9ed4-367d92df347f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:27.209023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426a11c-6f39-4644-9ed4-367d92df347f None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:27.209303 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426a11c-6f39-4644-9ed4-367d92df347f None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:27.209576 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426a11c-6f39-4644-9ed4-367d92df347f None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:27.210212 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426a11c-6f39-4644-9ed4-367d92df347f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:27.210519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426a11c-6f39-4644-9ed4-367d92df347f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:27.211950 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426a11c-6f39-4644-9ed4-367d92df347f None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:27.223561 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 617/1238] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:27.229551 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22f3f7-e6de-46ed-b93c-f862b42ae58b None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:27.329586 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22f3f7-e6de-46ed-b93c-f862b42ae58b None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:27.365446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800d85d-b1d0-4b7f-ae19-6a52b8ef2282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:27.366062 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800d85d-b1d0-4b7f-ae19-6a52b8ef2282 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:27.366347 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800d85d-b1d0-4b7f-ae19-6a52b8ef2282 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:27.366614 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800d85d-b1d0-4b7f-ae19-6a52b8ef2282 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:27.369260 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:27.373706 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800d85d-b1d0-4b7f-ae19-6a52b8ef2282 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:27.375212 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800d85d-b1d0-4b7f-ae19-6a52b8ef2282 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:27.386370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-7800d85d-b1d0-4b7f-ae19-6a52b8ef2282 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 13:38:27.386370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:27.386370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:27.386370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:27.386370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:27.386370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:27.386370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:27.386370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:27.386370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:27.386370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:27.386370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:27.386370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:27.386370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:38:27.386370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:38:27.386370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:38:27.386370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:38:27.387434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:27.387434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:27.387434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:38:27.387434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:38:27.387434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:38:27.387434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:38:27.387434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:27.387434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:27.387434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:27.387434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:27.387434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:27.387434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:27.387434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:27.387434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:27.387434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:27.387434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:27.387434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:27.387434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:27.388463 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:27.388463 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:27.388463 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:38:27.388463 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:38:27.388463 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:38:27.388463 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:38:27.388463 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:38:27.388463 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:38:27.388463 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 13:38:27.388463 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:38:27.388463 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 622/1239] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:38:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:27.393411 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426a11c-6f39-4644-9ed4-367d92df347f None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:27.491596 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426a11c-6f39-4644-9ed4-367d92df347f None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:27.525814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd17c1d-110c-42d7-ada5-93473cf8457d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:27.525814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd17c1d-110c-42d7-ada5-93473cf8457d None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:27.525814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd17c1d-110c-42d7-ada5-93473cf8457d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:27.525814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd17c1d-110c-42d7-ada5-93473cf8457d None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:27.526276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd17c1d-110c-42d7-ada5-93473cf8457d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:27.526276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd17c1d-110c-42d7-ada5-93473cf8457d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:27.527811 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd17c1d-110c-42d7-ada5-93473cf8457d None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:27.547250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 618/1240] 10.222.0.50 () {56 vars in 1143 bytes} [Thu Sep 1 13:38:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:27.553199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800d85d-b1d0-4b7f-ae19-6a52b8ef2282 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:27.659507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800d85d-b1d0-4b7f-ae19-6a52b8ef2282 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:27.694821 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffec81-7ac4-4948-84df-3dd889cada47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:27.695475 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffec81-7ac4-4948-84df-3dd889cada47 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:27.695754 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffec81-7ac4-4948-84df-3dd889cada47 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:27.696020 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffec81-7ac4-4948-84df-3dd889cada47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:27.758434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:27.765352 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffec81-7ac4-4948-84df-3dd889cada47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:27.768126 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffec81-7ac4-4948-84df-3dd889cada47 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:27.865892 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 623/1241] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:38:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 13:38:27.871863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd17c1d-110c-42d7-ada5-93473cf8457d None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:27.901553 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:27.977276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd17c1d-110c-42d7-ada5-93473cf8457d None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:28.011535 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94113df9-74b2-462e-a365-6d787da016d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:28.012142 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94113df9-74b2-462e-a365-6d787da016d0 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:28.012913 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94113df9-74b2-462e-a365-6d787da016d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:28.013184 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94113df9-74b2-462e-a365-6d787da016d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:28.023007 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94113df9-74b2-462e-a365-6d787da016d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:28.024518 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94113df9-74b2-462e-a365-6d787da016d0 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:28.039403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-94113df9-74b2-462e-a365-6d787da016d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:38:28.039403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:28.039403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:28.039403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:28.039403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:28.039403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:28.039403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:28.039403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:28.039403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:28.039403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:28.039403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:28.039403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:28.039403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:38:28.039403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:38:28.039403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:38:28.039403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:38:28.040539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:28.040539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:28.040539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:28.040539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:28.040539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:28.040539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:28.040539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:28.040539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:28.040539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:28.040539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:28.040539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:28.040539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:28.040539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:28.040539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:28.040539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:28.040539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:28.040539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:38:28.041712 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:38:28.041712 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:38:28.041712 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:38:28.041712 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 619/1242] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:38:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:28.046261 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffec81-7ac4-4948-84df-3dd889cada47 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:28.139882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:28.145510 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffec81-7ac4-4948-84df-3dd889cada47 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:28.177696 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9cc26e-df7a-4d26-80c2-e810c11c4529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:28.178298 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cc26e-df7a-4d26-80c2-e810c11c4529 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:28.178582 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cc26e-df7a-4d26-80c2-e810c11c4529 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:28.178857 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cc26e-df7a-4d26-80c2-e810c11c4529 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:28.179542 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9cc26e-df7a-4d26-80c2-e810c11c4529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:28.180004 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9cc26e-df7a-4d26-80c2-e810c11c4529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:28.181308 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9cc26e-df7a-4d26-80c2-e810c11c4529 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:28.192803 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 624/1243] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:28.198575 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94113df9-74b2-462e-a365-6d787da016d0 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:28.278889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:28.299183 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94113df9-74b2-462e-a365-6d787da016d0 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:28.332483 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8d545-1acc-4394-b3d3-6219aaeed408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:28.333107 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8d545-1acc-4394-b3d3-6219aaeed408 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:28.333387 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8d545-1acc-4394-b3d3-6219aaeed408 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:28.333660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8d545-1acc-4394-b3d3-6219aaeed408 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:28.340086 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8d545-1acc-4394-b3d3-6219aaeed408 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:28.341562 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8d545-1acc-4394-b3d3-6219aaeed408 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:28.352651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-87b8d545-1acc-4394-b3d3-6219aaeed408 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:38:28.352651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:28.352651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:28.352651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:28.352651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:28.352651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:28.352651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:28.352651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:28.352651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:28.352651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:28.352651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:28.352651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:28.352651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:38:28.352651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:38:28.352651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:38:28.353593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:38:28.353593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:28.353593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:28.353593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:28.353593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:28.353593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:28.353593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:28.353593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:28.353593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:28.353593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:28.353593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:28.353593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:28.353593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:28.353593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:28.353593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:28.353593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:28.353593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:28.354580 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:38:28.354580 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:38:28.354580 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:38:28.354580 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:38:28.354580 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:38:28.354580 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:38:28.354580 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:38:28.354580 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:38:28.354580 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 620/1244] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:38:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:28.359744 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9cc26e-df7a-4d26-80c2-e810c11c4529 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:28.458235 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9cc26e-df7a-4d26-80c2-e810c11c4529 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:28.491276 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9516550-5f67-41c8-9ebe-1ea383445521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:28.491902 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9516550-5f67-41c8-9ebe-1ea383445521 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:28.492181 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9516550-5f67-41c8-9ebe-1ea383445521 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:28.492454 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9516550-5f67-41c8-9ebe-1ea383445521 None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:28.493140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9516550-5f67-41c8-9ebe-1ea383445521 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:28.493445 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9516550-5f67-41c8-9ebe-1ea383445521 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:28.494880 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9516550-5f67-41c8-9ebe-1ea383445521 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:28.507191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 625/1245] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:38:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:28.513442 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8d545-1acc-4394-b3d3-6219aaeed408 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:28.613651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8d545-1acc-4394-b3d3-6219aaeed408 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:28.649021 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7500b2-f580-41d1-9b98-97271d6f5224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:28.649615 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7500b2-f580-41d1-9b98-97271d6f5224 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:28.649894 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7500b2-f580-41d1-9b98-97271d6f5224 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:28.650164 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7500b2-f580-41d1-9b98-97271d6f5224 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:28.650884 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7500b2-f580-41d1-9b98-97271d6f5224 None admin] RBAC: Adding query filter params (role.id=f8c77ddd17fd4bc7af83e8d8905fb404, scope.project.id=6283121e17814cd792df9d0edf81bf2d, user.id=63e675d44d2c49929feb0ec0d2c0d0eb) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:28.651193 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7500b2-f580-41d1-9b98-97271d6f5224 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:28.652684 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7500b2-f580-41d1-9b98-97271d6f5224 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:28.658429 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 621/1246] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:38:28 2022] GET /identity/v3/role_assignments?user.id=63e675d44d2c49929feb0ec0d2c0d0eb&scope.project.id=6283121e17814cd792df9d0edf81bf2d&role.id=f8c77ddd17fd4bc7af83e8d8905fb404 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:38:30.597260 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badadf4b-4708-439e-ae71-9b9a8f8d95e3 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:30.597789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badadf4b-4708-439e-ae71-9b9a8f8d95e3 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:30.597789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badadf4b-4708-439e-ae71-9b9a8f8d95e3 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:30.599130 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 626/1247] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:38:30.604710 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a24b3-c807-4206-a19c-6ca855fb6eb1 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:30.605089 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a24b3-c807-4206-a19c-6ca855fb6eb1 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:30.605255 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a24b3-c807-4206-a19c-6ca855fb6eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:30.612011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:30.624240 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-d85a24b3-c807-4206-a19c-6ca855fb6eb1 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:38:30.625427 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-d85a24b3-c807-4206-a19c-6ca855fb6eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:38:30.690874 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 622/1248] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:38:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:38:30.961145 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badadf4b-4708-439e-ae71-9b9a8f8d95e3 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:30.980014 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:31.064214 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badadf4b-4708-439e-ae71-9b9a8f8d95e3 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:31.098178 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5fdfa-810a-44d9-a627-a61e625294a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:31.098799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5fdfa-810a-44d9-a627-a61e625294a9 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:31.099077 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5fdfa-810a-44d9-a627-a61e625294a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:31.099346 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5fdfa-810a-44d9-a627-a61e625294a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:31.109515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5fdfa-810a-44d9-a627-a61e625294a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:38:31.114253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-c8c5fdfa-810a-44d9-a627-a61e625294a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:38:31.114253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:31.114253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:31.114253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:31.114253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:31.114253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:31.114253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:31.114253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:31.114253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:31.114253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:31.114253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:31.114253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:31.114253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:38:31.114253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:38:31.114253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:38:31.114253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:38:31.115326 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:38:31.115326 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:38:31.115326 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:38:31.115326 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:38:31.115326 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:31.115326 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:31.115326 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:31.115326 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:31.115326 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:31.115326 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:31.115326 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:31.115326 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:31.115326 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:31.115326 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:31.115326 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:31.115326 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:31.116421 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:31.116421 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:31.116421 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:31.116421 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:31.116421 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:38:31.116421 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:38:31.116421 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:38:31.116421 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:38:31.116421 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:38:31.116421 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:38:31.116421 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:38:31.116421 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:38:31.116421 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 627/1249] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:38:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:38:31.121400 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a24b3-c807-4206-a19c-6ca855fb6eb1 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:31.219306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a24b3-c807-4206-a19c-6ca855fb6eb1 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:31.248365 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:31.253207 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba912d64-a304-4837-b01b-ebf1f72ddebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:31.253808 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba912d64-a304-4837-b01b-ebf1f72ddebc None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:31.254084 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba912d64-a304-4837-b01b-ebf1f72ddebc None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:31.254354 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba912d64-a304-4837-b01b-ebf1f72ddebc None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:31.255050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba912d64-a304-4837-b01b-ebf1f72ddebc None admin] RBAC: Adding query filter params (name=admin) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:31.255351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba912d64-a304-4837-b01b-ebf1f72ddebc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:31.256735 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba912d64-a304-4837-b01b-ebf1f72ddebc None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:31.265449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 623/1250] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:38:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:31.271441 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5fdfa-810a-44d9-a627-a61e625294a9 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:31.350997 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:31.374759 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5fdfa-810a-44d9-a627-a61e625294a9 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:31.408557 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d5d8a-bfd7-49fe-aabd-76ffca0eb98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:31.409176 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d5d8a-bfd7-49fe-aabd-76ffca0eb98e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:31.409452 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d5d8a-bfd7-49fe-aabd-76ffca0eb98e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:31.409718 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d5d8a-bfd7-49fe-aabd-76ffca0eb98e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:31.419976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d5d8a-bfd7-49fe-aabd-76ffca0eb98e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:31.421407 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d5d8a-bfd7-49fe-aabd-76ffca0eb98e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:31.435702 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-ad2d5d8a-bfd7-49fe-aabd-76ffca0eb98e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:38:31.435702 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:31.435702 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:31.435702 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:31.435702 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:31.435702 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:31.435702 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:31.435702 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:31.435702 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:31.435702 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:31.435702 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:31.435702 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:31.435702 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:38:31.435702 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:38:31.435702 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:38:31.435702 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:38:31.436826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:31.436826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:31.436826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:31.436826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:31.436826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:31.436826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:31.436826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:31.436826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:31.436826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:31.436826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:31.436826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:31.436826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:31.436826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:31.436826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:31.436826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:31.436826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:31.436826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:38:31.437769 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:38:31.437769 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:38:31.437769 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:38:31.437769 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 628/1251] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:38:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:31.443031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba912d64-a304-4837-b01b-ebf1f72ddebc None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:31.542004 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba912d64-a304-4837-b01b-ebf1f72ddebc None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:31.575612 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053ec62-32ec-46ac-9872-eaa5cd9ae863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:31.576246 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053ec62-32ec-46ac-9872-eaa5cd9ae863 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:31.576523 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053ec62-32ec-46ac-9872-eaa5cd9ae863 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:31.576794 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053ec62-32ec-46ac-9872-eaa5cd9ae863 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:31.577434 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053ec62-32ec-46ac-9872-eaa5cd9ae863 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:31.577738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053ec62-32ec-46ac-9872-eaa5cd9ae863 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:31.579109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053ec62-32ec-46ac-9872-eaa5cd9ae863 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:31.591965 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 624/1252] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:31.597551 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d5d8a-bfd7-49fe-aabd-76ffca0eb98e None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:31.696495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d5d8a-bfd7-49fe-aabd-76ffca0eb98e None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:31.723315 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:31.731349 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc377ab-1e3e-41aa-b13c-71e072e14975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:31.732036 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc377ab-1e3e-41aa-b13c-71e072e14975 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:31.732317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc377ab-1e3e-41aa-b13c-71e072e14975 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:31.732591 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc377ab-1e3e-41aa-b13c-71e072e14975 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:31.740165 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc377ab-1e3e-41aa-b13c-71e072e14975 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:31.741596 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc377ab-1e3e-41aa-b13c-71e072e14975 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:31.752593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-0cc377ab-1e3e-41aa-b13c-71e072e14975 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 13:38:31.752593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:31.752593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:31.752593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:31.752593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:31.752593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:31.752593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:31.752593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:31.752593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:31.752593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:31.752593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:31.752593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:31.752593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:38:31.752593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:38:31.752593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:38:31.752593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:38:31.753725 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:31.753725 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:31.753725 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:38:31.753725 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:38:31.753725 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:38:31.753725 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:38:31.753725 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:31.753725 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:31.753725 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:31.753725 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:31.753725 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:31.753725 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:31.753725 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:31.753725 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:31.753725 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:31.753725 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:31.753725 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:31.753725 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:31.754663 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:31.754663 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:31.754663 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:38:31.754663 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:38:31.754663 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:38:31.754663 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:38:31.754663 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:38:31.754663 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:38:31.754663 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 13:38:31.754663 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:38:31.754663 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 629/1253] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:38:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:31.759596 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053ec62-32ec-46ac-9872-eaa5cd9ae863 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:31.814455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:31.858916 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053ec62-32ec-46ac-9872-eaa5cd9ae863 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:31.893786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0a0d8-e67a-403b-ba58-b408da636d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:31.894387 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0a0d8-e67a-403b-ba58-b408da636d51 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:31.894668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0a0d8-e67a-403b-ba58-b408da636d51 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:31.894942 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0a0d8-e67a-403b-ba58-b408da636d51 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:31.895692 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0a0d8-e67a-403b-ba58-b408da636d51 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:31.896000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0a0d8-e67a-403b-ba58-b408da636d51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:31.897438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0a0d8-e67a-403b-ba58-b408da636d51 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:31.914555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 625/1254] 10.222.0.50 () {56 vars in 1143 bytes} [Thu Sep 1 13:38:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:31.920457 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc377ab-1e3e-41aa-b13c-71e072e14975 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:32.020018 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc377ab-1e3e-41aa-b13c-71e072e14975 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:32.052558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c4e7c-1571-4249-8404-9d81dd9622c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:32.053158 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c4e7c-1571-4249-8404-9d81dd9622c7 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:32.053439 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c4e7c-1571-4249-8404-9d81dd9622c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:32.053715 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c4e7c-1571-4249-8404-9d81dd9622c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:32.109883 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:32.122273 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c4e7c-1571-4249-8404-9d81dd9622c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:32.123767 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c4e7c-1571-4249-8404-9d81dd9622c7 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:32.220950 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 630/1255] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:38:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:38:32.227148 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0a0d8-e67a-403b-ba58-b408da636d51 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:32.325916 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0a0d8-e67a-403b-ba58-b408da636d51 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:32.340770 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:32.362455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09a880-63af-4582-81ca-b25386ca7d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:32.363021 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09a880-63af-4582-81ca-b25386ca7d60 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:32.363303 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09a880-63af-4582-81ca-b25386ca7d60 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:32.363606 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09a880-63af-4582-81ca-b25386ca7d60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:32.373910 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09a880-63af-4582-81ca-b25386ca7d60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:32.375458 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09a880-63af-4582-81ca-b25386ca7d60 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:32.389611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-6d09a880-63af-4582-81ca-b25386ca7d60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:38:32.389611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:32.389611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:32.389611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:32.389611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:32.389611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:32.389611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:32.389611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:32.389611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:32.389611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:32.389611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:32.389611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:32.389611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:38:32.389611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:38:32.389611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:38:32.389611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:38:32.390709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:32.390709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:32.390709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:32.390709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:32.390709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:32.390709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:32.390709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:32.390709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:32.390709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:32.390709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:32.390709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:32.390709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:32.390709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:32.390709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:32.390709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:32.390709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:32.390709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:38:32.391853 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:38:32.391853 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:38:32.391853 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:38:32.391853 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 626/1256] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:38:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:32.396534 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c4e7c-1571-4249-8404-9d81dd9622c7 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:32.482386 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:32.493907 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c4e7c-1571-4249-8404-9d81dd9622c7 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:32.526430 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabda4f-d59d-4740-89e4-6164d827ea07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:32.527026 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabda4f-d59d-4740-89e4-6164d827ea07 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:32.527303 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabda4f-d59d-4740-89e4-6164d827ea07 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:32.527665 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabda4f-d59d-4740-89e4-6164d827ea07 None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:32.528383 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabda4f-d59d-4740-89e4-6164d827ea07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:32.528700 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabda4f-d59d-4740-89e4-6164d827ea07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:32.530051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabda4f-d59d-4740-89e4-6164d827ea07 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:32.541571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 631/1257] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:32.547164 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09a880-63af-4582-81ca-b25386ca7d60 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:32.651563 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09a880-63af-4582-81ca-b25386ca7d60 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:32.685618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e34069-d064-45bd-88ed-72645efe2016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:32.686249 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e34069-d064-45bd-88ed-72645efe2016 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:32.686527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e34069-d064-45bd-88ed-72645efe2016 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:32.686798 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e34069-d064-45bd-88ed-72645efe2016 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:32.693454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e34069-d064-45bd-88ed-72645efe2016 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:32.694959 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e34069-d064-45bd-88ed-72645efe2016 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:32.706135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-a9e34069-d064-45bd-88ed-72645efe2016 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:38:32.706135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:32.706135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:32.706135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:32.706135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:32.706135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:32.706135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:32.706135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:32.706135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:32.706135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:32.706135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:32.706135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:32.706135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:38:32.706135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:38:32.706135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:38:32.707209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:38:32.707209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:32.707209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:32.707209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:32.707209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:32.707209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:32.707209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:32.707209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:32.707209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:32.707209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:32.707209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:32.707209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:32.707209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:32.707209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:32.707209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:32.707209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:32.707209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:32.708270 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:38:32.708270 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:38:32.708270 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:38:32.708270 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:38:32.708270 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:38:32.708270 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:38:32.708270 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:38:32.708270 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:38:32.708270 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 627/1258] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:38:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:32.713179 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabda4f-d59d-4740-89e4-6164d827ea07 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:32.813484 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabda4f-d59d-4740-89e4-6164d827ea07 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:32.847127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740090d5-33c9-4853-bdd4-270727fa3854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:32.847769 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740090d5-33c9-4853-bdd4-270727fa3854 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:32.848051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740090d5-33c9-4853-bdd4-270727fa3854 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:32.848325 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740090d5-33c9-4853-bdd4-270727fa3854 None admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:32.849092 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740090d5-33c9-4853-bdd4-270727fa3854 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:32.849400 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740090d5-33c9-4853-bdd4-270727fa3854 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:32.850819 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740090d5-33c9-4853-bdd4-270727fa3854 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:32.863798 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 632/1259] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:38:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:32.869918 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e34069-d064-45bd-88ed-72645efe2016 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:32.895695 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:32.968811 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e34069-d064-45bd-88ed-72645efe2016 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:33.003106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8ba6d-f024-4188-9359-acb994060317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:33.003730 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8ba6d-f024-4188-9359-acb994060317 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:33.004010 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8ba6d-f024-4188-9359-acb994060317 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:33.004282 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8ba6d-f024-4188-9359-acb994060317 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:33.005090 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8ba6d-f024-4188-9359-acb994060317 None admin] RBAC: Adding query filter params (role.id=98ffd3c114804da292d7cb33721e9085, scope.project.id=6283121e17814cd792df9d0edf81bf2d, user.id=63e675d44d2c49929feb0ec0d2c0d0eb) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:33.005443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8ba6d-f024-4188-9359-acb994060317 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:33.006886 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8ba6d-f024-4188-9359-acb994060317 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:33.012802 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 628/1260] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:38:32 2022] GET /identity/v3/role_assignments?user.id=63e675d44d2c49929feb0ec0d2c0d0eb&scope.project.id=6283121e17814cd792df9d0edf81bf2d&role.id=98ffd3c114804da292d7cb33721e9085 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:34.905262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7332658-6478-43f4-96aa-a00fc0e6274f None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:34.905807 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7332658-6478-43f4-96aa-a00fc0e6274f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:34.905807 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7332658-6478-43f4-96aa-a00fc0e6274f None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:34.907175 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 633/1261] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:38:34.913210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3212a4a-6f98-405f-a475-610ddd11b1e1 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:34.913673 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3212a4a-6f98-405f-a475-610ddd11b1e1 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:34.913766 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3212a4a-6f98-405f-a475-610ddd11b1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:34.932524 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-b3212a4a-6f98-405f-a475-610ddd11b1e1 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:38:34.934237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b3212a4a-6f98-405f-a475-610ddd11b1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:38:35.007586 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 629/1262] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:38:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:38:35.275164 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7332658-6478-43f4-96aa-a00fc0e6274f None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:35.286913 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:35.385740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7332658-6478-43f4-96aa-a00fc0e6274f None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:35.420634 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e41397-3784-45ed-84a2-ebf1001cfa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:35.421248 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e41397-3784-45ed-84a2-ebf1001cfa87 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:35.421522 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e41397-3784-45ed-84a2-ebf1001cfa87 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:35.421791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e41397-3784-45ed-84a2-ebf1001cfa87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:35.431902 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e41397-3784-45ed-84a2-ebf1001cfa87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:38:35.436867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-b1e41397-3784-45ed-84a2-ebf1001cfa87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:38:35.436867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:35.436867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:35.436867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:35.436867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:35.436867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:35.436867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:35.436867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:35.436867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:35.436867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:35.436867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:35.436867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:35.436867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:38:35.436867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:38:35.436867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:38:35.436867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:38:35.438066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:38:35.438066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:38:35.438066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:38:35.438066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:38:35.438066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:35.438066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:35.438066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:35.438066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:35.438066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:35.438066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:35.438066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:35.438066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:35.438066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:35.438066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:35.438066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:35.438066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:35.438916 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:35.438916 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:35.438916 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:35.438916 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:35.438916 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:38:35.438916 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:38:35.438916 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:38:35.438916 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:38:35.438916 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:38:35.438916 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:38:35.438916 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:38:35.438916 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:38:35.438916 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 634/1263] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:38:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:35.444740 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3212a4a-6f98-405f-a475-610ddd11b1e1 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:35.464502 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:35.549012 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3212a4a-6f98-405f-a475-610ddd11b1e1 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:35.583297 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751f705-131a-4484-9b5b-5cd7ccc3fd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:35.583932 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751f705-131a-4484-9b5b-5cd7ccc3fd7c None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:35.584203 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751f705-131a-4484-9b5b-5cd7ccc3fd7c None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:35.584471 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751f705-131a-4484-9b5b-5cd7ccc3fd7c None admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:35.585135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751f705-131a-4484-9b5b-5cd7ccc3fd7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:35.585553 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751f705-131a-4484-9b5b-5cd7ccc3fd7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:35.586872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751f705-131a-4484-9b5b-5cd7ccc3fd7c None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:35.596230 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 630/1264] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:38:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:35.602326 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e41397-3784-45ed-84a2-ebf1001cfa87 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:35.674330 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:35.709145 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e41397-3784-45ed-84a2-ebf1001cfa87 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:35.742875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404547c-bddc-4507-9540-2c25469867d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:35.743526 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404547c-bddc-4507-9540-2c25469867d5 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:35.743836 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404547c-bddc-4507-9540-2c25469867d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:35.744109 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404547c-bddc-4507-9540-2c25469867d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:35.755972 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404547c-bddc-4507-9540-2c25469867d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:35.757426 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404547c-bddc-4507-9540-2c25469867d5 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:35.772186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-0404547c-bddc-4507-9540-2c25469867d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:38:35.772186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:35.772186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:35.772186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:35.772186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:35.772186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:35.772186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:35.772186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:35.772186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:35.772186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:35.772186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:35.772186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:35.772186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:38:35.772186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:38:35.772186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:38:35.772186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:38:35.773332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:35.773332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:35.773332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:35.773332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:35.773332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:35.773332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:35.773332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:35.773332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:35.773332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:35.773332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:35.773332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:35.773332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:35.773332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:35.773332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:35.773332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:35.773332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:35.773332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:38:35.774465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:38:35.774465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:38:35.774465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:38:35.774465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 635/1265] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:38:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:35.779216 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751f705-131a-4484-9b5b-5cd7ccc3fd7c None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:35.866207 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:35.887651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751f705-131a-4484-9b5b-5cd7ccc3fd7c None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:35.922141 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba6852-b916-40ce-bd93-569a25753816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:35.922816 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba6852-b916-40ce-bd93-569a25753816 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:35.923087 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba6852-b916-40ce-bd93-569a25753816 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:35.923389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba6852-b916-40ce-bd93-569a25753816 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:35.924038 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba6852-b916-40ce-bd93-569a25753816 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:35.924343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba6852-b916-40ce-bd93-569a25753816 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:35.925718 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba6852-b916-40ce-bd93-569a25753816 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:35.938084 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 631/1266] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:35.943872 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404547c-bddc-4507-9540-2c25469867d5 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:36.048491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404547c-bddc-4507-9540-2c25469867d5 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:36.068661 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:36.082973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9507e8e-cad0-43d3-8766-94dba4082c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:36.083572 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9507e8e-cad0-43d3-8766-94dba4082c6a None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:36.083854 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9507e8e-cad0-43d3-8766-94dba4082c6a None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:36.084126 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9507e8e-cad0-43d3-8766-94dba4082c6a None admin] PATH_INFO: `/v3/users/placement` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:36.091966 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9507e8e-cad0-43d3-8766-94dba4082c6a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:36.093413 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9507e8e-cad0-43d3-8766-94dba4082c6a None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:36.104705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-c9507e8e-cad0-43d3-8766-94dba4082c6a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 13:38:36.104705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:36.104705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:36.104705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:36.104705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:36.104705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:36.104705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:36.104705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:36.104705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:36.104705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:36.104705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:36.104705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:36.104705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:38:36.104705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:38:36.104705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:38:36.104705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:38:36.106496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:36.106496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:36.106496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:38:36.106496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:38:36.106496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:38:36.106496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:38:36.106496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:36.106496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:36.106496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:36.106496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:36.106496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:36.106496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:36.106496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:36.106496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:36.106496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:36.106496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:36.106496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:36.106496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:36.108645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:36.108645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:36.108645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:38:36.108645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:38:36.108645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:38:36.108645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:38:36.108645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:38:36.108645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:38:36.108645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 13:38:36.108645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:38:36.108645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 636/1267] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:38:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:36.112633 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba6852-b916-40ce-bd93-569a25753816 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:36.220094 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba6852-b916-40ce-bd93-569a25753816 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:36.256706 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e469e-2df0-481f-b927-6365a1afa8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:36.257318 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e469e-2df0-481f-b927-6365a1afa8e3 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:36.257629 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e469e-2df0-481f-b927-6365a1afa8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:36.257902 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e469e-2df0-481f-b927-6365a1afa8e3 None admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:36.258630 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e469e-2df0-481f-b927-6365a1afa8e3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:36.258930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e469e-2df0-481f-b927-6365a1afa8e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:36.260383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e469e-2df0-481f-b927-6365a1afa8e3 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:36.270249 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:36.278356 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 632/1268] 10.222.0.50 () {56 vars in 1143 bytes} [Thu Sep 1 13:38:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:36.284426 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9507e8e-cad0-43d3-8766-94dba4082c6a None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:36.389783 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9507e8e-cad0-43d3-8766-94dba4082c6a None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:36.426619 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55060e-abc1-4d24-9b06-373b24a74c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:36.427245 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55060e-abc1-4d24-9b06-373b24a74c03 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:36.427556 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55060e-abc1-4d24-9b06-373b24a74c03 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:36.427829 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55060e-abc1-4d24-9b06-373b24a74c03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:36.439536 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb55060e-abc1-4d24-9b06-373b24a74c03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:36.440940 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb55060e-abc1-4d24-9b06-373b24a74c03 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:36.455737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-cb55060e-abc1-4d24-9b06-373b24a74c03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:38:36.455737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:36.455737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:36.455737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:36.455737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:36.455737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:36.455737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:36.455737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:36.455737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:36.455737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:36.455737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:36.455737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:36.455737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:38:36.455737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:38:36.455737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:38:36.455737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:38:36.456865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:36.456865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:36.456865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:36.456865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:36.456865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:36.456865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:36.456865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:36.456865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:36.456865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:36.456865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:36.456865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:36.456865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:36.456865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:36.456865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:36.456865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:36.456865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:36.456865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:38:36.457976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:38:36.457976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:38:36.457976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:38:36.457976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 637/1269] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:38:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:36.464559 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e469e-2df0-481f-b927-6365a1afa8e3 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:36.567207 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e469e-2df0-481f-b927-6365a1afa8e3 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:36.602932 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8483323-c90f-44f1-a388-2838aedb3f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:36.603568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8483323-c90f-44f1-a388-2838aedb3f8d None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:36.603847 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8483323-c90f-44f1-a388-2838aedb3f8d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:36.604123 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8483323-c90f-44f1-a388-2838aedb3f8d None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:36.604758 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8483323-c90f-44f1-a388-2838aedb3f8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:36.605055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8483323-c90f-44f1-a388-2838aedb3f8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:36.606429 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8483323-c90f-44f1-a388-2838aedb3f8d None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:36.617923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 633/1270] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:38:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:38:36.624304 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55060e-abc1-4d24-9b06-373b24a74c03 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:36.656548 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:36.731872 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55060e-abc1-4d24-9b06-373b24a74c03 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:36.766690 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9b729-8190-42b0-a514-1878b42378bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:36.767318 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9b729-8190-42b0-a514-1878b42378bb None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:36.767627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9b729-8190-42b0-a514-1878b42378bb None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:36.767894 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9b729-8190-42b0-a514-1878b42378bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:36.774709 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9b729-8190-42b0-a514-1878b42378bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:36.776174 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9b729-8190-42b0-a514-1878b42378bb None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:36.787465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-b7d9b729-8190-42b0-a514-1878b42378bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:38:36.787465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:36.787465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:36.787465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:36.787465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:36.787465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:36.787465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:36.787465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:36.787465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:36.787465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:36.787465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:36.787465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:36.787465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:38:36.787465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:38:36.787465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:38:36.788709 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:38:36.788709 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:36.788709 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:36.788709 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:36.788709 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:36.788709 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:36.788709 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:36.788709 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:36.788709 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:36.788709 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:36.788709 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:36.788709 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:36.788709 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:36.788709 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:36.788709 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:36.788709 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:36.788709 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:36.800516 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:38:36.800516 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:38:36.800516 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:38:36.800516 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:38:36.800516 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:38:36.800516 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:38:36.800516 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:38:36.800516 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:38:36.800516 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 638/1271] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:38:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:36.801147 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8483323-c90f-44f1-a388-2838aedb3f8d None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:36.861309 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:36.902707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8483323-c90f-44f1-a388-2838aedb3f8d None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:36.937998 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35c7a8-da0d-4005-995d-d89f45d3325e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:36.938827 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35c7a8-da0d-4005-995d-d89f45d3325e None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:36.938827 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35c7a8-da0d-4005-995d-d89f45d3325e None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:36.939115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35c7a8-da0d-4005-995d-d89f45d3325e None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:36.939740 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35c7a8-da0d-4005-995d-d89f45d3325e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:36.940043 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35c7a8-da0d-4005-995d-d89f45d3325e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:36.941484 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35c7a8-da0d-4005-995d-d89f45d3325e None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:36.954416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 634/1272] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:38:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:36.960484 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9b729-8190-42b0-a514-1878b42378bb None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:37.053100 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:37.062403 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9b729-8190-42b0-a514-1878b42378bb None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:37.098512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ae77d-0f74-4c7c-ab39-34838bc2a87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:37.099179 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ae77d-0f74-4c7c-ab39-34838bc2a87f None admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:37.099522 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ae77d-0f74-4c7c-ab39-34838bc2a87f None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:37.099806 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ae77d-0f74-4c7c-ab39-34838bc2a87f None admin] PATH_INFO: `/v3/projects/6283121e17814cd792df9d0edf81bf2d/users/63e675d44d2c49929feb0ec0d2c0d0eb/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:37.101971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ae77d-0f74-4c7c-ab39-34838bc2a87f None admin] RBAC: Authorizing `identity:create_grant(project_id=6283121e17814cd792df9d0edf81bf2d, user_id=63e675d44d2c49929feb0ec0d2c0d0eb, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:37.103598 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ae77d-0f74-4c7c-ab39-34838bc2a87f None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:37.350740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 639/1273] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Sep 1 13:38:36 2022] PUT /identity/v3/projects/6283121e17814cd792df9d0edf81bf2d/users/63e675d44d2c49929feb0ec0d2c0d0eb/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:38:39.264616 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e875a-e8b2-435e-a87c-ca2de349d343 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:39.265116 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e875a-e8b2-435e-a87c-ca2de349d343 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:39.265116 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e875a-e8b2-435e-a87c-ca2de349d343 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:39.266472 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 635/1274] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:38:39.271666 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bc4f3-cc9b-47ff-b4d8-90dc0745d7e5 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:39.272086 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bc4f3-cc9b-47ff-b4d8-90dc0745d7e5 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:39.272222 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bc4f3-cc9b-47ff-b4d8-90dc0745d7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:39.290103 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-ed8bc4f3-cc9b-47ff-b4d8-90dc0745d7e5 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:38:39.293331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ed8bc4f3-cc9b-47ff-b4d8-90dc0745d7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:38:39.358181 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 640/1275] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:38:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:38:39.628000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e875a-e8b2-435e-a87c-ca2de349d343 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:39.732293 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e875a-e8b2-435e-a87c-ca2de349d343 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:39.751499 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:39.768272 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f794ee-38e7-4d5e-8340-cceec03b5ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:39.768922 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f794ee-38e7-4d5e-8340-cceec03b5ba2 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:39.769197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f794ee-38e7-4d5e-8340-cceec03b5ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:39.769462 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f794ee-38e7-4d5e-8340-cceec03b5ba2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:39.781451 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f794ee-38e7-4d5e-8340-cceec03b5ba2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:38:39.786360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-b1f794ee-38e7-4d5e-8340-cceec03b5ba2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:38:39.786360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:39.786360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:39.786360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:39.786360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:39.786360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:39.786360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:39.786360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:39.786360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:39.786360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:39.786360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:39.786360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:39.786360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:38:39.786360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:38:39.786360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:38:39.786360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:38:39.787512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:38:39.787512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:38:39.787512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:38:39.787512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:38:39.787512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:39.787512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:39.787512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:39.787512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:39.787512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:39.787512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:39.787512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:39.787512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:39.787512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:39.787512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:39.787512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:39.787512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:39.788551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:39.788551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:39.788551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:39.788551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:39.788551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:38:39.788551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:38:39.788551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:38:39.788551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:38:39.788551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:38:39.788551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:38:39.788551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:38:39.788551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:38:39.788551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 636/1276] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Sep 1 13:38:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:39.794320 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bc4f3-cc9b-47ff-b4d8-90dc0745d7e5 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:39.877197 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:39.894497 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bc4f3-cc9b-47ff-b4d8-90dc0745d7e5 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:39.928088 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47a5ce-786d-4086-82fc-48a82a9b172c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:39.928669 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47a5ce-786d-4086-82fc-48a82a9b172c None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:39.928948 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47a5ce-786d-4086-82fc-48a82a9b172c None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:39.929215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47a5ce-786d-4086-82fc-48a82a9b172c None admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:39.929868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47a5ce-786d-4086-82fc-48a82a9b172c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:39.930165 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47a5ce-786d-4086-82fc-48a82a9b172c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:39.931540 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47a5ce-786d-4086-82fc-48a82a9b172c None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:39.940319 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 641/1277] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Sep 1 13:38:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:39.945928 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f794ee-38e7-4d5e-8340-cceec03b5ba2 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:40.047010 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f794ee-38e7-4d5e-8340-cceec03b5ba2 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:40.084921 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5496ce4-e58a-4b57-93f5-ba5e45f2cd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:40.085554 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5496ce4-e58a-4b57-93f5-ba5e45f2cd2a None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:40.085833 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5496ce4-e58a-4b57-93f5-ba5e45f2cd2a None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:40.086102 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5496ce4-e58a-4b57-93f5-ba5e45f2cd2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:40.097699 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5496ce4-e58a-4b57-93f5-ba5e45f2cd2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:40.099209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5496ce4-e58a-4b57-93f5-ba5e45f2cd2a None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:40.114527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-f5496ce4-e58a-4b57-93f5-ba5e45f2cd2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:38:40.114527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:40.114527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:40.114527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:40.114527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:40.114527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:40.114527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:40.114527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:40.114527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:40.114527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:40.114527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:40.114527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:40.114527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:38:40.114527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:38:40.114527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:38:40.114527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:38:40.115782 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:40.115782 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:40.115782 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:40.115782 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:40.115782 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:40.115782 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:40.115782 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:40.115782 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:40.115782 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:40.115782 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:40.115782 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:40.115782 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:40.115782 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:40.115782 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:40.115782 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:40.115782 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:40.115782 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:38:40.116795 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:38:40.116795 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:38:40.116795 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:38:40.116795 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 637/1278] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:38:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:40.121776 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47a5ce-786d-4086-82fc-48a82a9b172c None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:40.223744 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47a5ce-786d-4086-82fc-48a82a9b172c None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:40.257568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f62610-b487-4083-8d06-1d171f91edaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:40.258164 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f62610-b487-4083-8d06-1d171f91edaf None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:40.258441 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f62610-b487-4083-8d06-1d171f91edaf None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:40.258708 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f62610-b487-4083-8d06-1d171f91edaf None admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:40.259336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f62610-b487-4083-8d06-1d171f91edaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:40.259670 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f62610-b487-4083-8d06-1d171f91edaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:40.261019 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f62610-b487-4083-8d06-1d171f91edaf None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:40.272796 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 642/1279] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:40.278872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5496ce4-e58a-4b57-93f5-ba5e45f2cd2a None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:40.310974 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:40.378255 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5496ce4-e58a-4b57-93f5-ba5e45f2cd2a None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:40.416561 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fe2a6-0799-4f40-81b2-ca744202540d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:40.417193 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fe2a6-0799-4f40-81b2-ca744202540d None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:40.417474 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fe2a6-0799-4f40-81b2-ca744202540d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:40.418422 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fe2a6-0799-4f40-81b2-ca744202540d None admin] PATH_INFO: `/v3/users/placement` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:40.425763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724fe2a6-0799-4f40-81b2-ca744202540d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:40.427216 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724fe2a6-0799-4f40-81b2-ca744202540d None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:40.439294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-724fe2a6-0799-4f40-81b2-ca744202540d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 13:38:40.439294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:40.439294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:40.439294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:40.439294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:40.439294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:40.439294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:40.439294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:40.439294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:40.439294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:40.439294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:40.439294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:40.439294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:38:40.439294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:38:40.439294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:38:40.439294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:38:40.440414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:40.440414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:40.440414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:38:40.440414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:38:40.440414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:38:40.440414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:38:40.440414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:40.440414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:40.440414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:40.440414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:40.440414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:40.440414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:40.440414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:40.440414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:40.440414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:40.440414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:40.440414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:40.440414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:40.441381 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:40.441381 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:40.441381 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:38:40.441381 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:38:40.441381 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:38:40.441381 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:38:40.441381 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:38:40.441381 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:38:40.441381 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 13:38:40.441381 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:38:40.441381 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 638/1280] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:38:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:40.446316 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f62610-b487-4083-8d06-1d171f91edaf None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:40.450853 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:40.547160 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f62610-b487-4083-8d06-1d171f91edaf None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:40.580671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eacc35-7355-49c1-918c-464f764cbaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:40.581272 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eacc35-7355-49c1-918c-464f764cbaeb None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:40.581555 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eacc35-7355-49c1-918c-464f764cbaeb None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:40.581828 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eacc35-7355-49c1-918c-464f764cbaeb None admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:40.582612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eacc35-7355-49c1-918c-464f764cbaeb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:40.582923 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eacc35-7355-49c1-918c-464f764cbaeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:40.584427 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eacc35-7355-49c1-918c-464f764cbaeb None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:40.601654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 643/1281] 10.222.0.50 () {56 vars in 1143 bytes} [Thu Sep 1 13:38:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:40.608153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fe2a6-0799-4f40-81b2-ca744202540d None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:40.698745 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:40.708116 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fe2a6-0799-4f40-81b2-ca744202540d None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:40.742177 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4a115-02e2-4b6e-84d9-8ef1f2e53ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:40.742779 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4a115-02e2-4b6e-84d9-8ef1f2e53ef1 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:40.743060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4a115-02e2-4b6e-84d9-8ef1f2e53ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:40.743332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4a115-02e2-4b6e-84d9-8ef1f2e53ef1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:40.811751 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4a115-02e2-4b6e-84d9-8ef1f2e53ef1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:40.813140 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4a115-02e2-4b6e-84d9-8ef1f2e53ef1 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:40.905708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:40.915565 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 639/1282] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Sep 1 13:38:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:38:40.925372 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eacc35-7355-49c1-918c-464f764cbaeb None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:40.988354 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:41.026187 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eacc35-7355-49c1-918c-464f764cbaeb None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:41.060898 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397586f1-d212-4599-bcd4-0fa1605346a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:41.061525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397586f1-d212-4599-bcd4-0fa1605346a3 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:41.061850 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397586f1-d212-4599-bcd4-0fa1605346a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:41.062072 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397586f1-d212-4599-bcd4-0fa1605346a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:41.072610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397586f1-d212-4599-bcd4-0fa1605346a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:41.074583 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397586f1-d212-4599-bcd4-0fa1605346a3 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:41.090114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-397586f1-d212-4599-bcd4-0fa1605346a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:38:41.090114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:41.090114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:41.090114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:41.090114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:41.090114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:41.090114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:41.090114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:41.090114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:41.090114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:41.090114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:41.090114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:41.090114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:38:41.090114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:38:41.090114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:38:41.090114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:38:41.091256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:41.091256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:41.091256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:41.091256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:41.091256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:41.091256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:41.091256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:41.091256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:41.091256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:41.091256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:41.091256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:41.091256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:41.091256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:41.091256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:41.091256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:41.091256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:41.091256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:38:41.092376 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:38:41.092376 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:38:41.092376 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:38:41.092376 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 644/1283] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:38:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:41.097333 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4a115-02e2-4b6e-84d9-8ef1f2e53ef1 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:41.197198 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4a115-02e2-4b6e-84d9-8ef1f2e53ef1 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:41.232092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c393e5-2bef-4150-86e9-fa5eedfc2df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:41.232693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c393e5-2bef-4150-86e9-fa5eedfc2df4 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:41.232972 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c393e5-2bef-4150-86e9-fa5eedfc2df4 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:41.233242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c393e5-2bef-4150-86e9-fa5eedfc2df4 None admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:41.233937 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c393e5-2bef-4150-86e9-fa5eedfc2df4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:41.234238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c393e5-2bef-4150-86e9-fa5eedfc2df4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:41.235652 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c393e5-2bef-4150-86e9-fa5eedfc2df4 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:41.247089 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 640/1284] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Sep 1 13:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:41.252842 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397586f1-d212-4599-bcd4-0fa1605346a3 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:41.355617 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397586f1-d212-4599-bcd4-0fa1605346a3 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:41.372460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:41.392514 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22981370-d87e-431d-bf73-c204a39060e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:41.393133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22981370-d87e-431d-bf73-c204a39060e7 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:41.393409 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22981370-d87e-431d-bf73-c204a39060e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:41.393678 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22981370-d87e-431d-bf73-c204a39060e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:41.400160 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22981370-d87e-431d-bf73-c204a39060e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:41.401626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22981370-d87e-431d-bf73-c204a39060e7 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:41.413115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application [None req-22981370-d87e-431d-bf73-c204a39060e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:38:41.413115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:41.413115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:41.413115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:41.413115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:41.413115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:41.413115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:41.413115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:41.413115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:41.413115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:41.413115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:41.413115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:41.413115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:38:41.413115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:38:41.413115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:38:41.414147 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:38:41.414147 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:41.414147 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:41.414147 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:41.414147 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:41.414147 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:41.414147 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:41.414147 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:41.414147 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:41.414147 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:41.414147 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:41.414147 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:41.414147 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:41.414147 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:41.414147 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:41.414147 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:41.414147 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:41.415226 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:38:41.415226 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:38:41.415226 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:38:41.415226 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:38:41.415226 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:38:41.415226 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:38:41.415226 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:38:41.415226 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: ERROR keystone.server.flask.application Sep 01 13:38:41.415226 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 645/1285] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Sep 1 13:38:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:41.420197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c393e5-2bef-4150-86e9-fa5eedfc2df4 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:41.470976 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:41.521082 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c393e5-2bef-4150-86e9-fa5eedfc2df4 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:41.556151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f1bb9-3331-4fb8-8ee7-479976443455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:41.556818 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f1bb9-3331-4fb8-8ee7-479976443455 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:41.557120 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f1bb9-3331-4fb8-8ee7-479976443455 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:41.557394 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f1bb9-3331-4fb8-8ee7-479976443455 None admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:41.558098 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f1bb9-3331-4fb8-8ee7-479976443455 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:41.558597 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f1bb9-3331-4fb8-8ee7-479976443455 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:41.560098 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f1bb9-3331-4fb8-8ee7-479976443455 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:41.572761 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 641/1286] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Sep 1 13:38:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:41.579444 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22981370-d87e-431d-bf73-c204a39060e7 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:41.685585 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22981370-d87e-431d-bf73-c204a39060e7 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:41.719806 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e1556-a9ba-453e-a798-50ce48751a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:41.720417 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e1556-a9ba-453e-a798-50ce48751a10 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:41.720696 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e1556-a9ba-453e-a798-50ce48751a10 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:41.720964 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e1556-a9ba-453e-a798-50ce48751a10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:41.721690 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e1556-a9ba-453e-a798-50ce48751a10 None admin] RBAC: Adding query filter params (role.id=98ffd3c114804da292d7cb33721e9085, scope.project.id=6283121e17814cd792df9d0edf81bf2d, user.id=63e675d44d2c49929feb0ec0d2c0d0eb) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:41.722054 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e1556-a9ba-453e-a798-50ce48751a10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:41.723629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e1556-a9ba-453e-a798-50ce48751a10 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:41.738474 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 646/1287] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Sep 1 13:38:41 2022] GET /identity/v3/role_assignments?user.id=63e675d44d2c49929feb0ec0d2c0d0eb&scope.project.id=6283121e17814cd792df9d0edf81bf2d&role.id=98ffd3c114804da292d7cb33721e9085 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:43.733038 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32209826-7382-4829-9abe-efbfa9dd755c None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:43.733683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32209826-7382-4829-9abe-efbfa9dd755c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:43.733683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32209826-7382-4829-9abe-efbfa9dd755c None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:43.734932 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 642/1288] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:38:43.740510 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62552ac7-d85e-4a68-ac93-966204a730f0 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:43.741006 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62552ac7-d85e-4a68-ac93-966204a730f0 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:43.741103 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62552ac7-d85e-4a68-ac93-966204a730f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:43.760157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-62552ac7-d85e-4a68-ac93-966204a730f0 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:38:43.761399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-62552ac7-d85e-4a68-ac93-966204a730f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:38:43.793386 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:43.830867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 647/1289] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:38:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:38:44.103932 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32209826-7382-4829-9abe-efbfa9dd755c None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:44.208816 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32209826-7382-4829-9abe-efbfa9dd755c None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:44.220098 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:44.244066 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f8c68-edc2-4335-998f-a0fef5c7d66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:44.244702 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f8c68-edc2-4335-998f-a0fef5c7d66d None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:44.244984 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f8c68-edc2-4335-998f-a0fef5c7d66d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:44.245256 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f8c68-edc2-4335-998f-a0fef5c7d66d None admin] PATH_INFO: `/v3/services/placement` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:44.246466 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f8c68-edc2-4335-998f-a0fef5c7d66d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:44.247910 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f8c68-edc2-4335-998f-a0fef5c7d66d None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:44.256880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-978f8c68-edc2-4335-998f-a0fef5c7d66d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 13:38:44.256880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:44.256880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:38:44.256880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:38:44.256880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:38:44.256880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:38:44.256880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:38:44.256880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:38:44.256880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 13:38:44.256880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:38:44.256880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:38:44.256880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:38:44.256880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:44.256880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:44.256880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:44.256880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:44.256880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:44.260079 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:44.260079 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:44.260079 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:44.260079 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:44.260079 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:44.260079 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:44.260079 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:38:44.260079 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:38:44.260079 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:38:44.260079 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:38:44.260079 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:44.260079 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:44.260079 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:44.260079 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:44.260079 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:44.260079 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:44.261342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:44.261342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:44.261342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:44.261342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:44.261342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:44.261342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:44.261342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:44.261342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:44.261342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:44.261342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:44.261342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:38:44.261342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:38:44.261342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 13:38:44.261342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:38:44.261342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 643/1290] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Sep 1 13:38:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:44.265428 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62552ac7-d85e-4a68-ac93-966204a730f0 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:44.364778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62552ac7-d85e-4a68-ac93-966204a730f0 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:44.398426 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9eb8b-1fe5-46ba-8f8d-a6612d437797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:44.399031 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9eb8b-1fe5-46ba-8f8d-a6612d437797 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:44.399309 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9eb8b-1fe5-46ba-8f8d-a6612d437797 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:44.399612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9eb8b-1fe5-46ba-8f8d-a6612d437797 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:44.400236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9eb8b-1fe5-46ba-8f8d-a6612d437797 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:44.400537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9eb8b-1fe5-46ba-8f8d-a6612d437797 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:44.402011 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9eb8b-1fe5-46ba-8f8d-a6612d437797 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:44.406756 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 648/1291] 10.222.0.50 () {56 vars in 1116 bytes} [Thu Sep 1 13:38:44 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:44.412648 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f8c68-edc2-4335-998f-a0fef5c7d66d None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:44.513933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f8c68-edc2-4335-998f-a0fef5c7d66d None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:44.547425 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b82db5-2e71-4f02-a5ee-e2ce007b915a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:44.548030 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b82db5-2e71-4f02-a5ee-e2ce007b915a None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:44.548316 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b82db5-2e71-4f02-a5ee-e2ce007b915a None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:44.548594 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b82db5-2e71-4f02-a5ee-e2ce007b915a None admin] PATH_INFO: `/v3/services` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:44.549215 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b82db5-2e71-4f02-a5ee-e2ce007b915a None admin] RBAC: Adding query filter params (type=placement) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:44.549517 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b82db5-2e71-4f02-a5ee-e2ce007b915a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:44.550973 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b82db5-2e71-4f02-a5ee-e2ce007b915a None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:44.555447 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 644/1292] 10.222.0.50 () {56 vars in 1116 bytes} [Thu Sep 1 13:38:44 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:46.466186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3a39f-afa9-479f-812c-880c316ee4bd None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:46.466853 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3a39f-afa9-479f-812c-880c316ee4bd None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:46.467104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3a39f-afa9-479f-812c-880c316ee4bd None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:46.469673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 649/1293] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:38:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:38:46.477118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32b584-55e4-40ac-8f69-7032145908ba None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:46.477748 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32b584-55e4-40ac-8f69-7032145908ba None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:46.477862 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32b584-55e4-40ac-8f69-7032145908ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:46.498872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-9b32b584-55e4-40ac-8f69-7032145908ba None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:38:46.500137 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-9b32b584-55e4-40ac-8f69-7032145908ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:38:46.534575 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:46.577279 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 645/1294] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:38:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:38:46.847713 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3a39f-afa9-479f-812c-880c316ee4bd None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:46.884268 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:46.964995 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3a39f-afa9-479f-812c-880c316ee4bd None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:47.003339 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03496fd3-3149-4ae1-86c1-2c7f6551bcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:47.003971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03496fd3-3149-4ae1-86c1-2c7f6551bcd8 None admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:47.004252 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03496fd3-3149-4ae1-86c1-2c7f6551bcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:47.004526 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03496fd3-3149-4ae1-86c1-2c7f6551bcd8 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:47.005181 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03496fd3-3149-4ae1-86c1-2c7f6551bcd8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:47.006590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03496fd3-3149-4ae1-86c1-2c7f6551bcd8 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:47.108812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 650/1295] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Sep 1 13:38:46 2022] POST /identity/v3/services => generated 246 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:38:49.176338 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe400f-f557-481b-9a93-34713e879479 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:49.177151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe400f-f557-481b-9a93-34713e879479 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:49.177327 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe400f-f557-481b-9a93-34713e879479 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:49.178813 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 646/1296] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:38:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:38:49.185475 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf49cee-4f9e-4599-855b-00e5795fd00f None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:49.192592 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf49cee-4f9e-4599-855b-00e5795fd00f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:49.192592 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf49cee-4f9e-4599-855b-00e5795fd00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:49.206904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-0bf49cee-4f9e-4599-855b-00e5795fd00f None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:38:49.208147 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-0bf49cee-4f9e-4599-855b-00e5795fd00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:38:49.291641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 651/1297] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:38:49 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:38:49.563427 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe400f-f557-481b-9a93-34713e879479 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:49.674243 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe400f-f557-481b-9a93-34713e879479 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:49.710109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22273a5-1f44-458e-b64d-6acdb131b0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:49.710901 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22273a5-1f44-458e-b64d-6acdb131b0e5 None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:49.711276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22273a5-1f44-458e-b64d-6acdb131b0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:49.711677 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22273a5-1f44-458e-b64d-6acdb131b0e5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:49.712349 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22273a5-1f44-458e-b64d-6acdb131b0e5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:49.713837 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22273a5-1f44-458e-b64d-6acdb131b0e5 None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:49.722787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-b22273a5-1f44-458e-b64d-6acdb131b0e5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 13:38:49.722787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:49.722787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:38:49.722787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:38:49.722787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:38:49.722787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:38:49.722787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:38:49.722787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:38:49.722787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 13:38:49.722787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:38:49.722787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:38:49.722787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:38:49.722787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:49.722787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:49.722787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:49.722787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:49.722787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:49.727324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:49.727324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:49.727324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:49.727324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:49.727324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:49.727324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:49.727324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:38:49.727324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:38:49.727324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:38:49.727324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:38:49.727324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:49.727324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:49.727324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:49.727324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:49.727324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:49.727324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:49.728945 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:49.728945 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:49.728945 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:49.728945 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:49.728945 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:49.728945 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:49.728945 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:49.728945 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:49.728945 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:49.728945 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:49.728945 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:38:49.728945 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:38:49.728945 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 13:38:49.728945 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:38:49.728945 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 647/1298] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Sep 1 13:38:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:49.735062 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf49cee-4f9e-4599-855b-00e5795fd00f None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:49.768265 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:49.851623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf49cee-4f9e-4599-855b-00e5795fd00f None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:49.886658 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd3bfb-03ee-4fcb-adcd-1caf9be97fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:49.887331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd3bfb-03ee-4fcb-adcd-1caf9be97fd4 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:49.887691 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd3bfb-03ee-4fcb-adcd-1caf9be97fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:49.888013 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd3bfb-03ee-4fcb-adcd-1caf9be97fd4 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:49.888719 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd3bfb-03ee-4fcb-adcd-1caf9be97fd4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:49.889066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd3bfb-03ee-4fcb-adcd-1caf9be97fd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:49.890502 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd3bfb-03ee-4fcb-adcd-1caf9be97fd4 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:49.895882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 652/1299] 10.222.0.50 () {56 vars in 1116 bytes} [Thu Sep 1 13:38:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:49.903147 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22273a5-1f44-458e-b64d-6acdb131b0e5 None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:49.943600 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:50.019550 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22273a5-1f44-458e-b64d-6acdb131b0e5 None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:50.057545 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729c52a-1b6c-4ba5-ad59-d77c2941cdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:50.058162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729c52a-1b6c-4ba5-ad59-d77c2941cdbd None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:50.058445 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729c52a-1b6c-4ba5-ad59-d77c2941cdbd None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:50.058715 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729c52a-1b6c-4ba5-ad59-d77c2941cdbd None admin] PATH_INFO: `/v3/endpoints` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:50.059442 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729c52a-1b6c-4ba5-ad59-d77c2941cdbd None admin] RBAC: Adding query filter params (interface=public, service_id=3eb3b0f34a334f55a587725889da8645, region_id=RegionOne) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:50.059751 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729c52a-1b6c-4ba5-ad59-d77c2941cdbd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:50.061129 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729c52a-1b6c-4ba5-ad59-d77c2941cdbd None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:50.066570 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 648/1300] 10.222.0.50 () {56 vars in 1251 bytes} [Thu Sep 1 13:38:49 2022] GET /identity/v3/endpoints?service_id=3eb3b0f34a334f55a587725889da8645&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:50.072786 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd3bfb-03ee-4fcb-adcd-1caf9be97fd4 None admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:50.160358 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:50.181644 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd3bfb-03ee-4fcb-adcd-1caf9be97fd4 None admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:50.219392 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368db619-f258-45ad-8801-ebaf1df22992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:50.220142 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368db619-f258-45ad-8801-ebaf1df22992 None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:50.220328 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368db619-f258-45ad-8801-ebaf1df22992 None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:50.220556 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368db619-f258-45ad-8801-ebaf1df22992 None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:50.221172 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368db619-f258-45ad-8801-ebaf1df22992 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:50.222667 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368db619-f258-45ad-8801-ebaf1df22992 None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:50.231112 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 653/1301] 10.222.0.50 () {56 vars in 1087 bytes} [Thu Sep 1 13:38:50 2022] GET /identity/v3/services => generated 2191 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 13:38:52.160639 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b82be0-0bd0-4169-ab53-1be47c534caa None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:52.161243 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b82be0-0bd0-4169-ab53-1be47c534caa None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:52.161243 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b82be0-0bd0-4169-ab53-1be47c534caa None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:52.162462 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 649/1302] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:38:52.168226 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52117715-12f0-412f-ae6d-668d5bfe19bf None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:52.168806 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52117715-12f0-412f-ae6d-668d5bfe19bf None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:52.168806 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52117715-12f0-412f-ae6d-668d5bfe19bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:52.189030 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-52117715-12f0-412f-ae6d-668d5bfe19bf None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:38:52.196165 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-52117715-12f0-412f-ae6d-668d5bfe19bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:38:52.263608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 654/1303] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:38:52 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:38:52.542812 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b82be0-0bd0-4169-ab53-1be47c534caa None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:52.642613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:52.649406 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b82be0-0bd0-4169-ab53-1be47c534caa None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:52.688969 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c544404-ecc8-4ad5-b2fe-7bf1de699e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:52.689601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c544404-ecc8-4ad5-b2fe-7bf1de699e0d None admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:52.689880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c544404-ecc8-4ad5-b2fe-7bf1de699e0d None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:52.690153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c544404-ecc8-4ad5-b2fe-7bf1de699e0d None admin] PATH_INFO: `/v3/services/placement` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:52.690734 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c544404-ecc8-4ad5-b2fe-7bf1de699e0d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:52.692191 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c544404-ecc8-4ad5-b2fe-7bf1de699e0d None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:52.700985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application [None req-9c544404-ecc8-4ad5-b2fe-7bf1de699e0d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 13:38:52.700985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:52.700985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:38:52.700985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:38:52.700985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:38:52.700985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:38:52.700985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:38:52.700985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:38:52.700985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 13:38:52.700985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:38:52.700985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:38:52.700985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:38:52.700985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:38:52.700985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:38:52.700985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:38:52.700985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:38:52.700985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:38:52.702237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:38:52.702237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:38:52.702237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:38:52.702237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:38:52.702237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:38:52.702237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:38:52.702237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:38:52.702237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:38:52.702237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:38:52.702237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:38:52.702237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:38:52.702237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:38:52.702237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:38:52.702237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:38:52.702237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:38:52.702237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:38:52.703271 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:38:52.703271 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application with Lock( Sep 01 13:38:52.703271 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:38:52.703271 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:38:52.703271 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:38:52.703271 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:38:52.703271 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:38:52.703271 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:38:52.703271 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:38:52.703271 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:38:52.703271 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:38:52.703271 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:38:52.703271 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 13:38:52.703271 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: ERROR keystone.server.flask.application Sep 01 13:38:52.703271 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 650/1304] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Sep 1 13:38:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:38:52.708348 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52117715-12f0-412f-ae6d-668d5bfe19bf None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:52.783525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:38:52.806593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52117715-12f0-412f-ae6d-668d5bfe19bf None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:52.844439 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c7dc3-2d0d-41d8-81f9-15ad18e2390e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:52.844768 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c7dc3-2d0d-41d8-81f9-15ad18e2390e None admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:52.845135 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c7dc3-2d0d-41d8-81f9-15ad18e2390e None admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:52.845423 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c7dc3-2d0d-41d8-81f9-15ad18e2390e None admin] PATH_INFO: `/v3/services` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:52.846401 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c7dc3-2d0d-41d8-81f9-15ad18e2390e None admin] RBAC: Adding query filter params (name=placement) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:38:52.846877 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c7dc3-2d0d-41d8-81f9-15ad18e2390e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:52.848460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c7dc3-2d0d-41d8-81f9-15ad18e2390e None admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:52.857803 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 655/1305] 10.222.0.50 () {56 vars in 1116 bytes} [Thu Sep 1 13:38:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:38:52.864790 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c544404-ecc8-4ad5-b2fe-7bf1de699e0d None admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:38:52.975062 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c544404-ecc8-4ad5-b2fe-7bf1de699e0d None admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:38:53.010385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e529e-4a8f-4d45-9840-66671eb099ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:38:53.011037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e529e-4a8f-4d45-9840-66671eb099ee None admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:38:53.011318 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e529e-4a8f-4d45-9840-66671eb099ee None admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:38:53.011626 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e529e-4a8f-4d45-9840-66671eb099ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:38:53.012283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e529e-4a8f-4d45-9840-66671eb099ee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:38:53.013661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e529e-4a8f-4d45-9840-66671eb099ee None admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:38:53.129727 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 651/1306] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:38:52 2022] POST /identity/v3/endpoints => generated 331 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:39:02.853689 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=30 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:39:03.124884 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:44.569023 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df858c5-81a0-4c11-a027-ddf979f5d8e9 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:44.571551 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df858c5-81a0-4c11-a027-ddf979f5d8e9 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:44.574174 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df858c5-81a0-4c11-a027-ddf979f5d8e9 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:44.583304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209921f1-096b-4957-9b12-2a69db8c6c3d None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:44.583804 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209921f1-096b-4957-9b12-2a69db8c6c3d None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:44.584130 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209921f1-096b-4957-9b12-2a69db8c6c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:44.587778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 656/1307] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:45:44 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:44.688714 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-209921f1-096b-4957-9b12-2a69db8c6c3d None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:44.690331 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-209921f1-096b-4957-9b12-2a69db8c6c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:44.876695 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 652/1308] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:45:45.161583 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00225dd8-e7de-4a7f-9804-ba0ba349ec52 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:45.161871 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00225dd8-e7de-4a7f-9804-ba0ba349ec52 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:45.162344 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00225dd8-e7de-4a7f-9804-ba0ba349ec52 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:45.163737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 657/1309] 10.222.0.50 () {54 vars in 965 bytes} [Thu Sep 1 13:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:45.170298 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a138d0-ce18-4440-b8e6-51e68de2c8e7 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:45.170661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a138d0-ce18-4440-b8e6-51e68de2c8e7 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:45.170886 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a138d0-ce18-4440-b8e6-51e68de2c8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:45.262217 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-e0a138d0-ce18-4440-b8e6-51e68de2c8e7 None None] MFA Rules not processed for user `72f0d372f6c34d1a9a990222d6b98948`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:45.263510 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-e0a138d0-ce18-4440-b8e6-51e68de2c8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:45.290106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:45.354462 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 653/1310] 10.222.0.50 () {58 vars in 1062 bytes} [Thu Sep 1 13:45:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:45:45.364330 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00225dd8-e7de-4a7f-9804-ba0ba349ec52 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:45.366307 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-00225dd8-e7de-4a7f-9804-ba0ba349ec52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:45.487482 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00225dd8-e7de-4a7f-9804-ba0ba349ec52 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:45.568736 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cb9d5-f471-4f86-97ac-b3685f7d6603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:45.569397 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cb9d5-f471-4f86-97ac-b3685f7d6603 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:45.569998 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cb9d5-f471-4f86-97ac-b3685f7d6603 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:45.570132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cb9d5-f471-4f86-97ac-b3685f7d6603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:45.571886 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-965cb9d5-f471-4f86-97ac-b3685f7d6603 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:45.632456 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:45.690556 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965cb9d5-f471-4f86-97ac-b3685f7d6603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:45.692123 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965cb9d5-f471-4f86-97ac-b3685f7d6603 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:45.712779 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 658/1311] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:45:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:45:47.924894 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202ded6-b5fd-4119-b00a-2c83d3931903 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:47.925461 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202ded6-b5fd-4119-b00a-2c83d3931903 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:47.925461 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202ded6-b5fd-4119-b00a-2c83d3931903 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:47.927034 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 654/1312] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:47.932673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb47f1-61a8-4391-b4e3-6deaa13a3df8 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:47.933162 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb47f1-61a8-4391-b4e3-6deaa13a3df8 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:47.933265 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb47f1-61a8-4391-b4e3-6deaa13a3df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:48.030106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-9edb47f1-61a8-4391-b4e3-6deaa13a3df8 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:48.031455 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-9edb47f1-61a8-4391-b4e3-6deaa13a3df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:48.138298 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 659/1313] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:45:48.421105 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202ded6-b5fd-4119-b00a-2c83d3931903 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:48.422637 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-f202ded6-b5fd-4119-b00a-2c83d3931903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:48.529040 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202ded6-b5fd-4119-b00a-2c83d3931903 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:48.601051 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:48.603869 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1beba0-3a07-4e55-962a-68dc612246eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:48.604478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1beba0-3a07-4e55-962a-68dc612246eb service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:48.604759 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1beba0-3a07-4e55-962a-68dc612246eb service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:48.605033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1beba0-3a07-4e55-962a-68dc612246eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:48.606646 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-fb1beba0-3a07-4e55-962a-68dc612246eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:48.720750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1beba0-3a07-4e55-962a-68dc612246eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:48.722145 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1beba0-3a07-4e55-962a-68dc612246eb service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:48.742899 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 655/1314] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:45:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:45:51.220585 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10451d-4d3e-49ec-91f1-d492668b0586 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:51.221230 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10451d-4d3e-49ec-91f1-d492668b0586 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:51.221230 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10451d-4d3e-49ec-91f1-d492668b0586 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:51.222434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 660/1315] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:51.227678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf203334-69de-4b5d-b188-ea8775f5e6e2 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:51.228084 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf203334-69de-4b5d-b188-ea8775f5e6e2 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:51.228228 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf203334-69de-4b5d-b188-ea8775f5e6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:51.294232 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-cf203334-69de-4b5d-b188-ea8775f5e6e2 None None] MFA Rules not processed for user `0d6402310bab4e4d9246f710d3c2eba1`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:51.295534 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-cf203334-69de-4b5d-b188-ea8775f5e6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:51.347611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:51.392756 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 656/1316] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:51 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:45:51.680249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10451d-4d3e-49ec-91f1-d492668b0586 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:51.681931 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-1e10451d-4d3e-49ec-91f1-d492668b0586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:51.692158 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:51.785174 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10451d-4d3e-49ec-91f1-d492668b0586 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:51.859651 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30220ab-f71f-4ac9-ab28-673c599059e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:51.860316 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30220ab-f71f-4ac9-ab28-673c599059e4 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:51.860601 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30220ab-f71f-4ac9-ab28-673c599059e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:51.860873 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30220ab-f71f-4ac9-ab28-673c599059e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:51.862492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b30220ab-f71f-4ac9-ab28-673c599059e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:51.924969 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:51.970472 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30220ab-f71f-4ac9-ab28-673c599059e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:51.971937 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30220ab-f71f-4ac9-ab28-673c599059e4 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:51.989957 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 661/1317] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:45:51 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:45:54.704454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71181575-e203-4e2c-96f4-904ab29ef35d None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:54.713472 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71181575-e203-4e2c-96f4-904ab29ef35d None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:54.713472 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71181575-e203-4e2c-96f4-904ab29ef35d None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:54.713472 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 657/1318] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:45:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:54.713780 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbd817-c2f3-46f2-a079-2f35454b93e1 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:54.713780 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbd817-c2f3-46f2-a079-2f35454b93e1 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:54.713780 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbd817-c2f3-46f2-a079-2f35454b93e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:54.778899 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-15bbd817-c2f3-46f2-a079-2f35454b93e1 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:54.780204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-15bbd817-c2f3-46f2-a079-2f35454b93e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:54.874572 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 662/1319] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:45:55.157453 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71181575-e203-4e2c-96f4-904ab29ef35d None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:55.158973 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-71181575-e203-4e2c-96f4-904ab29ef35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:55.261195 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71181575-e203-4e2c-96f4-904ab29ef35d None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:55.335290 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa836e-ee42-49c3-a916-c5112778eba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:55.336033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa836e-ee42-49c3-a916-c5112778eba5 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:55.336314 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa836e-ee42-49c3-a916-c5112778eba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:55.336586 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa836e-ee42-49c3-a916-c5112778eba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:55.338173 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-5baa836e-ee42-49c3-a916-c5112778eba5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:55.345581 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:55.446156 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa836e-ee42-49c3-a916-c5112778eba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:55.447534 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa836e-ee42-49c3-a916-c5112778eba5 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:55.464948 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 658/1320] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:45:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:45:58.376681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87309322-29c9-491d-b0c3-12b841b034c1 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:58.377245 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87309322-29c9-491d-b0c3-12b841b034c1 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:58.377245 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87309322-29c9-491d-b0c3-12b841b034c1 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:58.378640 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 663/1321] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:58.384132 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e38a2-8fc1-435c-bea4-9df9f5020113 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:58.384590 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e38a2-8fc1-435c-bea4-9df9f5020113 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:58.384868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e38a2-8fc1-435c-bea4-9df9f5020113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:58.454520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-f86e38a2-8fc1-435c-bea4-9df9f5020113 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:58.455776 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-f86e38a2-8fc1-435c-bea4-9df9f5020113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:58.535768 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:58.580739 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 659/1322] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:45:58.863088 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87309322-29c9-491d-b0c3-12b841b034c1 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:58.870032 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-87309322-29c9-491d-b0c3-12b841b034c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:58.886909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:58.973321 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87309322-29c9-491d-b0c3-12b841b034c1 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:59.045855 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075accb-6e5a-4791-ba44-f2e2f1df0883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:59.046461 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075accb-6e5a-4791-ba44-f2e2f1df0883 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:59.046739 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075accb-6e5a-4791-ba44-f2e2f1df0883 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:59.047581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075accb-6e5a-4791-ba44-f2e2f1df0883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:59.049173 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-9075accb-6e5a-4791-ba44-f2e2f1df0883 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:59.120503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:59.158770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075accb-6e5a-4791-ba44-f2e2f1df0883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:59.160152 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075accb-6e5a-4791-ba44-f2e2f1df0883 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:59.179320 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 664/1323] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:45:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 13:46:01.148539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c0d60-93be-494d-937c-23d7f578f8cc None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:01.149060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c0d60-93be-494d-937c-23d7f578f8cc None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:01.149060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c0d60-93be-494d-937c-23d7f578f8cc None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:01.150353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 660/1324] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:01.155685 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0324f66-a914-48b0-b942-b806049c1f1d None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:01.156121 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0324f66-a914-48b0-b942-b806049c1f1d None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:01.156217 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0324f66-a914-48b0-b942-b806049c1f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:01.221401 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-d0324f66-a914-48b0-b942-b806049c1f1d None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:01.222524 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-d0324f66-a914-48b0-b942-b806049c1f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:01.320746 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 665/1325] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:46:01.604658 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c0d60-93be-494d-937c-23d7f578f8cc None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:01.606201 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-ca1c0d60-93be-494d-937c-23d7f578f8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:01.719246 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c0d60-93be-494d-937c-23d7f578f8cc None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:01.797368 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d4df7-6768-44bd-ade3-59b8240bcdb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:01.797954 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d4df7-6768-44bd-ade3-59b8240bcdb6 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:01.798281 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d4df7-6768-44bd-ade3-59b8240bcdb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:01.798530 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d4df7-6768-44bd-ade3-59b8240bcdb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:01.800173 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-811d4df7-6768-44bd-ade3-59b8240bcdb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:01.818102 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:01.924574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d4df7-6768-44bd-ade3-59b8240bcdb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:01.926025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d4df7-6768-44bd-ade3-59b8240bcdb6 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:01.943689 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 661/1326] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:46:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:46:03.941453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d32e0-bc3b-4cc4-b600-896ca928bb4c None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:03.942014 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d32e0-bc3b-4cc4-b600-896ca928bb4c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:03.942159 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d32e0-bc3b-4cc4-b600-896ca928bb4c None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:03.943705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 666/1327] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:03.949346 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e132be1-06b3-45d9-a11c-93ab38cdae9b None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:03.949819 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e132be1-06b3-45d9-a11c-93ab38cdae9b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:03.949819 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e132be1-06b3-45d9-a11c-93ab38cdae9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:04.020842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-9e132be1-06b3-45d9-a11c-93ab38cdae9b None None] MFA Rules not processed for user `0d6402310bab4e4d9246f710d3c2eba1`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:04.022039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-9e132be1-06b3-45d9-a11c-93ab38cdae9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:04.092481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:04.125588 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 662/1328] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:03 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:46:04.410606 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d32e0-bc3b-4cc4-b600-896ca928bb4c None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:04.412201 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b08d32e0-bc3b-4cc4-b600-896ca928bb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:04.455642 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:04.535228 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d32e0-bc3b-4cc4-b600-896ca928bb4c None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:04.612729 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76f9b4-95e7-4050-bcb8-dcc90eadbca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:04.613328 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76f9b4-95e7-4050-bcb8-dcc90eadbca9 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:04.613602 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76f9b4-95e7-4050-bcb8-dcc90eadbca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:04.613872 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76f9b4-95e7-4050-bcb8-dcc90eadbca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:04.615476 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-5e76f9b4-95e7-4050-bcb8-dcc90eadbca9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:04.691464 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:04.722873 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76f9b4-95e7-4050-bcb8-dcc90eadbca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:04.724356 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76f9b4-95e7-4050-bcb8-dcc90eadbca9 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:04.743955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 667/1329] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:46:04 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:46:07.075389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe287363-e6ea-4fac-bf24-25d347fed5ce None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:07.075960 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe287363-e6ea-4fac-bf24-25d347fed5ce None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:07.075960 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe287363-e6ea-4fac-bf24-25d347fed5ce None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:07.077359 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 663/1330] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:07.083286 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09f1d9-c824-409b-8682-21827c64093e None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:07.083761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09f1d9-c824-409b-8682-21827c64093e None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:07.083855 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09f1d9-c824-409b-8682-21827c64093e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:07.152248 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-8e09f1d9-c824-409b-8682-21827c64093e None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:07.153365 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-8e09f1d9-c824-409b-8682-21827c64093e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:07.248799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 668/1331] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:46:07.526220 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe287363-e6ea-4fac-bf24-25d347fed5ce None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:07.527872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-fe287363-e6ea-4fac-bf24-25d347fed5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:07.630180 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe287363-e6ea-4fac-bf24-25d347fed5ce None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:07.700836 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc9dda-f1b9-4b9e-8edb-c0da87764c39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:07.701432 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc9dda-f1b9-4b9e-8edb-c0da87764c39 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:07.704418 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc9dda-f1b9-4b9e-8edb-c0da87764c39 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:07.704418 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc9dda-f1b9-4b9e-8edb-c0da87764c39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:07.704418 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-6bbc9dda-f1b9-4b9e-8edb-c0da87764c39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:07.730019 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:07.812899 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc9dda-f1b9-4b9e-8edb-c0da87764c39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:07.814334 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc9dda-f1b9-4b9e-8edb-c0da87764c39 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:07.832301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 664/1332] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:46:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:46:09.801339 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe4fd2-470f-47ac-a3d1-2022c2239256 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:09.801876 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe4fd2-470f-47ac-a3d1-2022c2239256 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:09.801876 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe4fd2-470f-47ac-a3d1-2022c2239256 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:09.803292 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 669/1333] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:09.808405 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518ed86-4277-491a-a2b3-82a1be52a8f8 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:09.808849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518ed86-4277-491a-a2b3-82a1be52a8f8 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:09.808946 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518ed86-4277-491a-a2b3-82a1be52a8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:09.873969 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-0518ed86-4277-491a-a2b3-82a1be52a8f8 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:09.875675 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-0518ed86-4277-491a-a2b3-82a1be52a8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:09.947959 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:09.969846 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 665/1334] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:46:10.253439 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe4fd2-470f-47ac-a3d1-2022c2239256 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:10.254985 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-e9fe4fd2-470f-47ac-a3d1-2022c2239256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:10.295246 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:10.360643 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe4fd2-470f-47ac-a3d1-2022c2239256 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:10.431898 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b8ab1-8007-4df7-b1ba-eb645fd0dee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:10.432493 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b8ab1-8007-4df7-b1ba-eb645fd0dee8 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:10.432767 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b8ab1-8007-4df7-b1ba-eb645fd0dee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:10.433033 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b8ab1-8007-4df7-b1ba-eb645fd0dee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:10.434611 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-452b8ab1-8007-4df7-b1ba-eb645fd0dee8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:10.516292 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:10.541610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b8ab1-8007-4df7-b1ba-eb645fd0dee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:10.543036 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b8ab1-8007-4df7-b1ba-eb645fd0dee8 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:10.562402 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 670/1335] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:46:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:46:13.183179 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a271c-e996-48e7-b023-a0c62efd15f6 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:13.183737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a271c-e996-48e7-b023-a0c62efd15f6 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:13.183737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a271c-e996-48e7-b023-a0c62efd15f6 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:13.185028 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 666/1336] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:13.190275 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa6131-7d7f-4726-a3ef-f0130b79e8bf None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:13.190701 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa6131-7d7f-4726-a3ef-f0130b79e8bf None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:13.190811 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa6131-7d7f-4726-a3ef-f0130b79e8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:13.255457 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-a8aa6131-7d7f-4726-a3ef-f0130b79e8bf None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:13.256654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a8aa6131-7d7f-4726-a3ef-f0130b79e8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:13.356284 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 671/1337] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:46:13.645722 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a271c-e996-48e7-b023-a0c62efd15f6 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:13.647296 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-632a271c-e996-48e7-b023-a0c62efd15f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:13.755514 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a271c-e996-48e7-b023-a0c62efd15f6 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:13.828691 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a008e-f5b6-471b-9d5e-89d26818bf35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:13.829411 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a008e-f5b6-471b-9d5e-89d26818bf35 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:13.829684 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a008e-f5b6-471b-9d5e-89d26818bf35 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:13.829958 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a008e-f5b6-471b-9d5e-89d26818bf35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:13.831613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-201a008e-f5b6-471b-9d5e-89d26818bf35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:13.869225 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:13.943141 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a008e-f5b6-471b-9d5e-89d26818bf35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:13.944533 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a008e-f5b6-471b-9d5e-89d26818bf35 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:13.963951 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 667/1338] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:46:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:46:18.149077 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6895678-7dbb-405b-8c22-0a996755f595 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:18.149630 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6895678-7dbb-405b-8c22-0a996755f595 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:18.149630 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6895678-7dbb-405b-8c22-0a996755f595 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:18.150939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 672/1339] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:18.156687 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cfcfd-fa49-46d2-bc4c-6695b7c45e70 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:18.157140 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cfcfd-fa49-46d2-bc4c-6695b7c45e70 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:18.157244 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cfcfd-fa49-46d2-bc4c-6695b7c45e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:18.224301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-a42cfcfd-fa49-46d2-bc4c-6695b7c45e70 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:18.225503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a42cfcfd-fa49-46d2-bc4c-6695b7c45e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:18.314186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:18.325769 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 668/1340] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:46:18.613275 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6895678-7dbb-405b-8c22-0a996755f595 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:18.614798 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-f6895678-7dbb-405b-8c22-0a996755f595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:18.668395 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:18.724951 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6895678-7dbb-405b-8c22-0a996755f595 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:18.802123 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90285760-8e92-486b-ad29-b5701834ca8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:18.802748 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90285760-8e92-486b-ad29-b5701834ca8c service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:18.803029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90285760-8e92-486b-ad29-b5701834ca8c service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:18.803300 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90285760-8e92-486b-ad29-b5701834ca8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:18.804938 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-90285760-8e92-486b-ad29-b5701834ca8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:19.016520 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:19.033359 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90285760-8e92-486b-ad29-b5701834ca8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:19.034783 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90285760-8e92-486b-ad29-b5701834ca8c service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:19.052689 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 673/1341] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:46:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:46:22.106724 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93902c-6c0c-45fd-8385-0736f505841d None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:22.107256 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93902c-6c0c-45fd-8385-0736f505841d None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:22.107256 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93902c-6c0c-45fd-8385-0736f505841d None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:22.108633 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 669/1342] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:22.114049 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977b02a-1d66-4d43-8750-a4db6a7c86c8 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:22.114441 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977b02a-1d66-4d43-8750-a4db6a7c86c8 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:22.114659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977b02a-1d66-4d43-8750-a4db6a7c86c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:22.180402 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-3977b02a-1d66-4d43-8750-a4db6a7c86c8 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:22.181598 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-3977b02a-1d66-4d43-8750-a4db6a7c86c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:22.280323 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 674/1343] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:46:22.568837 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93902c-6c0c-45fd-8385-0736f505841d None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:22.570379 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-0b93902c-6c0c-45fd-8385-0736f505841d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:22.681382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93902c-6c0c-45fd-8385-0736f505841d None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:22.758801 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68710c-8caf-434d-84d7-291b22822a23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:22.759436 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68710c-8caf-434d-84d7-291b22822a23 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:22.759719 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68710c-8caf-434d-84d7-291b22822a23 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:22.759987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68710c-8caf-434d-84d7-291b22822a23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:22.761573 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-5e68710c-8caf-434d-84d7-291b22822a23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:22.805704 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:22.874163 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68710c-8caf-434d-84d7-291b22822a23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:22.877876 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68710c-8caf-434d-84d7-291b22822a23 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:22.895502 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 670/1344] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:46:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:46:27.215690 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84d73c-3553-45fa-b8e9-f98df544416a None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:27.216261 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84d73c-3553-45fa-b8e9-f98df544416a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:27.216261 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84d73c-3553-45fa-b8e9-f98df544416a None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:27.217579 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 675/1345] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:27.223117 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f2564-e5cc-40ca-852f-e9234d7685e4 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:27.223677 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f2564-e5cc-40ca-852f-e9234d7685e4 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:27.223677 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f2564-e5cc-40ca-852f-e9234d7685e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:27.295720 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-0a7f2564-e5cc-40ca-852f-e9234d7685e4 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:27.297413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-0a7f2564-e5cc-40ca-852f-e9234d7685e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:27.398364 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:27.400846 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 671/1346] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:46:27.681918 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84d73c-3553-45fa-b8e9-f98df544416a None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:27.683470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-5c84d73c-3553-45fa-b8e9-f98df544416a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:27.753462 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:27.816585 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84d73c-3553-45fa-b8e9-f98df544416a None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:27.887289 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baaa679-ff36-4243-9a5e-9d4287e3da85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:27.887920 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baaa679-ff36-4243-9a5e-9d4287e3da85 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:27.888220 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baaa679-ff36-4243-9a5e-9d4287e3da85 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:27.888488 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baaa679-ff36-4243-9a5e-9d4287e3da85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:27.890718 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-9baaa679-ff36-4243-9a5e-9d4287e3da85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:27.996050 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:27.999828 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baaa679-ff36-4243-9a5e-9d4287e3da85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:28.001263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baaa679-ff36-4243-9a5e-9d4287e3da85 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:28.020088 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 676/1347] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:46:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:46:32.965196 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd5cf6-274b-4b78-bbee-1df23bc30562 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:32.965634 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd5cf6-274b-4b78-bbee-1df23bc30562 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:32.965737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd5cf6-274b-4b78-bbee-1df23bc30562 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:32.967228 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 672/1348] 10.222.0.50 () {54 vars in 921 bytes} [Thu Sep 1 13:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:32.972338 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae82daa-e544-47a3-b9d4-e6e83412f747 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:32.972776 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae82daa-e544-47a3-b9d4-e6e83412f747 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:32.972964 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae82daa-e544-47a3-b9d4-e6e83412f747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:33.082755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-7ae82daa-e544-47a3-b9d4-e6e83412f747 None None] MFA Rules not processed for user `63e675d44d2c49929feb0ec0d2c0d0eb`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:33.084457 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-7ae82daa-e544-47a3-b9d4-e6e83412f747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:33.245120 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 677/1349] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Sep 1 13:46:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:46:37.503908 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3353231-303c-4ffb-be12-057f76bb612e None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:37.504439 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3353231-303c-4ffb-be12-057f76bb612e None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:37.504521 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3353231-303c-4ffb-be12-057f76bb612e None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:37.505941 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 673/1350] 10.222.0.50 () {54 vars in 921 bytes} [Thu Sep 1 13:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:37.511527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2390f8c-c0b4-4113-9c3c-5b6c0ac926c8 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:37.512010 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2390f8c-c0b4-4113-9c3c-5b6c0ac926c8 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:37.512093 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2390f8c-c0b4-4113-9c3c-5b6c0ac926c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:37.569545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:37.592997 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-d2390f8c-c0b4-4113-9c3c-5b6c0ac926c8 None None] MFA Rules not processed for user `63e675d44d2c49929feb0ec0d2c0d0eb`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:37.594193 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-d2390f8c-c0b4-4113-9c3c-5b6c0ac926c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:37.714718 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 678/1351] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Sep 1 13:46:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:46:38.969148 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43369e-1a87-48ad-9395-1848852d59e6 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:38.969709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43369e-1a87-48ad-9395-1848852d59e6 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:38.969709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43369e-1a87-48ad-9395-1848852d59e6 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:38.971015 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 674/1352] 10.222.0.50 () {54 vars in 921 bytes} [Thu Sep 1 13:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:38.976356 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fbe3b-86ef-4f83-b07b-7580e3acc75b None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:38.976776 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fbe3b-86ef-4f83-b07b-7580e3acc75b None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:38.976911 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fbe3b-86ef-4f83-b07b-7580e3acc75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:39.054922 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-bf7fbe3b-86ef-4f83-b07b-7580e3acc75b None None] MFA Rules not processed for user `63e675d44d2c49929feb0ec0d2c0d0eb`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:39.056147 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-bf7fbe3b-86ef-4f83-b07b-7580e3acc75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:39.098643 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:39.164168 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 679/1353] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Sep 1 13:46:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:46:42.528132 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c30a6-ce68-497f-842c-06f1cf823ce2 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:42.528682 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c30a6-ce68-497f-842c-06f1cf823ce2 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:42.528682 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c30a6-ce68-497f-842c-06f1cf823ce2 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:42.530048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 675/1354] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:42.535342 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219179d4-f5fb-4a62-bf13-1b8e3e6bc99a None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:42.535819 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219179d4-f5fb-4a62-bf13-1b8e3e6bc99a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:42.535924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219179d4-f5fb-4a62-bf13-1b8e3e6bc99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:42.617306 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-219179d4-f5fb-4a62-bf13-1b8e3e6bc99a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:42.618507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-219179d4-f5fb-4a62-bf13-1b8e3e6bc99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:42.755471 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 680/1355] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:46:43.055994 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac88da-1f42-42a6-b1ad-42c9db73fe8a None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:43.056500 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac88da-1f42-42a6-b1ad-42c9db73fe8a None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:43.056967 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac88da-1f42-42a6-b1ad-42c9db73fe8a None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:43.058758 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 676/1356] 10.222.0.50 () {54 vars in 962 bytes} [Thu Sep 1 13:46:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:43.067348 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b928c9-a82a-4cef-9584-4696a504f3db None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:43.068050 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b928c9-a82a-4cef-9584-4696a504f3db None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:43.068670 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b928c9-a82a-4cef-9584-4696a504f3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:43.089962 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:43.156660 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-89b928c9-a82a-4cef-9584-4696a504f3db None None] MFA Rules not processed for user `2d231136bcd44d9a97efe6c257f936ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:43.157911 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-89b928c9-a82a-4cef-9584-4696a504f3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:43.278924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 681/1357] 10.222.0.50 () {58 vars in 1059 bytes} [Thu Sep 1 13:46:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:46:43.298656 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac88da-1f42-42a6-b1ad-42c9db73fe8a None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:43.300667 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-64ac88da-1f42-42a6-b1ad-42c9db73fe8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:43.465710 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac88da-1f42-42a6-b1ad-42c9db73fe8a None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:43.546034 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:43.591284 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892e419-0f31-4be6-8a28-f9351e2a6fcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:43.591921 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892e419-0f31-4be6-8a28-f9351e2a6fcf service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:43.592247 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892e419-0f31-4be6-8a28-f9351e2a6fcf service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:43.592543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892e419-0f31-4be6-8a28-f9351e2a6fcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:43.594132 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-7892e419-0f31-4be6-8a28-f9351e2a6fcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:43.692853 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7892e419-0f31-4be6-8a28-f9351e2a6fcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:43.694639 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7892e419-0f31-4be6-8a28-f9351e2a6fcf service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:43.713643 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 677/1358] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:46:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:46:45.850071 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850063e-fe07-47a6-88f0-f50da22918f3 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:45.850689 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850063e-fe07-47a6-88f0-f50da22918f3 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:45.850689 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850063e-fe07-47a6-88f0-f50da22918f3 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:45.855683 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 682/1359] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:46:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:45.857308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f711ba0-ddbd-480b-83e6-a23983c7d63c None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:45.857729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f711ba0-ddbd-480b-83e6-a23983c7d63c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:45.857888 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f711ba0-ddbd-480b-83e6-a23983c7d63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:45.929086 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-6f711ba0-ddbd-480b-83e6-a23983c7d63c None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:45.930249 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-6f711ba0-ddbd-480b-83e6-a23983c7d63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:45.970126 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:46.033751 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 678/1360] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:46:46.325271 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850063e-fe07-47a6-88f0-f50da22918f3 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:46.327268 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c850063e-fe07-47a6-88f0-f50da22918f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:46.450847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:46.541784 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850063e-fe07-47a6-88f0-f50da22918f3 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:46.662734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f4fad-c02b-4531-aa10-9dc9f661da88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:46.663554 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f4fad-c02b-4531-aa10-9dc9f661da88 service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:46.664077 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f4fad-c02b-4531-aa10-9dc9f661da88 service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:46.664458 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f4fad-c02b-4531-aa10-9dc9f661da88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:46.666163 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-393f4fad-c02b-4531-aa10-9dc9f661da88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:46.689677 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:46.765584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f4fad-c02b-4531-aa10-9dc9f661da88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:46.767190 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f4fad-c02b-4531-aa10-9dc9f661da88 service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:46.787938 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 683/1361] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:46:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:46:49.229293 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47903797-b185-4d76-8dc0-fb3df5816fe6 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:49.230251 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47903797-b185-4d76-8dc0-fb3df5816fe6 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:49.230765 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47903797-b185-4d76-8dc0-fb3df5816fe6 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:49.232957 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 679/1362] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:46:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:49.238604 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13190839-9da3-44b0-a77a-e43b12998d7a None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:49.239491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13190839-9da3-44b0-a77a-e43b12998d7a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:49.240000 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13190839-9da3-44b0-a77a-e43b12998d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:49.310244 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-13190839-9da3-44b0-a77a-e43b12998d7a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:49.312427 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-13190839-9da3-44b0-a77a-e43b12998d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:49.413501 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:49.416572 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 684/1363] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:46:49.711240 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b15ec9-6b3d-4756-ad6a-1249f8655c69 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:49.711649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b15ec9-6b3d-4756-ad6a-1249f8655c69 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:49.712076 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b15ec9-6b3d-4756-ad6a-1249f8655c69 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:49.713506 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 680/1364] 10.222.0.50 () {54 vars in 962 bytes} [Thu Sep 1 13:46:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:49.719834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394b818-e882-47ff-898c-84cd47a4a858 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:49.720195 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394b818-e882-47ff-898c-84cd47a4a858 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:49.720545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394b818-e882-47ff-898c-84cd47a4a858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:49.803907 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-7394b818-e882-47ff-898c-84cd47a4a858 None None] MFA Rules not processed for user `2d231136bcd44d9a97efe6c257f936ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:49.805101 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-7394b818-e882-47ff-898c-84cd47a4a858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:49.938053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 685/1365] 10.222.0.50 () {58 vars in 1059 bytes} [Thu Sep 1 13:46:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:46:49.947899 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b15ec9-6b3d-4756-ad6a-1249f8655c69 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:49.949315 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c7b15ec9-6b3d-4756-ad6a-1249f8655c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:50.112936 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b15ec9-6b3d-4756-ad6a-1249f8655c69 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:50.135450 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:50.241858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191a3dd-d002-472f-8bac-63ecf1874114 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:50.242509 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191a3dd-d002-472f-8bac-63ecf1874114 service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:50.242810 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191a3dd-d002-472f-8bac-63ecf1874114 service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:50.243013 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191a3dd-d002-472f-8bac-63ecf1874114 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:50.244611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-4191a3dd-d002-472f-8bac-63ecf1874114 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:50.340104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191a3dd-d002-472f-8bac-63ecf1874114 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:50.341819 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191a3dd-d002-472f-8bac-63ecf1874114 service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:50.360793 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 681/1366] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:46:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:46:50.825994 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cd7aa-312c-40a9-b369-62fa0f0e128e None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:50.826547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cd7aa-312c-40a9-b369-62fa0f0e128e None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:50.826652 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cd7aa-312c-40a9-b369-62fa0f0e128e None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:50.828140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 686/1367] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:50.833216 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f48ef1-0d2d-4f7b-888a-27ff8a3f72f8 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:50.833506 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f48ef1-0d2d-4f7b-888a-27ff8a3f72f8 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:50.833781 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f48ef1-0d2d-4f7b-888a-27ff8a3f72f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:50.867463 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:50.910258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-e3f48ef1-0d2d-4f7b-888a-27ff8a3f72f8 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:50.911496 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-e3f48ef1-0d2d-4f7b-888a-27ff8a3f72f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:51.017487 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 682/1368] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:46:51.602784 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c008b1-2409-41f5-98a5-130648805717 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:51.602784 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c008b1-2409-41f5-98a5-130648805717 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:51.602784 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c008b1-2409-41f5-98a5-130648805717 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:51.604637 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 687/1369] 10.222.0.50 () {54 vars in 964 bytes} [Thu Sep 1 13:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:51.609382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc1bd6-da32-49f3-a280-51b1fba933c1 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:51.609898 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc1bd6-da32-49f3-a280-51b1fba933c1 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:51.609898 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc1bd6-da32-49f3-a280-51b1fba933c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:51.691134 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-37dc1bd6-da32-49f3-a280-51b1fba933c1 None None] MFA Rules not processed for user `1dc5b80f0e4c48189389d23507a9d2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:51.692430 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-37dc1bd6-da32-49f3-a280-51b1fba933c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:51.746613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:51.780192 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 683/1370] 10.222.0.50 () {58 vars in 1061 bytes} [Thu Sep 1 13:46:51 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:46:51.788749 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c008b1-2409-41f5-98a5-130648805717 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:51.790570 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-63c008b1-2409-41f5-98a5-130648805717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:51.846506 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:51.908743 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c008b1-2409-41f5-98a5-130648805717 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:51.986273 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a01625-7d65-484f-94ea-4dc41f98bf40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:51.986879 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a01625-7d65-484f-94ea-4dc41f98bf40 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:51.987140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a01625-7d65-484f-94ea-4dc41f98bf40 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:51.987451 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a01625-7d65-484f-94ea-4dc41f98bf40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:51.991252 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-51a01625-7d65-484f-94ea-4dc41f98bf40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:52.097307 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:52.116795 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a01625-7d65-484f-94ea-4dc41f98bf40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:52.118629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a01625-7d65-484f-94ea-4dc41f98bf40 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:52.143787 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 688/1371] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:46:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:46:52.552622 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb61481-de18-4e4d-b86c-c8e0241dc9c3 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:52.552931 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb61481-de18-4e4d-b86c-c8e0241dc9c3 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:52.553222 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb61481-de18-4e4d-b86c-c8e0241dc9c3 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:52.554624 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 684/1372] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:52.559822 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3333ee-65b1-4422-a5b2-d1f6c09af519 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:52.560112 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3333ee-65b1-4422-a5b2-d1f6c09af519 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:52.560904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3333ee-65b1-4422-a5b2-d1f6c09af519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:52.627439 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-8c3333ee-65b1-4422-a5b2-d1f6c09af519 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:52.628681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-8c3333ee-65b1-4422-a5b2-d1f6c09af519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:52.726926 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 689/1373] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:46:53.022734 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb61481-de18-4e4d-b86c-c8e0241dc9c3 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:53.024279 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-0bb61481-de18-4e4d-b86c-c8e0241dc9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:53.171716 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb61481-de18-4e4d-b86c-c8e0241dc9c3 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:53.223854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:53.296263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0392f1-9724-46f4-abf6-b0f97d2a1a1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:53.296853 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0392f1-9724-46f4-abf6-b0f97d2a1a1a service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:53.297134 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0392f1-9724-46f4-abf6-b0f97d2a1a1a service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:53.297408 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0392f1-9724-46f4-abf6-b0f97d2a1a1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:53.299012 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-7f0392f1-9724-46f4-abf6-b0f97d2a1a1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:53.392565 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0392f1-9724-46f4-abf6-b0f97d2a1a1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:53.394184 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0392f1-9724-46f4-abf6-b0f97d2a1a1a service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:53.412795 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 685/1374] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:46:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:46:55.529997 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb28bb3-8616-4295-ac83-2e1d2fad9a2a None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:55.530580 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb28bb3-8616-4295-ac83-2e1d2fad9a2a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:55.530580 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb28bb3-8616-4295-ac83-2e1d2fad9a2a None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:55.531905 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 690/1375] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:55.537103 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd981d4-b0ef-4c57-b16e-23362019edc3 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:55.537715 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd981d4-b0ef-4c57-b16e-23362019edc3 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:55.537715 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd981d4-b0ef-4c57-b16e-23362019edc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:55.603657 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-0fd981d4-b0ef-4c57-b16e-23362019edc3 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:55.604854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-0fd981d4-b0ef-4c57-b16e-23362019edc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:55.612471 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:55.706001 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 686/1376] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:46:56.022618 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb28bb3-8616-4295-ac83-2e1d2fad9a2a None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:56.024122 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-0bb28bb3-8616-4295-ac83-2e1d2fad9a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:56.090035 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:56.191325 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb28bb3-8616-4295-ac83-2e1d2fad9a2a None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:56.313376 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea04f2-1817-445e-9f77-85078a29d8d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:56.314325 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea04f2-1817-445e-9f77-85078a29d8d5 service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:56.314676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea04f2-1817-445e-9f77-85078a29d8d5 service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:56.315080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea04f2-1817-445e-9f77-85078a29d8d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:56.316791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c4ea04f2-1817-445e-9f77-85078a29d8d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:56.337145 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:56.418858 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea04f2-1817-445e-9f77-85078a29d8d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:56.421362 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea04f2-1817-445e-9f77-85078a29d8d5 service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:56.442126 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 691/1377] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:46:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:46:58.563711 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb13b98-c87e-4450-93fe-9ef4cdac3972 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:58.564306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb13b98-c87e-4450-93fe-9ef4cdac3972 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:58.564306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb13b98-c87e-4450-93fe-9ef4cdac3972 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:58.565745 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 687/1378] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:58.570938 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424f6b3-9fc2-42d8-92f1-42d3e0ec29ce None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:58.571494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424f6b3-9fc2-42d8-92f1-42d3e0ec29ce None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:58.571589 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424f6b3-9fc2-42d8-92f1-42d3e0ec29ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:58.643979 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-f424f6b3-9fc2-42d8-92f1-42d3e0ec29ce None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:58.645495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-f424f6b3-9fc2-42d8-92f1-42d3e0ec29ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:58.774488 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:58.783403 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 692/1379] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:46:59.073031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb13b98-c87e-4450-93fe-9ef4cdac3972 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:59.074656 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-bdb13b98-c87e-4450-93fe-9ef4cdac3972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:59.227060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:59.237949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb13b98-c87e-4450-93fe-9ef4cdac3972 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:59.365858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffdcf4e-bb9a-49a3-b373-5cc087a06aed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:59.366539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdcf4e-bb9a-49a3-b373-5cc087a06aed service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:59.366820 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdcf4e-bb9a-49a3-b373-5cc087a06aed service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:59.367093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdcf4e-bb9a-49a3-b373-5cc087a06aed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:59.368752 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-cffdcf4e-bb9a-49a3-b373-5cc087a06aed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:59.463033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffdcf4e-bb9a-49a3-b373-5cc087a06aed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:59.464793 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffdcf4e-bb9a-49a3-b373-5cc087a06aed service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:59.476429 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:59.488405 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 688/1380] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:46:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:47:01.947961 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977df51-2b0f-4a33-ac28-2b2db65cf364 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:01.948488 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977df51-2b0f-4a33-ac28-2b2db65cf364 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:01.948488 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977df51-2b0f-4a33-ac28-2b2db65cf364 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:01.949858 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 693/1381] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:47:01.956081 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661ed8c-c3c9-44a2-ac3d-1491d89c777b None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:01.956488 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661ed8c-c3c9-44a2-ac3d-1491d89c777b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:01.956621 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661ed8c-c3c9-44a2-ac3d-1491d89c777b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:02.026384 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-b661ed8c-c3c9-44a2-ac3d-1491d89c777b None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:02.027628 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b661ed8c-c3c9-44a2-ac3d-1491d89c777b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:02.149863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 689/1382] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:47:02.524155 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977df51-2b0f-4a33-ac28-2b2db65cf364 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:02.525673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-9977df51-2b0f-4a33-ac28-2b2db65cf364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:02.692133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977df51-2b0f-4a33-ac28-2b2db65cf364 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:02.765679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:02.814899 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b20da-afa7-4fec-ae0f-aed126f0fe5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:02.815531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b20da-afa7-4fec-ae0f-aed126f0fe5b service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:02.815813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b20da-afa7-4fec-ae0f-aed126f0fe5b service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:02.816086 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b20da-afa7-4fec-ae0f-aed126f0fe5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:02.817676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a55b20da-afa7-4fec-ae0f-aed126f0fe5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:02.924781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b20da-afa7-4fec-ae0f-aed126f0fe5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:02.926878 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b20da-afa7-4fec-ae0f-aed126f0fe5b service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:02.949534 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 694/1383] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:47:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 13:47:05.340020 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff9d39-254e-4722-b492-0b290558402c None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:05.340648 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff9d39-254e-4722-b492-0b290558402c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:05.340648 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff9d39-254e-4722-b492-0b290558402c None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:05.341952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 690/1384] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:47:05.348168 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f371466-f3fb-4b4c-b0ff-064786b32b4c None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:05.348663 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f371466-f3fb-4b4c-b0ff-064786b32b4c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:05.348770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f371466-f3fb-4b4c-b0ff-064786b32b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:05.429078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-0f371466-f3fb-4b4c-b0ff-064786b32b4c None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:05.430450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-0f371466-f3fb-4b4c-b0ff-064786b32b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:05.465239 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:05.540565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 695/1385] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:47:05.839893 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff9d39-254e-4722-b492-0b290558402c None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:05.842134 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-3cff9d39-254e-4722-b492-0b290558402c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:05.923700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:05.992347 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff9d39-254e-4722-b492-0b290558402c None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:06.107186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3952e7-daad-49eb-878d-7935d27cfe5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:06.107730 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3952e7-daad-49eb-878d-7935d27cfe5b service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:06.108012 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3952e7-daad-49eb-878d-7935d27cfe5b service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:06.108283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3952e7-daad-49eb-878d-7935d27cfe5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:06.110175 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-fa3952e7-daad-49eb-878d-7935d27cfe5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:06.149110 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:06.199962 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3952e7-daad-49eb-878d-7935d27cfe5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:06.202124 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3952e7-daad-49eb-878d-7935d27cfe5b service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:06.220721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 691/1386] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:47:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:47:07.477215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984c6be-df1d-4f56-b644-e708c999ce44 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:07.477809 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984c6be-df1d-4f56-b644-e708c999ce44 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:07.477809 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984c6be-df1d-4f56-b644-e708c999ce44 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:07.479226 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 696/1387] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:47:07.485517 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a713f76-8beb-49e5-92bf-b43c5a4aae0c None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:07.485924 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a713f76-8beb-49e5-92bf-b43c5a4aae0c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:07.486076 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a713f76-8beb-49e5-92bf-b43c5a4aae0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:07.552873 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-0a713f76-8beb-49e5-92bf-b43c5a4aae0c None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:07.554087 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-0a713f76-8beb-49e5-92bf-b43c5a4aae0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:07.655306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 692/1388] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:47:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:47:07.951966 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccf16a-9e9d-4fef-b7d3-fdf2be7ba600 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:07.952280 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccf16a-9e9d-4fef-b7d3-fdf2be7ba600 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:07.952556 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccf16a-9e9d-4fef-b7d3-fdf2be7ba600 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:07.953917 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 697/1389] 10.222.0.50 () {54 vars in 967 bytes} [Thu Sep 1 13:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:47:07.958864 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb86cb2-686f-49f0-940a-e90a86b59d09 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:07.959216 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb86cb2-686f-49f0-940a-e90a86b59d09 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:07.959581 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb86cb2-686f-49f0-940a-e90a86b59d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:07.975994 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:08.038668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-8fb86cb2-686f-49f0-940a-e90a86b59d09 None None] MFA Rules not processed for user `fc11fe25135d4bf1b1a06b8619e4a2e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:08.039888 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-8fb86cb2-686f-49f0-940a-e90a86b59d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:08.117079 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 693/1390] 10.222.0.50 () {58 vars in 1064 bytes} [Thu Sep 1 13:47:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:47:08.124599 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccf16a-9e9d-4fef-b7d3-fdf2be7ba600 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:08.126092 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ffccf16a-9e9d-4fef-b7d3-fdf2be7ba600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:08.233285 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccf16a-9e9d-4fef-b7d3-fdf2be7ba600 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:08.288189 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff8a65-0e9a-4411-84c5-adaf7d2da4d0 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:08.288477 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff8a65-0e9a-4411-84c5-adaf7d2da4d0 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:08.288769 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff8a65-0e9a-4411-84c5-adaf7d2da4d0 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:08.290100 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 694/1391] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:47:08.294988 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00d094-e16d-428a-98f1-8f690b2a1ed2 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:08.295342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00d094-e16d-428a-98f1-8f690b2a1ed2 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:08.295659 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00d094-e16d-428a-98f1-8f690b2a1ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:08.297165 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:08.313858 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0d81f-f02a-4c2a-955f-791c211c56b9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc11fe25135d4bf1b1a06b8619e4a2e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:08.316292 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0d81f-f02a-4c2a-955f-791c211c56b9 service glance] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:08.316292 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0d81f-f02a-4c2a-955f-791c211c56b9 service glance] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:08.316292 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0d81f-f02a-4c2a-955f-791c211c56b9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:08.316825 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-3eb0d81f-f02a-4c2a-955f-791c211c56b9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:08.363214 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-4f00d094-e16d-428a-98f1-8f690b2a1ed2 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:08.364499 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-4f00d094-e16d-428a-98f1-8f690b2a1ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:08.422679 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:08.434867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0d81f-f02a-4c2a-955f-791c211c56b9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:08.436340 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0d81f-f02a-4c2a-955f-791c211c56b9 service glance] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:08.454879 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 698/1392] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:47:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:47:08.467936 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 695/1393] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:47:08.762998 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0d81f-f02a-4c2a-955f-791c211c56b9 service glance] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:08.764227 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-3eb0d81f-f02a-4c2a-955f-791c211c56b9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:08.857187 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:08.865108 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0d81f-f02a-4c2a-955f-791c211c56b9 service glance] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:08.994301 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1a0be-5385-469e-9710-59f0a31805ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:08.994906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1a0be-5385-469e-9710-59f0a31805ef service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:08.995192 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1a0be-5385-469e-9710-59f0a31805ef service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:08.995492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1a0be-5385-469e-9710-59f0a31805ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:08.997641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-69f1a0be-5385-469e-9710-59f0a31805ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:09.090389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1a0be-5385-469e-9710-59f0a31805ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:09.092360 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1a0be-5385-469e-9710-59f0a31805ef service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:09.107494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:09.110566 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 699/1394] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:47:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:47:09.385675 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81006664-5f5f-4a55-8e34-db64d4bc8f74 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:09.386145 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81006664-5f5f-4a55-8e34-db64d4bc8f74 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:09.386223 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81006664-5f5f-4a55-8e34-db64d4bc8f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:09.468205 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-81006664-5f5f-4a55-8e34-db64d4bc8f74 None None] MFA Rules not processed for user `6f01578bf21244a5ac357e54979ffc0d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:09.469931 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-81006664-5f5f-4a55-8e34-db64d4bc8f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:09.571050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 696/1395] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 1 13:47:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:47:09.615556 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1c7d6-0673-4dac-8230-958b53929ae5 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:09.615811 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1c7d6-0673-4dac-8230-958b53929ae5 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:09.616031 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1c7d6-0673-4dac-8230-958b53929ae5 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:09.617558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 700/1396] 10.222.0.50 () {54 vars in 943 bytes} [Thu Sep 1 13:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:47:09.624538 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61227528-8191-48db-b44e-9a5933347b71 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:09.624848 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61227528-8191-48db-b44e-9a5933347b71 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:09.625130 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61227528-8191-48db-b44e-9a5933347b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:09.695816 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:09.717014 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-61227528-8191-48db-b44e-9a5933347b71 None None] MFA Rules not processed for user `85bbede0f8674384bcc3028ea77eb724`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:09.718234 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-61227528-8191-48db-b44e-9a5933347b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:09.829679 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 697/1397] 10.222.0.50 () {58 vars in 1040 bytes} [Thu Sep 1 13:47:09 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:47:09.839676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1c7d6-0673-4dac-8230-958b53929ae5 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:09.841187 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ade1c7d6-0673-4dac-8230-958b53929ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:09.976252 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1c7d6-0673-4dac-8230-958b53929ae5 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:10.062550 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:10.081871 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013c0c0-845f-42af-9b18-1e748bb67796 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bbede0f8674384bcc3028ea77eb724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:10.082470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013c0c0-845f-42af-9b18-1e748bb67796 service swift] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:10.082748 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013c0c0-845f-42af-9b18-1e748bb67796 service swift] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:10.083019 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013c0c0-845f-42af-9b18-1e748bb67796 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:10.084720 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-5013c0c0-845f-42af-9b18-1e748bb67796 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:10.166915 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013c0c0-845f-42af-9b18-1e748bb67796 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:10.168611 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013c0c0-845f-42af-9b18-1e748bb67796 service swift] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:10.178381 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 701/1398] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 1 13:47:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 13:47:11.307405 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb948969-05fd-4acc-abb3-c8f185f206e9 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:11.308021 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb948969-05fd-4acc-abb3-c8f185f206e9 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:11.308021 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb948969-05fd-4acc-abb3-c8f185f206e9 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:11.309677 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 698/1399] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:47:11.318303 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c655d0-05f5-4b15-9db6-4a54bfe1faa4 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:11.318303 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c655d0-05f5-4b15-9db6-4a54bfe1faa4 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:11.318303 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c655d0-05f5-4b15-9db6-4a54bfe1faa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:11.395094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-36c655d0-05f5-4b15-9db6-4a54bfe1faa4 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:11.396475 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-36c655d0-05f5-4b15-9db6-4a54bfe1faa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:11.478620 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:11.511965 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 702/1400] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:47:11.807779 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb948969-05fd-4acc-abb3-c8f185f206e9 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:11.809690 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-bb948969-05fd-4acc-abb3-c8f185f206e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:11.947283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:11.995271 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb948969-05fd-4acc-abb3-c8f185f206e9 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:12.130956 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf060e-bc0e-4df7-951d-7871671dc3b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:12.131540 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf060e-bc0e-4df7-951d-7871671dc3b3 service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:12.131817 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf060e-bc0e-4df7-951d-7871671dc3b3 service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:12.132086 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf060e-bc0e-4df7-951d-7871671dc3b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:12.134161 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-5ecf060e-bc0e-4df7-951d-7871671dc3b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:12.246328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:12.268980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf060e-bc0e-4df7-951d-7871671dc3b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:12.309293 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf060e-bc0e-4df7-951d-7871671dc3b3 service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:12.309293 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 699/1401] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:47:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:47:15.025561 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899f665-fd19-4f7a-8fca-c755f38612cd None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:15.026137 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899f665-fd19-4f7a-8fca-c755f38612cd None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:15.026137 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899f665-fd19-4f7a-8fca-c755f38612cd None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:15.027612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 703/1402] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:47:15.033132 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56902e5c-cc93-4b9e-b7ec-67290bfacaae None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:15.033570 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56902e5c-cc93-4b9e-b7ec-67290bfacaae None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:15.033667 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56902e5c-cc93-4b9e-b7ec-67290bfacaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:15.111547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-56902e5c-cc93-4b9e-b7ec-67290bfacaae None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:15.116618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-56902e5c-cc93-4b9e-b7ec-67290bfacaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:15.231488 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 700/1403] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:47:15.517478 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899f665-fd19-4f7a-8fca-c755f38612cd None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:15.519062 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c899f665-fd19-4f7a-8fca-c755f38612cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:15.685900 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899f665-fd19-4f7a-8fca-c755f38612cd None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:15.746130 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:15.817930 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731364b2-301a-4b50-af94-feda3d6f18c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:15.818861 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731364b2-301a-4b50-af94-feda3d6f18c6 service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:15.819127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731364b2-301a-4b50-af94-feda3d6f18c6 service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:15.819441 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731364b2-301a-4b50-af94-feda3d6f18c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:15.821067 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-731364b2-301a-4b50-af94-feda3d6f18c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:15.920947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731364b2-301a-4b50-af94-feda3d6f18c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:15.922595 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731364b2-301a-4b50-af94-feda3d6f18c6 service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:15.942306 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 704/1404] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:47:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:47:18.095114 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af105cc-9d5e-485f-bc69-a3778f02b73b None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:18.095731 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af105cc-9d5e-485f-bc69-a3778f02b73b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:18.095953 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af105cc-9d5e-485f-bc69-a3778f02b73b None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:18.097416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 701/1405] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:47:18.104019 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ebbbe-c767-44b6-9dd2-4bf29039c5bc None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:18.104591 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ebbbe-c767-44b6-9dd2-4bf29039c5bc None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:18.104591 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ebbbe-c767-44b6-9dd2-4bf29039c5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:18.189792 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-2e3ebbbe-c767-44b6-9dd2-4bf29039c5bc None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:18.191104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-2e3ebbbe-c767-44b6-9dd2-4bf29039c5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:18.207643 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:18.299945 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 705/1406] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:47:18.607156 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af105cc-9d5e-485f-bc69-a3778f02b73b None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:18.609012 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-3af105cc-9d5e-485f-bc69-a3778f02b73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:18.667986 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:18.780698 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af105cc-9d5e-485f-bc69-a3778f02b73b None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:18.927887 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf139cb6-e808-43de-8b9d-9a97467b6a16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:18.928663 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf139cb6-e808-43de-8b9d-9a97467b6a16 service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:18.929027 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf139cb6-e808-43de-8b9d-9a97467b6a16 service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:18.929372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf139cb6-e808-43de-8b9d-9a97467b6a16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:18.931056 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-cf139cb6-e808-43de-8b9d-9a97467b6a16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:18.941895 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:19.039238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf139cb6-e808-43de-8b9d-9a97467b6a16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:19.040940 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf139cb6-e808-43de-8b9d-9a97467b6a16 service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:19.063481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 702/1407] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:47:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:47:28.529161 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=37 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:29.061150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=41 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:34.501755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78959a12-a1fe-448f-a6f3-30dfb75bad23 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:34.502328 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78959a12-a1fe-448f-a6f3-30dfb75bad23 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:34.502328 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78959a12-a1fe-448f-a6f3-30dfb75bad23 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:34.503704 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 706/1408] 10.222.0.50 () {54 vars in 918 bytes} [Thu Sep 1 13:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:47:34.508817 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29672d36-a5da-4d1c-a8b3-e3a60f88efed None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:34.509219 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29672d36-a5da-4d1c-a8b3-e3a60f88efed None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:34.509502 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29672d36-a5da-4d1c-a8b3-e3a60f88efed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:34.587655 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-29672d36-a5da-4d1c-a8b3-e3a60f88efed None None] MFA Rules not processed for user `63e675d44d2c49929feb0ec0d2c0d0eb`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:34.589005 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-29672d36-a5da-4d1c-a8b3-e3a60f88efed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:34.698335 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 703/1409] 10.222.0.50 () {58 vars in 1015 bytes} [Thu Sep 1 13:47:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:47:34.713233 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a442fc3-67e2-40bd-8d6b-f0c8e64f22ac None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:34.713600 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a442fc3-67e2-40bd-8d6b-f0c8e64f22ac None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:34.713878 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a442fc3-67e2-40bd-8d6b-f0c8e64f22ac None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:34.715251 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 707/1410] 10.222.0.50 () {54 vars in 918 bytes} [Thu Sep 1 13:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:47:34.720202 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d2371-ba74-455f-844e-2f9bc7b1453d None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:34.720486 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d2371-ba74-455f-844e-2f9bc7b1453d None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:34.720758 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d2371-ba74-455f-844e-2f9bc7b1453d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:34.794893 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:34.797573 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-129d2371-ba74-455f-844e-2f9bc7b1453d None None] MFA Rules not processed for user `2d231136bcd44d9a97efe6c257f936ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:34.798819 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-129d2371-ba74-455f-844e-2f9bc7b1453d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:34.912652 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 704/1411] 10.222.0.50 () {58 vars in 1015 bytes} [Thu Sep 1 13:47:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:47:37.315176 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28933d-e17e-4172-afd9-57767623f1c8 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:37.315778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28933d-e17e-4172-afd9-57767623f1c8 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:37.315778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28933d-e17e-4172-afd9-57767623f1c8 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:37.317103 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 708/1412] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 13:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:47:37.322333 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04679e1b-136c-470f-9a87-68dd83c05c9e None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:37.322782 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04679e1b-136c-470f-9a87-68dd83c05c9e None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:37.322881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04679e1b-136c-470f-9a87-68dd83c05c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:37.389101 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-04679e1b-136c-470f-9a87-68dd83c05c9e None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:37.390281 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-04679e1b-136c-470f-9a87-68dd83c05c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:37.446284 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:37.488501 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 705/1413] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 13:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:47:37.772909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28933d-e17e-4172-afd9-57767623f1c8 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:37.774429 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-3e28933d-e17e-4172-afd9-57767623f1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:37.920691 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28933d-e17e-4172-afd9-57767623f1c8 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:37.992030 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:38.031998 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26c11a-48e0-4651-a0ce-46e31ed3de98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:38.032603 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26c11a-48e0-4651-a0ce-46e31ed3de98 service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:38.032876 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26c11a-48e0-4651-a0ce-46e31ed3de98 service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:38.033143 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26c11a-48e0-4651-a0ce-46e31ed3de98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:38.034719 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-eb26c11a-48e0-4651-a0ce-46e31ed3de98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:38.124427 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26c11a-48e0-4651-a0ce-46e31ed3de98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:38.126031 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26c11a-48e0-4651-a0ce-46e31ed3de98 service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:38.144876 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 709/1414] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:47:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:47:39.031980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9a172-cccf-405d-9a41-988bd48ca1da None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:39.032515 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9a172-cccf-405d-9a41-988bd48ca1da None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:39.032515 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9a172-cccf-405d-9a41-988bd48ca1da None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:39.033895 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 706/1415] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 13:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:47:39.039175 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211d2e6-65af-48a4-8df3-eed67c401250 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:39.039653 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211d2e6-65af-48a4-8df3-eed67c401250 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:39.039752 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211d2e6-65af-48a4-8df3-eed67c401250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:39.118475 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-2211d2e6-65af-48a4-8df3-eed67c401250 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:39.119631 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-2211d2e6-65af-48a4-8df3-eed67c401250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:39.147036 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:39.217354 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 710/1416] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 13:47:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:47:39.367957 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9a172-cccf-405d-9a41-988bd48ca1da None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:39.369580 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-9ad9a172-cccf-405d-9a41-988bd48ca1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:39.516026 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9a172-cccf-405d-9a41-988bd48ca1da None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:39.556013 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:39.635828 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad456c-fe68-4a92-845e-36285ff14ccf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:39.636380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad456c-fe68-4a92-845e-36285ff14ccf service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:39.636658 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad456c-fe68-4a92-845e-36285ff14ccf service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:39.636928 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad456c-fe68-4a92-845e-36285ff14ccf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:39.638508 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-5cad456c-fe68-4a92-845e-36285ff14ccf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:39.729258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad456c-fe68-4a92-845e-36285ff14ccf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:39.730987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad456c-fe68-4a92-845e-36285ff14ccf service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:39.750231 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 707/1417] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:47:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:47:40.631173 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993f71d-fd85-44ff-a73a-fdbd68a4af67 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:40.631750 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993f71d-fd85-44ff-a73a-fdbd68a4af67 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:40.631750 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993f71d-fd85-44ff-a73a-fdbd68a4af67 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:40.633083 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 711/1418] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 13:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:47:40.638023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6563cc-9f6e-43b7-b764-2e341cdec1ef None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:40.638446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6563cc-9f6e-43b7-b764-2e341cdec1ef None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:40.638563 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6563cc-9f6e-43b7-b764-2e341cdec1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:40.693853 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:40.716014 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-be6563cc-9f6e-43b7-b764-2e341cdec1ef None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:40.717230 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-be6563cc-9f6e-43b7-b764-2e341cdec1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:40.814258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 708/1419] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 13:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:47:40.968941 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993f71d-fd85-44ff-a73a-fdbd68a4af67 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:40.971116 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b993f71d-fd85-44ff-a73a-fdbd68a4af67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:41.117602 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993f71d-fd85-44ff-a73a-fdbd68a4af67 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:41.130384 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:41.236452 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aea707-686b-4ccf-b1e2-3623f9265963 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:41.236982 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aea707-686b-4ccf-b1e2-3623f9265963 service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:41.237261 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aea707-686b-4ccf-b1e2-3623f9265963 service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:41.237524 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aea707-686b-4ccf-b1e2-3623f9265963 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:41.239132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-66aea707-686b-4ccf-b1e2-3623f9265963 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:41.332090 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aea707-686b-4ccf-b1e2-3623f9265963 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:41.333834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aea707-686b-4ccf-b1e2-3623f9265963 service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:41.351723 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 712/1420] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:47:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:47:42.215624 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a741d-4e6b-4456-981e-5af40d8a52c5 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:42.216155 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a741d-4e6b-4456-981e-5af40d8a52c5 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:42.216155 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a741d-4e6b-4456-981e-5af40d8a52c5 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:42.217423 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 709/1421] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 13:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:47:42.222434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5805e0-3d28-4407-94b8-506fce6218ef None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:42.222870 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5805e0-3d28-4407-94b8-506fce6218ef None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:42.223107 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5805e0-3d28-4407-94b8-506fce6218ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:42.243281 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:42.301118 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-ee5805e0-3d28-4407-94b8-506fce6218ef None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:42.302343 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ee5805e0-3d28-4407-94b8-506fce6218ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:42.397895 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 713/1422] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 13:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:47:42.549024 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a741d-4e6b-4456-981e-5af40d8a52c5 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:42.550523 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-ec2a741d-4e6b-4456-981e-5af40d8a52c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:42.660728 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:42.697328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a741d-4e6b-4456-981e-5af40d8a52c5 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:42.809982 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4acf3-7f93-4c9d-b2d4-de61678c8b05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:42.810512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4acf3-7f93-4c9d-b2d4-de61678c8b05 service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:42.810789 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4acf3-7f93-4c9d-b2d4-de61678c8b05 service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:42.811061 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4acf3-7f93-4c9d-b2d4-de61678c8b05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:42.812694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a3a4acf3-7f93-4c9d-b2d4-de61678c8b05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:42.888107 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:42.901919 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4acf3-7f93-4c9d-b2d4-de61678c8b05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:42.903626 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4acf3-7f93-4c9d-b2d4-de61678c8b05 service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:42.922378 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 710/1423] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:47:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 13:47:43.774932 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a567d-c5ad-4f8c-a80c-0d08a3b36e88 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:43.775607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a567d-c5ad-4f8c-a80c-0d08a3b36e88 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:43.775607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a567d-c5ad-4f8c-a80c-0d08a3b36e88 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:43.777473 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 714/1424] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 13:47:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:47:43.782399 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66661ad1-c59f-4a7f-8d66-eb3247922b76 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:43.782835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66661ad1-c59f-4a7f-8d66-eb3247922b76 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:43.782938 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66661ad1-c59f-4a7f-8d66-eb3247922b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:43.860349 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-66661ad1-c59f-4a7f-8d66-eb3247922b76 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:43.861547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-66661ad1-c59f-4a7f-8d66-eb3247922b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:43.960663 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 711/1425] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 13:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:47:44.111011 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a567d-c5ad-4f8c-a80c-0d08a3b36e88 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:44.112587 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-9f0a567d-c5ad-4f8c-a80c-0d08a3b36e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:44.196813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:44.260329 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a567d-c5ad-4f8c-a80c-0d08a3b36e88 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:44.373195 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b3b4d-9134-4e1c-a70a-8688a57161cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:44.373705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b3b4d-9134-4e1c-a70a-8688a57161cb service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:44.373985 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b3b4d-9134-4e1c-a70a-8688a57161cb service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:44.374255 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b3b4d-9134-4e1c-a70a-8688a57161cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:44.375890 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a96b3b4d-9134-4e1c-a70a-8688a57161cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:44.424288 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:44.464534 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b3b4d-9134-4e1c-a70a-8688a57161cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:44.466120 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b3b4d-9134-4e1c-a70a-8688a57161cb service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:44.485247 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 715/1426] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:47:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:47:45.377604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946e981-b475-4289-8149-9a64ef758237 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:45.378211 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946e981-b475-4289-8149-9a64ef758237 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:45.378211 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946e981-b475-4289-8149-9a64ef758237 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:45.379497 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 712/1427] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 13:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:47:45.384581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcfd19-3dc2-4bb6-a493-8b29ada7b48e None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:45.385004 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcfd19-3dc2-4bb6-a493-8b29ada7b48e None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:45.385128 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcfd19-3dc2-4bb6-a493-8b29ada7b48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:45.462517 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-f0bcfd19-3dc2-4bb6-a493-8b29ada7b48e None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:45.463757 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-f0bcfd19-3dc2-4bb6-a493-8b29ada7b48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:45.559771 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 716/1428] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 13:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:47:45.713346 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946e981-b475-4289-8149-9a64ef758237 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:45.713686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c946e981-b475-4289-8149-9a64ef758237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:45.763278 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:45.860831 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946e981-b475-4289-8149-9a64ef758237 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:45.973320 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2903a7-0310-47c6-b36d-f53e27fb0345 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:45.973842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2903a7-0310-47c6-b36d-f53e27fb0345 service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:45.974123 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2903a7-0310-47c6-b36d-f53e27fb0345 service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:45.974395 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2903a7-0310-47c6-b36d-f53e27fb0345 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:45.976001 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-7e2903a7-0310-47c6-b36d-f53e27fb0345 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:45.982858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:46.066003 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2903a7-0310-47c6-b36d-f53e27fb0345 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:46.067666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2903a7-0310-47c6-b36d-f53e27fb0345 service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:46.085775 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 713/1429] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:47:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:47:46.971125 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed32e7-7481-4fdb-890d-f80a57070eb0 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:46.971684 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed32e7-7481-4fdb-890d-f80a57070eb0 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:46.971813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed32e7-7481-4fdb-890d-f80a57070eb0 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:46.973052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 717/1430] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 13:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:47:46.977984 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb9b06-24f5-41e1-9d20-25115cfb0488 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:46.978376 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb9b06-24f5-41e1-9d20-25115cfb0488 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:46.978524 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb9b06-24f5-41e1-9d20-25115cfb0488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:47.054337 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-12fb9b06-24f5-41e1-9d20-25115cfb0488 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:47.055514 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-12fb9b06-24f5-41e1-9d20-25115cfb0488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:47.124865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:47.154114 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 714/1431] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 13:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:47:47.305984 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed32e7-7481-4fdb-890d-f80a57070eb0 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:47.307435 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-97ed32e7-7481-4fdb-890d-f80a57070eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:47.325624 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:47.451970 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed32e7-7481-4fdb-890d-f80a57070eb0 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:47.538289 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:47.564788 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222adcd5-89a2-4576-9c82-86268888b9eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:47.565328 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222adcd5-89a2-4576-9c82-86268888b9eb service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:47.565608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222adcd5-89a2-4576-9c82-86268888b9eb service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:47.565908 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222adcd5-89a2-4576-9c82-86268888b9eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:47.567550 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-222adcd5-89a2-4576-9c82-86268888b9eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:47.657876 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222adcd5-89a2-4576-9c82-86268888b9eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:47.659524 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222adcd5-89a2-4576-9c82-86268888b9eb service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:47.677819 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 718/1432] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:47:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:47:48.584836 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae089d3-8b01-438e-a625-1d79d9ac94f8 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:48.585414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae089d3-8b01-438e-a625-1d79d9ac94f8 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:48.585414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae089d3-8b01-438e-a625-1d79d9ac94f8 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:48.586722 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 715/1433] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 13:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:47:48.592585 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf1341-2121-48f0-94e2-cf3783a99937 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:48.593043 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf1341-2121-48f0-94e2-cf3783a99937 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:48.593151 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf1341-2121-48f0-94e2-cf3783a99937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:48.670816 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-64cf1341-2121-48f0-94e2-cf3783a99937 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:48.672071 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-64cf1341-2121-48f0-94e2-cf3783a99937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:48.714672 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:48.769094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 719/1434] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 13:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:47:48.916208 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae089d3-8b01-438e-a625-1d79d9ac94f8 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:48.917751 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-fae089d3-8b01-438e-a625-1d79d9ac94f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:49.063912 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae089d3-8b01-438e-a625-1d79d9ac94f8 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:49.117559 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:49.176077 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71400fca-2907-41e5-be74-c26831091403 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:49.176686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71400fca-2907-41e5-be74-c26831091403 service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:49.177257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71400fca-2907-41e5-be74-c26831091403 service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:49.177257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71400fca-2907-41e5-be74-c26831091403 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:49.178823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-71400fca-2907-41e5-be74-c26831091403 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:49.268809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71400fca-2907-41e5-be74-c26831091403 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:49.270423 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71400fca-2907-41e5-be74-c26831091403 service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:49.288383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 716/1435] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:47:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:47:50.150020 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9bafc-cde3-4242-a6a3-e90de677e0f6 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:50.150548 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9bafc-cde3-4242-a6a3-e90de677e0f6 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:50.150548 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9bafc-cde3-4242-a6a3-e90de677e0f6 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:50.151902 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 720/1436] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 13:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:47:50.156952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346273d-66b0-4e11-b089-de5b8984fe5b None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:50.157377 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346273d-66b0-4e11-b089-de5b8984fe5b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:50.157566 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346273d-66b0-4e11-b089-de5b8984fe5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:50.233275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-f346273d-66b0-4e11-b089-de5b8984fe5b None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:50.234490 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-f346273d-66b0-4e11-b089-de5b8984fe5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:50.236945 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:50.452888 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 717/1437] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 13:47:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:47:50.605881 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9bafc-cde3-4242-a6a3-e90de677e0f6 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:50.607308 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-3ab9bafc-cde3-4242-a6a3-e90de677e0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:50.757324 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9bafc-cde3-4242-a6a3-e90de677e0f6 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:50.783383 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:50.867745 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029d637-4657-4648-ba13-18b2f554df6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:50.868340 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029d637-4657-4648-ba13-18b2f554df6f service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:50.868616 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029d637-4657-4648-ba13-18b2f554df6f service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:50.868889 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029d637-4657-4648-ba13-18b2f554df6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:50.871075 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-d029d637-4657-4648-ba13-18b2f554df6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:50.959680 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029d637-4657-4648-ba13-18b2f554df6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:50.961270 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029d637-4657-4648-ba13-18b2f554df6f service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:50.980289 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 721/1438] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:47:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:47:52.798313 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7f59c-e62b-4fa5-9dab-9a3945d3c9d2 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:52.798880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7f59c-e62b-4fa5-9dab-9a3945d3c9d2 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:52.798880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7f59c-e62b-4fa5-9dab-9a3945d3c9d2 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:52.800257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 718/1439] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 13:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:47:52.805406 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e61de6-da4b-4892-81ba-66f2a73fa44f None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:52.805901 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e61de6-da4b-4892-81ba-66f2a73fa44f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:52.805994 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e61de6-da4b-4892-81ba-66f2a73fa44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:52.847221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:52.871914 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-81e61de6-da4b-4892-81ba-66f2a73fa44f None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:52.873121 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-81e61de6-da4b-4892-81ba-66f2a73fa44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:52.969572 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 722/1440] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 13:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:47:53.255765 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7f59c-e62b-4fa5-9dab-9a3945d3c9d2 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:53.257298 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-69c7f59c-e62b-4fa5-9dab-9a3945d3c9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:53.362504 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7f59c-e62b-4fa5-9dab-9a3945d3c9d2 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:53.395823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:53.437642 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98625c26-e655-4c8b-9c9c-433bbdc569e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:53.438239 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98625c26-e655-4c8b-9c9c-433bbdc569e2 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:53.438516 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98625c26-e655-4c8b-9c9c-433bbdc569e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:53.438783 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98625c26-e655-4c8b-9c9c-433bbdc569e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:53.440450 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-98625c26-e655-4c8b-9c9c-433bbdc569e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:53.549147 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98625c26-e655-4c8b-9c9c-433bbdc569e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:53.550672 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98625c26-e655-4c8b-9c9c-433bbdc569e2 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:53.569118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 719/1441] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:47:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:47:55.641457 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5232d-3536-4beb-a877-92ab86781f43 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:55.642055 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5232d-3536-4beb-a877-92ab86781f43 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:55.642055 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5232d-3536-4beb-a877-92ab86781f43 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:55.643319 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 723/1442] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 13:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:47:55.648702 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094adbcf-defd-48f3-b967-62c212da0727 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:55.649115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094adbcf-defd-48f3-b967-62c212da0727 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:55.649245 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094adbcf-defd-48f3-b967-62c212da0727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:55.714933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-094adbcf-defd-48f3-b967-62c212da0727 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:55.717326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-094adbcf-defd-48f3-b967-62c212da0727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:55.729010 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:55.813506 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 720/1443] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 13:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:47:56.102239 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5232d-3536-4beb-a877-92ab86781f43 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:56.103923 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-02d5232d-3536-4beb-a877-92ab86781f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:56.206496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5232d-3536-4beb-a877-92ab86781f43 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:56.218470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:56.280145 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd4eed-64a2-447f-9487-6f1e6236d052 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:56.280755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd4eed-64a2-447f-9487-6f1e6236d052 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:56.281035 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd4eed-64a2-447f-9487-6f1e6236d052 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:56.281306 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd4eed-64a2-447f-9487-6f1e6236d052 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:56.282899 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-96dd4eed-64a2-447f-9487-6f1e6236d052 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:56.390747 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd4eed-64a2-447f-9487-6f1e6236d052 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:56.392205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd4eed-64a2-447f-9487-6f1e6236d052 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:56.410719 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 724/1444] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:47:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:47:58.700198 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f060eeb-31de-4d82-9713-55835013774a None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:58.700772 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f060eeb-31de-4d82-9713-55835013774a None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:58.700772 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f060eeb-31de-4d82-9713-55835013774a None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:58.702140 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 721/1445] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 13:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:47:58.707923 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf56c58-1cad-4eee-9479-8dd48f95bf92 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:58.708349 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf56c58-1cad-4eee-9479-8dd48f95bf92 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:58.714324 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf56c58-1cad-4eee-9479-8dd48f95bf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:58.757694 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:58.776838 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-8cf56c58-1cad-4eee-9479-8dd48f95bf92 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:58.778034 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-8cf56c58-1cad-4eee-9479-8dd48f95bf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:58.872504 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 725/1446] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 13:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:47:59.175525 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8913e-c23d-49e0-85fd-35b778faf1d6 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:59.175809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8913e-c23d-49e0-85fd-35b778faf1d6 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:59.176087 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8913e-c23d-49e0-85fd-35b778faf1d6 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:59.177438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 722/1447] 10.222.0.50 () {54 vars in 965 bytes} [Thu Sep 1 13:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:47:59.184245 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc99da3-1a32-41d2-90b5-0ad3c44fdef1 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:59.184531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc99da3-1a32-41d2-90b5-0ad3c44fdef1 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:59.184803 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc99da3-1a32-41d2-90b5-0ad3c44fdef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:59.261905 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-9cc99da3-1a32-41d2-90b5-0ad3c44fdef1 None None] MFA Rules not processed for user `72f0d372f6c34d1a9a990222d6b98948`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:59.263172 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-9cc99da3-1a32-41d2-90b5-0ad3c44fdef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:59.321263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:59.339694 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 726/1448] 10.222.0.50 () {58 vars in 1062 bytes} [Thu Sep 1 13:47:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:47:59.348876 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8913e-c23d-49e0-85fd-35b778faf1d6 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:59.350387 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-48d8913e-c23d-49e0-85fd-35b778faf1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:59.455455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8913e-c23d-49e0-85fd-35b778faf1d6 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:59.496500 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:59.529252 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b6c90-5302-4ca3-8b4f-dad8df27a554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:59.529845 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b6c90-5302-4ca3-8b4f-dad8df27a554 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:59.530117 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b6c90-5302-4ca3-8b4f-dad8df27a554 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:59.530385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b6c90-5302-4ca3-8b4f-dad8df27a554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:59.531980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-275b6c90-5302-4ca3-8b4f-dad8df27a554 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:59.639618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b6c90-5302-4ca3-8b4f-dad8df27a554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:59.641082 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b6c90-5302-4ca3-8b4f-dad8df27a554 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:59.659592 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 723/1449] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:47:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:48:02.100329 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945a0af-5e40-4806-9cca-f7d8899163dd None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:02.100844 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945a0af-5e40-4806-9cca-f7d8899163dd None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:02.100844 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945a0af-5e40-4806-9cca-f7d8899163dd None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:02.102141 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 13:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:48:02.108196 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bda71-4bcd-4ec8-ae95-e411a6103925 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:02.108603 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bda71-4bcd-4ec8-ae95-e411a6103925 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:02.108779 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bda71-4bcd-4ec8-ae95-e411a6103925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:02.174611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-263bda71-4bcd-4ec8-ae95-e411a6103925 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:48:02.175835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-263bda71-4bcd-4ec8-ae95-e411a6103925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:02.196680 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:02.272517 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 13:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:48:02.554049 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945a0af-5e40-4806-9cca-f7d8899163dd None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:02.555608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-4945a0af-5e40-4806-9cca-f7d8899163dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:02.658234 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945a0af-5e40-4806-9cca-f7d8899163dd None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:02.733104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c4560-b556-4116-83eb-951e0d90b82c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:02.733711 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c4560-b556-4116-83eb-951e0d90b82c service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:02.733986 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c4560-b556-4116-83eb-951e0d90b82c service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:02.734269 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c4560-b556-4116-83eb-951e0d90b82c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:02.735863 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-6c1c4560-b556-4116-83eb-951e0d90b82c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:02.775096 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:02.843353 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c4560-b556-4116-83eb-951e0d90b82c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:02.844740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c4560-b556-4116-83eb-951e0d90b82c service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:02.864232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 728/1452] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:48:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 13:48:04.829339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac85780-803c-46fb-bc80-8099090a13bc None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:04.829898 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac85780-803c-46fb-bc80-8099090a13bc None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:04.829898 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac85780-803c-46fb-bc80-8099090a13bc None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:04.831227 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 13:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:48:04.836475 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b8893-995f-42d1-a130-d01f7c3fef86 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:04.836917 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b8893-995f-42d1-a130-d01f7c3fef86 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:04.837015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b8893-995f-42d1-a130-d01f7c3fef86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:04.904417 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-2b2b8893-995f-42d1-a130-d01f7c3fef86 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:48:04.905636 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-2b2b8893-995f-42d1-a130-d01f7c3fef86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:04.995437 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:05.001354 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 13:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:48:05.289495 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac85780-803c-46fb-bc80-8099090a13bc None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:05.291028 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-dac85780-803c-46fb-bc80-8099090a13bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:05.396876 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac85780-803c-46fb-bc80-8099090a13bc None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:05.445326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:05.469926 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8e4e4-0429-4e12-9790-55d23187282b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:05.470527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8e4e4-0429-4e12-9790-55d23187282b service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:05.470808 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8e4e4-0429-4e12-9790-55d23187282b service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:05.471086 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8e4e4-0429-4e12-9790-55d23187282b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:05.472701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-93f8e4e4-0429-4e12-9790-55d23187282b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:05.580332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8e4e4-0429-4e12-9790-55d23187282b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:05.581687 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8e4e4-0429-4e12-9790-55d23187282b service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:05.600033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 726/1455] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:48:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:48:07.544327 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a42a8c-a40c-4143-a7c7-826b9e2d6514 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:07.544865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a42a8c-a40c-4143-a7c7-826b9e2d6514 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:07.544865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a42a8c-a40c-4143-a7c7-826b9e2d6514 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:07.546188 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 13:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:48:07.551569 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7f813-7db7-4946-a68c-03bbc62a95e9 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:07.552005 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7f813-7db7-4946-a68c-03bbc62a95e9 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:07.552126 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7f813-7db7-4946-a68c-03bbc62a95e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:07.621865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-cad7f813-7db7-4946-a68c-03bbc62a95e9 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:48:07.623044 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-cad7f813-7db7-4946-a68c-03bbc62a95e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:07.653746 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:07.721767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 13:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:48:08.005877 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a42a8c-a40c-4143-a7c7-826b9e2d6514 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:08.007458 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b1a42a8c-a40c-4143-a7c7-826b9e2d6514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:08.110854 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a42a8c-a40c-4143-a7c7-826b9e2d6514 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:08.184350 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5808118-79c7-4e63-9b5a-afd4b08ea4eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:08.184943 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5808118-79c7-4e63-9b5a-afd4b08ea4eb service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:08.185216 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5808118-79c7-4e63-9b5a-afd4b08ea4eb service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:08.185481 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5808118-79c7-4e63-9b5a-afd4b08ea4eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:08.187043 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b5808118-79c7-4e63-9b5a-afd4b08ea4eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:08.234885 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:08.297689 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5808118-79c7-4e63-9b5a-afd4b08ea4eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:08.299138 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5808118-79c7-4e63-9b5a-afd4b08ea4eb service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:08.318086 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 731/1458] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:48:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:48:10.311893 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ff4ea-bc6a-47a9-8679-0da60876c2a9 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:10.312440 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ff4ea-bc6a-47a9-8679-0da60876c2a9 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:10.312440 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ff4ea-bc6a-47a9-8679-0da60876c2a9 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:10.313769 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 13:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:48:10.319531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1b558-50e0-4ddb-a6c8-cfff463a759c None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:10.319960 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1b558-50e0-4ddb-a6c8-cfff463a759c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:10.320085 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1b558-50e0-4ddb-a6c8-cfff463a759c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:10.387325 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-5ad1b558-50e0-4ddb-a6c8-cfff463a759c None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:48:10.388607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-5ad1b558-50e0-4ddb-a6c8-cfff463a759c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:10.483426 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 13:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:48:10.766618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ff4ea-bc6a-47a9-8679-0da60876c2a9 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:10.768203 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-750ff4ea-bc6a-47a9-8679-0da60876c2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:10.872326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ff4ea-bc6a-47a9-8679-0da60876c2a9 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:10.926985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:10.945793 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344d4d8-efd2-4a13-8f31-605d504974e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:10.946394 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344d4d8-efd2-4a13-8f31-605d504974e3 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:10.946672 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344d4d8-efd2-4a13-8f31-605d504974e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:10.946940 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344d4d8-efd2-4a13-8f31-605d504974e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:10.948545 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-1344d4d8-efd2-4a13-8f31-605d504974e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:11.055802 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344d4d8-efd2-4a13-8f31-605d504974e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:11.057879 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344d4d8-efd2-4a13-8f31-605d504974e3 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:11.078805 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 729/1461] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:48:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:48:13.037078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5eb20c-66db-4f26-a0c3-a51ce2a2e54e None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:13.037653 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5eb20c-66db-4f26-a0c3-a51ce2a2e54e None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:13.037653 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5eb20c-66db-4f26-a0c3-a51ce2a2e54e None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:13.039056 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 13:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:48:13.044477 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d540a-aed6-4d80-b975-e786708fbd0b None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:13.044930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d540a-aed6-4d80-b975-e786708fbd0b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:13.045049 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d540a-aed6-4d80-b975-e786708fbd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:13.113607 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-7d9d540a-aed6-4d80-b975-e786708fbd0b None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:48:13.114718 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-7d9d540a-aed6-4d80-b975-e786708fbd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:13.153351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:13.209728 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 13:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:48:13.491896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5eb20c-66db-4f26-a0c3-a51ce2a2e54e None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:13.493421 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-8f5eb20c-66db-4f26-a0c3-a51ce2a2e54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:13.497973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:13.596704 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5eb20c-66db-4f26-a0c3-a51ce2a2e54e None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:13.670314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31a66d-f11c-445d-9537-29a56fa099bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:13.670917 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31a66d-f11c-445d-9537-29a56fa099bd service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:13.671192 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31a66d-f11c-445d-9537-29a56fa099bd service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:13.671500 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31a66d-f11c-445d-9537-29a56fa099bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:13.673089 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-7b31a66d-f11c-445d-9537-29a56fa099bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:13.733630 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:13.783191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31a66d-f11c-445d-9537-29a56fa099bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:13.784654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31a66d-f11c-445d-9537-29a56fa099bd service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:13.803194 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 734/1464] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:48:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:48:15.743172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cefaab-c172-4b99-9f38-e7b6b4f20f50 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:15.743740 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cefaab-c172-4b99-9f38-e7b6b4f20f50 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:15.743740 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cefaab-c172-4b99-9f38-e7b6b4f20f50 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:15.745079 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 13:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:48:15.750497 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0d9d5-a9cc-486b-9f46-bce1d7c2cf32 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:15.750935 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0d9d5-a9cc-486b-9f46-bce1d7c2cf32 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:15.751044 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0d9d5-a9cc-486b-9f46-bce1d7c2cf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:15.816564 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-bac0d9d5-a9cc-486b-9f46-bce1d7c2cf32 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:48:15.817744 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-bac0d9d5-a9cc-486b-9f46-bce1d7c2cf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:15.913768 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 13:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:48:16.197007 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cefaab-c172-4b99-9f38-e7b6b4f20f50 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:16.199071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-86cefaab-c172-4b99-9f38-e7b6b4f20f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:16.302268 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cefaab-c172-4b99-9f38-e7b6b4f20f50 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:16.376013 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:16.382678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6e465-4851-45bd-8c14-f09f25db786d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:16.383272 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6e465-4851-45bd-8c14-f09f25db786d service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:16.383575 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6e465-4851-45bd-8c14-f09f25db786d service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:16.383846 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6e465-4851-45bd-8c14-f09f25db786d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:16.385418 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-6ef6e465-4851-45bd-8c14-f09f25db786d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:16.495954 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6e465-4851-45bd-8c14-f09f25db786d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:16.497654 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6e465-4851-45bd-8c14-f09f25db786d service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:16.517117 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 732/1467] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:48:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:48:18.472667 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b8eac-c396-4f63-bf4e-8e668701c8da None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:18.473289 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b8eac-c396-4f63-bf4e-8e668701c8da None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:18.473289 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b8eac-c396-4f63-bf4e-8e668701c8da None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:18.474537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 13:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:48:18.480280 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5882a3-c6e3-4bba-a7be-15041d626a50 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:18.480716 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5882a3-c6e3-4bba-a7be-15041d626a50 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:18.480829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5882a3-c6e3-4bba-a7be-15041d626a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:18.546874 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-7b5882a3-c6e3-4bba-a7be-15041d626a50 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:48:18.548264 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-7b5882a3-c6e3-4bba-a7be-15041d626a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:18.596057 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:18.643490 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 13:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:48:18.928304 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b8eac-c396-4f63-bf4e-8e668701c8da None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:18.929943 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b35b8eac-c396-4f63-bf4e-8e668701c8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:18.943965 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:19.033389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b8eac-c396-4f63-bf4e-8e668701c8da None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:19.106079 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2a8e2-f750-44b5-b8fd-e2723419799f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:19.106599 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2a8e2-f750-44b5-b8fd-e2723419799f service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:19.106881 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2a8e2-f750-44b5-b8fd-e2723419799f service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:19.107150 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2a8e2-f750-44b5-b8fd-e2723419799f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:19.109031 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-18c2a8e2-f750-44b5-b8fd-e2723419799f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:19.176401 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:19.217709 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2a8e2-f750-44b5-b8fd-e2723419799f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:19.219139 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2a8e2-f750-44b5-b8fd-e2723419799f service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:19.239214 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 737/1470] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:48:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:48:28.657540 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=22 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:29.236731 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=25 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:39.389502 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c46692-330c-4dd0-ba64-1d6b1c440632 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:39.390079 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c46692-330c-4dd0-ba64-1d6b1c440632 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:39.390079 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c46692-330c-4dd0-ba64-1d6b1c440632 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:39.391488 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 734/1471] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:48:39.396937 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3c573-f764-4a54-8969-25c10ef85b36 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:39.397372 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3c573-f764-4a54-8969-25c10ef85b36 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:39.397485 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3c573-f764-4a54-8969-25c10ef85b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:39.462280 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-b1c3c573-f764-4a54-8969-25c10ef85b36 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:48:39.463509 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b1c3c573-f764-4a54-8969-25c10ef85b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:39.558874 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 738/1472] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:48:39.856637 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34bc78-4eb0-4b8f-ab6e-4da6ed91fdd5 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:39.856923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34bc78-4eb0-4b8f-ab6e-4da6ed91fdd5 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:39.857462 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34bc78-4eb0-4b8f-ab6e-4da6ed91fdd5 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:39.858804 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 735/1473] 10.222.0.50 () {54 vars in 967 bytes} [Thu Sep 1 13:48:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:48:39.863626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abcd1e-3b35-4ef4-9f13-b6548f443363 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:39.863917 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abcd1e-3b35-4ef4-9f13-b6548f443363 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:39.864192 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abcd1e-3b35-4ef4-9f13-b6548f443363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:39.940257 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-24abcd1e-3b35-4ef4-9f13-b6548f443363 None None] MFA Rules not processed for user `fc11fe25135d4bf1b1a06b8619e4a2e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:48:39.941508 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-24abcd1e-3b35-4ef4-9f13-b6548f443363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:39.962336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:40.018270 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 739/1474] 10.222.0.50 () {58 vars in 1064 bytes} [Thu Sep 1 13:48:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:48:40.025714 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34bc78-4eb0-4b8f-ab6e-4da6ed91fdd5 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:40.027251 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-6f34bc78-4eb0-4b8f-ab6e-4da6ed91fdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:40.131039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34bc78-4eb0-4b8f-ab6e-4da6ed91fdd5 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:40.205143 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676de73-7f05-471c-b9b9-e144ed13ae58 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc11fe25135d4bf1b1a06b8619e4a2e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:40.205748 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676de73-7f05-471c-b9b9-e144ed13ae58 service glance] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:40.206028 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676de73-7f05-471c-b9b9-e144ed13ae58 service glance] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:40.206307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676de73-7f05-471c-b9b9-e144ed13ae58 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:40.207920 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-d676de73-7f05-471c-b9b9-e144ed13ae58 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:40.263965 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:40.320126 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676de73-7f05-471c-b9b9-e144ed13ae58 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:40.321561 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676de73-7f05-471c-b9b9-e144ed13ae58 service glance] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:40.341289 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 736/1475] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:48:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:48:42.326998 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cae6d9-7c26-449a-a22c-58d5bd131abf None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:42.327593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cae6d9-7c26-449a-a22c-58d5bd131abf None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:42.327593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cae6d9-7c26-449a-a22c-58d5bd131abf None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:42.328941 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 740/1476] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:48:42.334516 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d9065-f3ae-4159-ac72-2f6d123facd2 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:42.334948 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d9065-f3ae-4159-ac72-2f6d123facd2 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:42.335084 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d9065-f3ae-4159-ac72-2f6d123facd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:42.400029 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-c95d9065-f3ae-4159-ac72-2f6d123facd2 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:48:42.401235 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c95d9065-f3ae-4159-ac72-2f6d123facd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:42.498051 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 737/1477] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:48:42.767112 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cae6d9-7c26-449a-a22c-58d5bd131abf None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:42.768595 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-70cae6d9-7c26-449a-a22c-58d5bd131abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:42.898743 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cae6d9-7c26-449a-a22c-58d5bd131abf None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:42.946869 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:42.993349 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5c484-eacf-4eab-b84e-097a7659c565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:42.993947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5c484-eacf-4eab-b84e-097a7659c565 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:42.994225 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5c484-eacf-4eab-b84e-097a7659c565 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:42.994495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5c484-eacf-4eab-b84e-097a7659c565 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:42.995192 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5c484-eacf-4eab-b84e-097a7659c565 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:42.996981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: WARNING py.warnings [None req-e4c5c484-eacf-4eab-b84e-097a7659c565 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 13:48:42.996981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: warnings.warn(msg) Sep 01 13:48:42.996981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: Sep 01 13:48:42.998240 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5c484-eacf-4eab-b84e-097a7659c565 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:43.018078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 741/1478] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Sep 1 13:48:42 2022] GET /identity/v3/projects => generated 2553 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:48:44.935926 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25feea37-a422-40f2-9a0f-5f6a05ab88d8 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:44.935926 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25feea37-a422-40f2-9a0f-5f6a05ab88d8 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:44.935926 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25feea37-a422-40f2-9a0f-5f6a05ab88d8 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:44.935926 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 738/1479] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:48:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:48:44.940080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b983799-ed1e-451d-8ba2-1f6043ab2f65 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:44.940478 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b983799-ed1e-451d-8ba2-1f6043ab2f65 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:44.940638 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b983799-ed1e-451d-8ba2-1f6043ab2f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:45.007700 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-0b983799-ed1e-451d-8ba2-1f6043ab2f65 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:48:45.008945 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-0b983799-ed1e-451d-8ba2-1f6043ab2f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:45.111713 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 742/1480] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:48:45.404496 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25feea37-a422-40f2-9a0f-5f6a05ab88d8 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:45.406025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-25feea37-a422-40f2-9a0f-5f6a05ab88d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:45.415831 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:45.552157 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25feea37-a422-40f2-9a0f-5f6a05ab88d8 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:45.633722 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:45.668782 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7a916-f8d6-42a9-95e2-a9a610a9fc9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:45.669307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7a916-f8d6-42a9-95e2-a9a610a9fc9b service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:45.669580 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7a916-f8d6-42a9-95e2-a9a610a9fc9b service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:45.669854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7a916-f8d6-42a9-95e2-a9a610a9fc9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:45.671481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-8fa7a916-f8d6-42a9-95e2-a9a610a9fc9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:45.761634 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7a916-f8d6-42a9-95e2-a9a610a9fc9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:45.763334 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7a916-f8d6-42a9-95e2-a9a610a9fc9b service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:45.781948 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 739/1481] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:48:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:48:47.870231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a8093-2966-45b3-a88b-acb7f91d9404 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:47.870724 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a8093-2966-45b3-a88b-acb7f91d9404 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:47.870821 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a8093-2966-45b3-a88b-acb7f91d9404 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:47.872735 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 743/1482] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:48:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:48:47.878015 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87d538-da66-4ae7-965e-c5ba612e5ffd None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:47.878438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87d538-da66-4ae7-965e-c5ba612e5ffd None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:47.878564 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87d538-da66-4ae7-965e-c5ba612e5ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:47.944453 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-cd87d538-da66-4ae7-965e-c5ba612e5ffd None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:48:47.945638 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-cd87d538-da66-4ae7-965e-c5ba612e5ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:47.990685 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:48.039842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 740/1483] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:48:48.336524 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a8093-2966-45b3-a88b-acb7f91d9404 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:48.338089 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-268a8093-2966-45b3-a88b-acb7f91d9404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:48.362596 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:48.442290 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a8093-2966-45b3-a88b-acb7f91d9404 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:48.516144 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06601fd5-b851-4a52-a638-753b03960cf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:48.516751 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06601fd5-b851-4a52-a638-753b03960cf1 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:48.517029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06601fd5-b851-4a52-a638-753b03960cf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:48.517321 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06601fd5-b851-4a52-a638-753b03960cf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:48.518955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-06601fd5-b851-4a52-a638-753b03960cf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:48.593630 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:48.628157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06601fd5-b851-4a52-a638-753b03960cf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:48.629598 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06601fd5-b851-4a52-a638-753b03960cf1 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:48.648476 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 744/1484] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:48:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:48:50.616907 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888f7ed-a2bc-4af0-86c7-4f8a13ca3d0a None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:50.617486 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888f7ed-a2bc-4af0-86c7-4f8a13ca3d0a None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:50.617486 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888f7ed-a2bc-4af0-86c7-4f8a13ca3d0a None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:50.618865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 741/1485] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:48:50.624538 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf5cb1-c3e4-456c-b34f-6e13d5ff2e1e None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:50.624944 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf5cb1-c3e4-456c-b34f-6e13d5ff2e1e None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:50.625078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf5cb1-c3e4-456c-b34f-6e13d5ff2e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:50.691590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-6acf5cb1-c3e4-456c-b34f-6e13d5ff2e1e None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:48:50.692813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-6acf5cb1-c3e4-456c-b34f-6e13d5ff2e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:50.791392 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 745/1486] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:48:51.084124 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888f7ed-a2bc-4af0-86c7-4f8a13ca3d0a None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:51.085643 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-3888f7ed-a2bc-4af0-86c7-4f8a13ca3d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:51.188648 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888f7ed-a2bc-4af0-86c7-4f8a13ca3d0a None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:51.259809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:51.261605 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9742d27-c566-4457-aa01-7119f5b1f698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:51.262206 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9742d27-c566-4457-aa01-7119f5b1f698 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:51.262480 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9742d27-c566-4457-aa01-7119f5b1f698 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:51.262750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9742d27-c566-4457-aa01-7119f5b1f698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:51.264378 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-d9742d27-c566-4457-aa01-7119f5b1f698 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:51.377323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9742d27-c566-4457-aa01-7119f5b1f698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:51.378679 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9742d27-c566-4457-aa01-7119f5b1f698 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:51.396626 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 742/1487] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:48:53.481664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eebb33-5504-4e16-9c36-59cb0c89d9c0 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:53.482503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eebb33-5504-4e16-9c36-59cb0c89d9c0 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:53.482503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eebb33-5504-4e16-9c36-59cb0c89d9c0 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:53.483832 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 746/1488] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:48:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:48:53.489017 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477893d-a1f4-43be-a416-247f9df338e5 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:53.489495 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477893d-a1f4-43be-a416-247f9df338e5 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:53.489602 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477893d-a1f4-43be-a416-247f9df338e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:53.554884 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-d477893d-a1f4-43be-a416-247f9df338e5 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:48:53.556103 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-d477893d-a1f4-43be-a416-247f9df338e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:53.608553 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:53.654454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 743/1489] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:48:53.947822 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eebb33-5504-4e16-9c36-59cb0c89d9c0 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:53.949347 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-98eebb33-5504-4e16-9c36-59cb0c89d9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:53.987986 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:54.056079 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eebb33-5504-4e16-9c36-59cb0c89d9c0 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:54.129367 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a2507-3cf8-423d-8828-9f58a42bc11d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:54.129905 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a2507-3cf8-423d-8828-9f58a42bc11d service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:54.130186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a2507-3cf8-423d-8828-9f58a42bc11d service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:54.130462 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a2507-3cf8-423d-8828-9f58a42bc11d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:54.132082 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-978a2507-3cf8-423d-8828-9f58a42bc11d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:54.212863 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:54.241633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a2507-3cf8-423d-8828-9f58a42bc11d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:54.243069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a2507-3cf8-423d-8828-9f58a42bc11d service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:54.261935 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 747/1490] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:48:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:48:56.572153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc466282-460d-42e2-80ca-37d57e1a9fd0 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:56.572153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc466282-460d-42e2-80ca-37d57e1a9fd0 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:56.572153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc466282-460d-42e2-80ca-37d57e1a9fd0 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:56.573515 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 744/1491] 10.222.0.50 () {54 vars in 927 bytes} [Thu Sep 1 13:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:48:56.579257 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e228104-90c8-4af1-ae32-e87b0eb92c0e None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:56.579732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e228104-90c8-4af1-ae32-e87b0eb92c0e None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:56.579836 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e228104-90c8-4af1-ae32-e87b0eb92c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:56.644930 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-0e228104-90c8-4af1-ae32-e87b0eb92c0e None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:48:56.646130 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-0e228104-90c8-4af1-ae32-e87b0eb92c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:56.742615 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 748/1492] 10.222.0.50 () {58 vars in 1024 bytes} [Thu Sep 1 13:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:48:57.030831 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc466282-460d-42e2-80ca-37d57e1a9fd0 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:57.032398 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-fc466282-460d-42e2-80ca-37d57e1a9fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:57.136674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc466282-460d-42e2-80ca-37d57e1a9fd0 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:57.211389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516d34e-7572-4a07-9e12-3369122af936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:57.212002 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516d34e-7572-4a07-9e12-3369122af936 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:57.212286 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516d34e-7572-4a07-9e12-3369122af936 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:57.212581 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516d34e-7572-4a07-9e12-3369122af936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:57.214806 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-e516d34e-7572-4a07-9e12-3369122af936 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:57.224249 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:57.326742 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516d34e-7572-4a07-9e12-3369122af936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:57.328221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516d34e-7572-4a07-9e12-3369122af936 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:57.347370 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 745/1493] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:48:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:49:06.740835 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=82 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:07.345058 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=50 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:50:38.473590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439d9b7-e041-486b-a6bc-e885646bb583 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:50:38.474169 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439d9b7-e041-486b-a6bc-e885646bb583 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:50:38.474169 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439d9b7-e041-486b-a6bc-e885646bb583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:50:38.548325 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-c439d9b7-e041-486b-a6bc-e885646bb583 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:50:38.549522 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c439d9b7-e041-486b-a6bc-e885646bb583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:50:38.644290 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 749/1494] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:50:38.652272 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f2829-e56a-4710-b8fd-11f8f153a40f None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:50:38.652753 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f2829-e56a-4710-b8fd-11f8f153a40f None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:50:38.652860 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f2829-e56a-4710-b8fd-11f8f153a40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:50:38.728624 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-455f2829-e56a-4710-b8fd-11f8f153a40f None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:50:38.729730 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-455f2829-e56a-4710-b8fd-11f8f153a40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:50:38.826580 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 746/1495] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:50:38.831248 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439d9b7-e041-486b-a6bc-e885646bb583 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:50:38.832467 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c439d9b7-e041-486b-a6bc-e885646bb583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:50:38.844168 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439d9b7-e041-486b-a6bc-e885646bb583 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:50:38.905463 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:50:38.940899 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337811b-0248-48c4-9bea-ac463b445ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:50:38.941506 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337811b-0248-48c4-9bea-ac463b445ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:50:38.941791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337811b-0248-48c4-9bea-ac463b445ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:50:38.942070 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337811b-0248-48c4-9bea-ac463b445ac2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:50:38.942720 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337811b-0248-48c4-9bea-ac463b445ac2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:50:38.943023 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337811b-0248-48c4-9bea-ac463b445ac2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:50:38.944106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: WARNING py.warnings [None req-b337811b-0248-48c4-9bea-ac463b445ac2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 13:50:38.944106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: warnings.warn(msg) Sep 01 13:50:38.944106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: Sep 01 13:50:38.945001 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337811b-0248-48c4-9bea-ac463b445ac2 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:50:38.956220 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 750/1496] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:50:38.964801 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f2829-e56a-4710-b8fd-11f8f153a40f None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:50:38.974402 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f2829-e56a-4710-b8fd-11f8f153a40f None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:50:39.036747 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:50:39.070554 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e529a-a8df-4923-b421-f911ecfc45a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:50:39.071162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e529a-a8df-4923-b421-f911ecfc45a2 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:50:39.071471 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e529a-a8df-4923-b421-f911ecfc45a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:50:39.071743 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e529a-a8df-4923-b421-f911ecfc45a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:50:39.072393 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e529a-a8df-4923-b421-f911ecfc45a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:50:39.074163 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: WARNING py.warnings [None req-023e529a-a8df-4923-b421-f911ecfc45a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 13:50:39.074163 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: warnings.warn(msg) Sep 01 13:50:39.074163 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: Sep 01 13:50:39.075467 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e529a-a8df-4923-b421-f911ecfc45a2 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:50:39.226978 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 747/1497] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:50:38 2022] POST /identity/v3/projects => generated 379 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:50:39.231854 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337811b-0248-48c4-9bea-ac463b445ac2 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:50:39.233917 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b337811b-0248-48c4-9bea-ac463b445ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:50:39.268375 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337811b-0248-48c4-9bea-ac463b445ac2 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:50:39.366937 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c83bc-2071-4ac7-9671-d28e43fbbd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:50:39.367480 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c83bc-2071-4ac7-9671-d28e43fbbd39 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:50:39.367757 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c83bc-2071-4ac7-9671-d28e43fbbd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:50:39.368022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c83bc-2071-4ac7-9671-d28e43fbbd39 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:50:39.368672 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c83bc-2071-4ac7-9671-d28e43fbbd39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:50:39.369680 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: WARNING py.warnings [None req-360c83bc-2071-4ac7-9671-d28e43fbbd39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 13:50:39.369680 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: warnings.warn(msg) Sep 01 13:50:39.369680 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: Sep 01 13:50:39.370878 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c83bc-2071-4ac7-9671-d28e43fbbd39 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:50:39.515647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 751/1498] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:50:39 2022] POST /identity/v3/users => generated 290 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:50:39.519751 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e529a-a8df-4923-b421-f911ecfc45a2 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:50:39.521739 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-023e529a-a8df-4923-b421-f911ecfc45a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:50:39.584210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e529a-a8df-4923-b421-f911ecfc45a2 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:50:39.670261 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:50:39.680645 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302ddc5-bef0-4405-bcfd-e90f84ba2583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:50:39.684615 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302ddc5-bef0-4405-bcfd-e90f84ba2583 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:50:39.684615 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302ddc5-bef0-4405-bcfd-e90f84ba2583 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:50:39.684615 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302ddc5-bef0-4405-bcfd-e90f84ba2583 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:50:39.684615 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302ddc5-bef0-4405-bcfd-e90f84ba2583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:50:39.684615 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: WARNING py.warnings [None req-5302ddc5-bef0-4405-bcfd-e90f84ba2583 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 13:50:39.684615 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: warnings.warn(msg) Sep 01 13:50:39.684615 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: Sep 01 13:50:39.685302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302ddc5-bef0-4405-bcfd-e90f84ba2583 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:50:39.697812 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 748/1499] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:50:39.701845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c83bc-2071-4ac7-9671-d28e43fbbd39 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:50:39.703480 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-360c83bc-2071-4ac7-9671-d28e43fbbd39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:50:39.715431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c83bc-2071-4ac7-9671-d28e43fbbd39 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:50:39.740576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:50:39.810416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd3ce0-401d-4194-a336-ffd07ffc9f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:50:39.811015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd3ce0-401d-4194-a336-ffd07ffc9f27 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:50:39.811291 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd3ce0-401d-4194-a336-ffd07ffc9f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:50:39.811658 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd3ce0-401d-4194-a336-ffd07ffc9f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:50:39.812290 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd3ce0-401d-4194-a336-ffd07ffc9f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:50:39.813299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: WARNING py.warnings [None req-18dd3ce0-401d-4194-a336-ffd07ffc9f27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 13:50:39.813299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: warnings.warn(msg) Sep 01 13:50:39.813299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: Sep 01 13:50:39.814172 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd3ce0-401d-4194-a336-ffd07ffc9f27 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:50:39.828939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 752/1500] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:50:39.833843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302ddc5-bef0-4405-bcfd-e90f84ba2583 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:50:39.835601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-5302ddc5-bef0-4405-bcfd-e90f84ba2583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:50:39.870289 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302ddc5-bef0-4405-bcfd-e90f84ba2583 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:50:39.964230 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50e56e-6f6f-49c0-a6e8-44a38d69275d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:50:39.964800 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50e56e-6f6f-49c0-a6e8-44a38d69275d admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:50:39.965095 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50e56e-6f6f-49c0-a6e8-44a38d69275d admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:50:39.965346 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50e56e-6f6f-49c0-a6e8-44a38d69275d admin admin] PATH_INFO: `/v3/projects/02d87792612c4f37bcd4d48a0f4817b8/users/b849f3aec99c4ed5b45313dd7250ccda/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:50:39.987266 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50e56e-6f6f-49c0-a6e8-44a38d69275d admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d87792612c4f37bcd4d48a0f4817b8, user_id=b849f3aec99c4ed5b45313dd7250ccda, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:50:39.988332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: WARNING py.warnings [None req-4d50e56e-6f6f-49c0-a6e8-44a38d69275d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 13:50:39.988332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: warnings.warn(msg) Sep 01 13:50:39.988332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: Sep 01 13:50:39.990757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50e56e-6f6f-49c0-a6e8-44a38d69275d admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:50:40.103749 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 749/1501] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:50:39 2022] PUT /identity/v3/projects/02d87792612c4f37bcd4d48a0f4817b8/users/b849f3aec99c4ed5b45313dd7250ccda/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:50:40.116793 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ff768-5d89-4308-9bc9-2878bb072a5d None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:50:40.117081 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ff768-5d89-4308-9bc9-2878bb072a5d None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:50:40.117383 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ff768-5d89-4308-9bc9-2878bb072a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:50:40.173499 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-3e3ff768-5d89-4308-9bc9-2878bb072a5d None None] MFA Rules not processed for user `b849f3aec99c4ed5b45313dd7250ccda`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:50:40.174700 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-3e3ff768-5d89-4308-9bc9-2878bb072a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:50:40.254204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 753/1502] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:50:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:50:40.267963 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d20c71-0783-4082-93f8-2ea1ff1eeb38 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:50:40.268247 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d20c71-0783-4082-93f8-2ea1ff1eeb38 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:50:40.268522 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d20c71-0783-4082-93f8-2ea1ff1eeb38 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:50:40.269900 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 750/1503] 10.222.0.50 () {54 vars in 964 bytes} [Thu Sep 1 13:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:50:40.274699 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df72ec-80f3-4a49-8959-aa62248e3502 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:50:40.274984 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df72ec-80f3-4a49-8959-aa62248e3502 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:50:40.275262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df72ec-80f3-4a49-8959-aa62248e3502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:50:40.307461 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:50:40.351648 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-75df72ec-80f3-4a49-8959-aa62248e3502 None None] MFA Rules not processed for user `1dc5b80f0e4c48189389d23507a9d2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:50:40.352870 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-75df72ec-80f3-4a49-8959-aa62248e3502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:50:40.429035 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 754/1504] 10.222.0.50 () {58 vars in 1061 bytes} [Thu Sep 1 13:50:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:50:40.438881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d20c71-0783-4082-93f8-2ea1ff1eeb38 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:50:40.440418 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-32d20c71-0783-4082-93f8-2ea1ff1eeb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:50:40.490634 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:50:40.545164 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d20c71-0783-4082-93f8-2ea1ff1eeb38 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:50:40.619209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db1465-4d95-4253-a9a1-e59cae375c4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:50:40.619834 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db1465-4d95-4253-a9a1-e59cae375c4a service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:50:40.620110 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db1465-4d95-4253-a9a1-e59cae375c4a service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:50:40.620378 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db1465-4d95-4253-a9a1-e59cae375c4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:50:40.621954 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a3db1465-4d95-4253-a9a1-e59cae375c4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:50:40.720062 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db1465-4d95-4253-a9a1-e59cae375c4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:50:40.721506 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db1465-4d95-4253-a9a1-e59cae375c4a service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:50:40.725503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:50:40.739883 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 751/1505] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:50:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:50:40.785479 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5453306-3a2b-4bc7-a6c1-a8ac45b7992a None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:50:40.786510 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5453306-3a2b-4bc7-a6c1-a8ac45b7992a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:50:40.786745 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5453306-3a2b-4bc7-a6c1-a8ac45b7992a None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:50:40.788028 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 755/1506] 10.222.0.50 () {52 vars in 830 bytes} [Thu Sep 1 13:50:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:50:40.791593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db1465-4d95-4253-a9a1-e59cae375c4a service cinder] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:50:40.792798 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a3db1465-4d95-4253-a9a1-e59cae375c4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:50:40.893076 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db1465-4d95-4253-a9a1-e59cae375c4a service cinder] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:50:40.988631 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272b994-359d-471f-a175-f37e6a2e7acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:50:40.989260 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272b994-359d-471f-a175-f37e6a2e7acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:50:40.989617 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272b994-359d-471f-a175-f37e6a2e7acf admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:50:40.989793 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272b994-359d-471f-a175-f37e6a2e7acf admin admin] PATH_INFO: `/v3/users/b849f3aec99c4ed5b45313dd7250ccda` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:50:41.003500 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272b994-359d-471f-a175-f37e6a2e7acf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b849f3aec99c4ed5b45313dd7250ccda)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:50:41.004535 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: WARNING py.warnings [None req-c272b994-359d-471f-a175-f37e6a2e7acf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 13:50:41.004535 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: warnings.warn(msg) Sep 01 13:50:41.004535 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: Sep 01 13:50:41.005744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272b994-359d-471f-a175-f37e6a2e7acf admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:50:41.015342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:50:41.234453 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c272b994-359d-471f-a175-f37e6a2e7acf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b849f3aec99c4ed5b45313dd7250ccda'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:50:41.235037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c272b994-359d-471f-a175-f37e6a2e7acf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b849f3aec99c4ed5b45313dd7250ccda'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:50:41.259662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c272b994-359d-471f-a175-f37e6a2e7acf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b849f3aec99c4ed5b45313dd7250ccda'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:50:41.274413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c272b994-359d-471f-a175-f37e6a2e7acf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b849f3aec99c4ed5b45313dd7250ccda'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:50:41.371780 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c272b994-359d-471f-a175-f37e6a2e7acf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b849f3aec99c4ed5b45313dd7250ccda'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:50:41.381466 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 752/1507] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:50:40 2022] DELETE /identity/v3/users/b849f3aec99c4ed5b45313dd7250ccda => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:50:41.386044 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbb3c0-6089-4cc2-9c8c-2a0dd05d45d7 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:50:41.386337 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbb3c0-6089-4cc2-9c8c-2a0dd05d45d7 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:50:41.386614 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbb3c0-6089-4cc2-9c8c-2a0dd05d45d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:50:41.445025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-9ecbb3c0-6089-4cc2-9c8c-2a0dd05d45d7 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:50:41.446240 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-9ecbb3c0-6089-4cc2-9c8c-2a0dd05d45d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:50:41.522089 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:50:41.535069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 756/1508] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:50:41.545193 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272b994-359d-471f-a175-f37e6a2e7acf admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:50:41.546405 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c272b994-359d-471f-a175-f37e6a2e7acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:50:41.646813 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272b994-359d-471f-a175-f37e6a2e7acf admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:50:41.701142 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:50:41.719523 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4af90-a99c-4dc8-80f3-5fbc49098060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:50:41.720139 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4af90-a99c-4dc8-80f3-5fbc49098060 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:50:41.720694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4af90-a99c-4dc8-80f3-5fbc49098060 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:50:41.720694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4af90-a99c-4dc8-80f3-5fbc49098060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:50:41.722242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-ccf4af90-a99c-4dc8-80f3-5fbc49098060 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:50:41.831121 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4af90-a99c-4dc8-80f3-5fbc49098060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:50:41.833672 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4af90-a99c-4dc8-80f3-5fbc49098060 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:50:41.854756 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 753/1509] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:50:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:50:42.402676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbb3c0-6089-4cc2-9c8c-2a0dd05d45d7 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:50:42.403923 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-9ecbb3c0-6089-4cc2-9c8c-2a0dd05d45d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:50:42.415776 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbb3c0-6089-4cc2-9c8c-2a0dd05d45d7 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:50:42.536178 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125dc0e-d0e5-4b88-9946-30101250db24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:50:42.536887 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125dc0e-d0e5-4b88-9946-30101250db24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:50:42.537171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125dc0e-d0e5-4b88-9946-30101250db24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:50:42.537445 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125dc0e-d0e5-4b88-9946-30101250db24 admin admin] PATH_INFO: `/v3/projects/02d87792612c4f37bcd4d48a0f4817b8` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:50:42.549404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125dc0e-d0e5-4b88-9946-30101250db24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02d87792612c4f37bcd4d48a0f4817b8)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:50:42.550462 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: WARNING py.warnings [None req-1125dc0e-d0e5-4b88-9946-30101250db24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 13:50:42.550462 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: warnings.warn(msg) Sep 01 13:50:42.550462 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: Sep 01 13:50:42.552224 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125dc0e-d0e5-4b88-9946-30101250db24 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:50:42.686944 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-1125dc0e-d0e5-4b88-9946-30101250db24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02d87792612c4f37bcd4d48a0f4817b8', 'request_id': 'req-1125dc0e-d0e5-4b88-9946-30101250db24'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:50:42.692859 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-1125dc0e-d0e5-4b88-9946-30101250db24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02d87792612c4f37bcd4d48a0f4817b8', 'request_id': 'req-1125dc0e-d0e5-4b88-9946-30101250db24'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:50:42.753603 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-1125dc0e-d0e5-4b88-9946-30101250db24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02d87792612c4f37bcd4d48a0f4817b8', 'request_id': 'req-1125dc0e-d0e5-4b88-9946-30101250db24'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:50:42.782950 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-1125dc0e-d0e5-4b88-9946-30101250db24 admin admin] The token cache is being invalidate because project 02d87792612c4f37bcd4d48a0f4817b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:50:42.783233 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-1125dc0e-d0e5-4b88-9946-30101250db24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:50:42.783783 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-1125dc0e-d0e5-4b88-9946-30101250db24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:50:42.785072 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 757/1510] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:50:42 2022] DELETE /identity/v3/projects/02d87792612c4f37bcd4d48a0f4817b8 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:50:51.852343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=62 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:50:52.780918 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:52:12.359431 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83978b18-202c-4f52-abe1-a43c188a87a8 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:12.360043 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83978b18-202c-4f52-abe1-a43c188a87a8 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:12.360144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83978b18-202c-4f52-abe1-a43c188a87a8 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:12.361484 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 13:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:52:12.366530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca3962-6108-48f5-bce2-843e37a4e98d None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:12.367020 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca3962-6108-48f5-bce2-843e37a4e98d None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:12.367128 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca3962-6108-48f5-bce2-843e37a4e98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:12.454722 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-4eca3962-6108-48f5-bce2-843e37a4e98d None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:52:12.454722 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-4eca3962-6108-48f5-bce2-843e37a4e98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:52:12.561823 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 13:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:52:12.715922 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83978b18-202c-4f52-abe1-a43c188a87a8 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:52:12.718199 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-83978b18-202c-4f52-abe1-a43c188a87a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:52:12.841683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83978b18-202c-4f52-abe1-a43c188a87a8 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:52:12.847158 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82510bd-39a2-4667-bdc9-3ff935398b75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:52:12.847788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82510bd-39a2-4667-bdc9-3ff935398b75 service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:12.848064 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82510bd-39a2-4667-bdc9-3ff935398b75 service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:12.848330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82510bd-39a2-4667-bdc9-3ff935398b75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:12.857008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82510bd-39a2-4667-bdc9-3ff935398b75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:52:12.859405 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82510bd-39a2-4667-bdc9-3ff935398b75 service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:52:12.869734 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 755/1513] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:52:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:52:13.712069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391de192-d2f6-46a4-b93d-87666f133ebe None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:13.712667 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391de192-d2f6-46a4-b93d-87666f133ebe None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:13.712667 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391de192-d2f6-46a4-b93d-87666f133ebe None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:13.713995 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 13:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:52:13.718817 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9f844-bc07-4af0-9e24-8e337366914f None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:13.719252 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9f844-bc07-4af0-9e24-8e337366914f None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:13.719426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9f844-bc07-4af0-9e24-8e337366914f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:13.740807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-6ae9f844-bc07-4af0-9e24-8e337366914f None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:52:13.742034 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-6ae9f844-bc07-4af0-9e24-8e337366914f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:52:13.750704 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 13:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:52:13.903249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391de192-d2f6-46a4-b93d-87666f133ebe None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:52:13.918887 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391de192-d2f6-46a4-b93d-87666f133ebe None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:52:13.924627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a615b-d2c2-4c0e-a63f-d189dea1017b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:52:13.925242 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a615b-d2c2-4c0e-a63f-d189dea1017b service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:13.925522 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a615b-d2c2-4c0e-a63f-d189dea1017b service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:13.925795 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a615b-d2c2-4c0e-a63f-d189dea1017b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:13.934639 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a615b-d2c2-4c0e-a63f-d189dea1017b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:52:13.936294 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a615b-d2c2-4c0e-a63f-d189dea1017b service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:52:13.945934 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 760/1516] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:52:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:52:15.519620 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39666bc4-eff8-479d-b1bc-755e60ddd3be None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:15.520223 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39666bc4-eff8-479d-b1bc-755e60ddd3be None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:15.520223 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39666bc4-eff8-479d-b1bc-755e60ddd3be None None] PATH_INFO: `/v3` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:15.521436 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 757/1517] 10.222.0.27 () {54 vars in 925 bytes} [Thu Sep 1 13:52:15 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:52:15.528560 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7305ce-e30c-4084-b66f-16fd97f26806 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:15.529047 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7305ce-e30c-4084-b66f-16fd97f26806 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:15.529156 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7305ce-e30c-4084-b66f-16fd97f26806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:15.590284 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-3a7305ce-e30c-4084-b66f-16fd97f26806 None None] MFA Rules not processed for user `63e675d44d2c49929feb0ec0d2c0d0eb`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:52:15.591564 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-3a7305ce-e30c-4084-b66f-16fd97f26806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:52:15.609496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:52:15.664483 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 761/1518] 10.222.0.27 () {58 vars in 1015 bytes} [Thu Sep 1 13:52:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:52:20.037897 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f589e-0bd8-4562-80e2-97f10dd176b0 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:20.038439 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f589e-0bd8-4562-80e2-97f10dd176b0 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:20.038439 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f589e-0bd8-4562-80e2-97f10dd176b0 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:20.039861 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 758/1519] 10.222.0.50 () {54 vars in 961 bytes} [Thu Sep 1 13:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:52:20.044842 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994592c-b187-40c1-8c1a-a990f6f4c477 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:20.045345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994592c-b187-40c1-8c1a-a990f6f4c477 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:20.045445 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994592c-b187-40c1-8c1a-a990f6f4c477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:20.067069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-d994592c-b187-40c1-8c1a-a990f6f4c477 None None] MFA Rules not processed for user `63e675d44d2c49929feb0ec0d2c0d0eb`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:52:20.068341 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-d994592c-b187-40c1-8c1a-a990f6f4c477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:52:20.077671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 762/1520] 10.222.0.50 () {58 vars in 1058 bytes} [Thu Sep 1 13:52:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:52:20.085686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f589e-0bd8-4562-80e2-97f10dd176b0 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:52:20.099029 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f589e-0bd8-4562-80e2-97f10dd176b0 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:52:20.104386 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489cfa4-4656-4bc0-99ec-37ec1817a427 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e675d44d2c49929feb0ec0d2c0d0eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:52:20.104983 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489cfa4-4656-4bc0-99ec-37ec1817a427 service placement] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:20.105259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489cfa4-4656-4bc0-99ec-37ec1817a427 service placement] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:20.105548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489cfa4-4656-4bc0-99ec-37ec1817a427 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:20.114528 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489cfa4-4656-4bc0-99ec-37ec1817a427 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:52:20.116149 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489cfa4-4656-4bc0-99ec-37ec1817a427 service placement] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:52:20.126418 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 759/1521] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:52:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:52:25.197101 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1f6fb-2ba4-4b44-9292-69ca0968fa3d None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:25.197625 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1f6fb-2ba4-4b44-9292-69ca0968fa3d None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:25.197625 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1f6fb-2ba4-4b44-9292-69ca0968fa3d None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:25.198942 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 13:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:52:25.204166 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16e802-01f5-48b4-a2c0-114e8a25d297 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:25.204632 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16e802-01f5-48b4-a2c0-114e8a25d297 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:25.204740 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16e802-01f5-48b4-a2c0-114e8a25d297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:25.225275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-9f16e802-01f5-48b4-a2c0-114e8a25d297 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:52:25.226495 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-9f16e802-01f5-48b4-a2c0-114e8a25d297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:52:25.235299 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 13:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:52:25.404285 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1f6fb-2ba4-4b44-9292-69ca0968fa3d None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:52:25.419838 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1f6fb-2ba4-4b44-9292-69ca0968fa3d None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:52:25.425444 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e37745-594c-42fc-9d7f-5f682555cfc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:52:25.426050 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e37745-594c-42fc-9d7f-5f682555cfc4 service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:25.426334 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e37745-594c-42fc-9d7f-5f682555cfc4 service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:25.426609 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e37745-594c-42fc-9d7f-5f682555cfc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:25.436148 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e37745-594c-42fc-9d7f-5f682555cfc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:52:25.438044 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e37745-594c-42fc-9d7f-5f682555cfc4 service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:52:25.448875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 764/1524] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:52:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 13:52:26.304717 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b04a9-9d06-4045-9fa2-04fcc78c9b93 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:26.305286 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b04a9-9d06-4045-9fa2-04fcc78c9b93 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:26.305286 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b04a9-9d06-4045-9fa2-04fcc78c9b93 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:26.307208 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 13:52:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:52:26.312543 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe23125-8b92-4fb9-9f7a-e92ce5224ebd None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:26.313039 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe23125-8b92-4fb9-9f7a-e92ce5224ebd None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:26.313144 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe23125-8b92-4fb9-9f7a-e92ce5224ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:26.332697 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-8fe23125-8b92-4fb9-9f7a-e92ce5224ebd None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:52:26.343910 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-8fe23125-8b92-4fb9-9f7a-e92ce5224ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:52:26.343910 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 13:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:52:26.497304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b04a9-9d06-4045-9fa2-04fcc78c9b93 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:52:26.511577 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b04a9-9d06-4045-9fa2-04fcc78c9b93 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:52:26.517301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81941c23-a67e-4b44-9944-a1f3779462ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:52:26.517902 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81941c23-a67e-4b44-9944-a1f3779462ba service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:26.518185 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81941c23-a67e-4b44-9944-a1f3779462ba service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:26.518461 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81941c23-a67e-4b44-9944-a1f3779462ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:26.527478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81941c23-a67e-4b44-9944-a1f3779462ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:52:26.529078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81941c23-a67e-4b44-9944-a1f3779462ba service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:52:26.538797 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 762/1527] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:52:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:52:30.500633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39334879-6765-4b9e-8cfe-61b281174147 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:30.501177 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39334879-6765-4b9e-8cfe-61b281174147 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:30.501177 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39334879-6765-4b9e-8cfe-61b281174147 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:30.502418 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 13:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:52:30.507728 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feaa601-0f53-4d31-9653-2a52e19cccd3 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:30.508241 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feaa601-0f53-4d31-9653-2a52e19cccd3 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:30.508346 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feaa601-0f53-4d31-9653-2a52e19cccd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:30.528986 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-7feaa601-0f53-4d31-9653-2a52e19cccd3 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:52:30.530187 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-7feaa601-0f53-4d31-9653-2a52e19cccd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:52:30.538072 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 13:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:52:30.828344 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39334879-6765-4b9e-8cfe-61b281174147 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:52:30.830117 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-39334879-6765-4b9e-8cfe-61b281174147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:52:30.908999 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39334879-6765-4b9e-8cfe-61b281174147 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:52:30.912818 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2855bdc-244e-40ee-9444-5b20ed79cd51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:52:30.913426 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2855bdc-244e-40ee-9444-5b20ed79cd51 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:30.913706 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2855bdc-244e-40ee-9444-5b20ed79cd51 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:30.913978 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2855bdc-244e-40ee-9444-5b20ed79cd51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:30.924077 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2855bdc-244e-40ee-9444-5b20ed79cd51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:52:30.925620 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2855bdc-244e-40ee-9444-5b20ed79cd51 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:52:30.936406 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 767/1530] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:52:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:52:32.830328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79a93c-6fc2-4b00-a552-a0190d3a4e70 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:32.830934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79a93c-6fc2-4b00-a552-a0190d3a4e70 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:32.830934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79a93c-6fc2-4b00-a552-a0190d3a4e70 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:32.832241 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 13:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:52:32.838049 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171b153-8050-4e46-8ac6-c216ac901521 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:32.838557 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171b153-8050-4e46-8ac6-c216ac901521 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:32.838660 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171b153-8050-4e46-8ac6-c216ac901521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:32.860589 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-f171b153-8050-4e46-8ac6-c216ac901521 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:52:32.861832 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-f171b153-8050-4e46-8ac6-c216ac901521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:52:32.869785 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 13:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:52:33.154206 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79a93c-6fc2-4b00-a552-a0190d3a4e70 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:52:33.165029 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79a93c-6fc2-4b00-a552-a0190d3a4e70 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:52:33.168525 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3678dc-cedd-4add-9675-4c0ffab52e7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:52:33.169117 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3678dc-cedd-4add-9675-4c0ffab52e7d service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:33.169397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3678dc-cedd-4add-9675-4c0ffab52e7d service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:33.169671 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3678dc-cedd-4add-9675-4c0ffab52e7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:33.178440 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3678dc-cedd-4add-9675-4c0ffab52e7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:52:33.179920 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3678dc-cedd-4add-9675-4c0ffab52e7d service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:52:33.189200 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 765/1533] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:52:36.595571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffb414-1a52-48d7-8f46-e8703bfec19c None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:36.596149 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffb414-1a52-48d7-8f46-e8703bfec19c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:36.596149 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffb414-1a52-48d7-8f46-e8703bfec19c None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:36.597473 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 13:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:52:36.603735 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b80258-0772-4e88-8a77-331cc258d35a None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:36.604155 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b80258-0772-4e88-8a77-331cc258d35a None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:36.604266 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b80258-0772-4e88-8a77-331cc258d35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:36.623446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-60b80258-0772-4e88-8a77-331cc258d35a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:52:36.624662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-60b80258-0772-4e88-8a77-331cc258d35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:52:36.632446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 13:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:52:37.190067 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffb414-1a52-48d7-8f46-e8703bfec19c None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:52:37.191788 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a3ffb414-1a52-48d7-8f46-e8703bfec19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:52:37.259423 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:52:37.273159 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffb414-1a52-48d7-8f46-e8703bfec19c None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:52:37.277554 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bf079-05e0-41c8-a57d-da46a6224912 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:52:37.278156 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bf079-05e0-41c8-a57d-da46a6224912 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:37.278433 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bf079-05e0-41c8-a57d-da46a6224912 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:37.278700 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bf079-05e0-41c8-a57d-da46a6224912 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:37.288084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983bf079-05e0-41c8-a57d-da46a6224912 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:52:37.289502 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983bf079-05e0-41c8-a57d-da46a6224912 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:52:37.300164 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 770/1536] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:52:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:52:39.230017 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba0b36-c0c9-457b-b0f4-d8c9308db986 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:39.230553 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba0b36-c0c9-457b-b0f4-d8c9308db986 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:39.230553 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba0b36-c0c9-457b-b0f4-d8c9308db986 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:39.231884 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 13:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:52:39.236929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12139a4d-f797-44e4-9557-2f7638d0a9bf None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:39.237358 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12139a4d-f797-44e4-9557-2f7638d0a9bf None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:39.237496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12139a4d-f797-44e4-9557-2f7638d0a9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:39.258060 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-12139a4d-f797-44e4-9557-2f7638d0a9bf None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:52:39.259649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-12139a4d-f797-44e4-9557-2f7638d0a9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:52:39.267974 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 13:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:52:39.822413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba0b36-c0c9-457b-b0f4-d8c9308db986 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:52:39.824172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b0ba0b36-c0c9-457b-b0f4-d8c9308db986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:52:39.840211 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba0b36-c0c9-457b-b0f4-d8c9308db986 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:52:39.845784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef23ed4-31ed-4652-831d-b62f27fc107d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:52:39.846458 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef23ed4-31ed-4652-831d-b62f27fc107d service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:52:39.846966 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef23ed4-31ed-4652-831d-b62f27fc107d service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:52:39.847472 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef23ed4-31ed-4652-831d-b62f27fc107d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:52:39.861759 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef23ed4-31ed-4652-831d-b62f27fc107d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:52:39.863229 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef23ed4-31ed-4652-831d-b62f27fc107d service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:52:39.873878 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 768/1539] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:52:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:52:49.252956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=11 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:52:49.869165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=89 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:07.839319 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bc80c-f654-4bfd-8ff8-f5eca856b153 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:07.839948 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bc80c-f654-4bfd-8ff8-f5eca856b153 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:07.839948 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bc80c-f654-4bfd-8ff8-f5eca856b153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:07.877270 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-b89bc80c-f654-4bfd-8ff8-f5eca856b153 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:07.878589 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b89bc80c-f654-4bfd-8ff8-f5eca856b153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:07.890121 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 772/1540] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:07.900452 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbd0c8-94cc-41f4-bbba-e9f3ddf47ffa None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:07.901032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbd0c8-94cc-41f4-bbba-e9f3ddf47ffa None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:07.901032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbd0c8-94cc-41f4-bbba-e9f3ddf47ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:07.929142 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-b7dbd0c8-94cc-41f4-bbba-e9f3ddf47ffa None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:07.930348 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b7dbd0c8-94cc-41f4-bbba-e9f3ddf47ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:07.943338 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 769/1541] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:07.948132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bc80c-f654-4bfd-8ff8-f5eca856b153 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:07.959562 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bc80c-f654-4bfd-8ff8-f5eca856b153 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:07.967790 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107afd4-1fc8-4535-8335-25ae33cb0e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:07.968417 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107afd4-1fc8-4535-8335-25ae33cb0e33 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:07.968696 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107afd4-1fc8-4535-8335-25ae33cb0e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:07.968967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107afd4-1fc8-4535-8335-25ae33cb0e33 admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:07.969624 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107afd4-1fc8-4535-8335-25ae33cb0e33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:54:07.969921 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107afd4-1fc8-4535-8335-25ae33cb0e33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:07.972172 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107afd4-1fc8-4535-8335-25ae33cb0e33 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:07.989688 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 773/1542] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:54:07.998145 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbd0c8-94cc-41f4-bbba-e9f3ddf47ffa None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:08.008109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbd0c8-94cc-41f4-bbba-e9f3ddf47ffa None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:08.016809 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf87df4-1096-4a62-9382-04008335e1a0 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:08.017190 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf87df4-1096-4a62-9382-04008335e1a0 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:08.017432 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf87df4-1096-4a62-9382-04008335e1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:08.022889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9977fa-5179-435e-a9fc-4b32a77f62a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:08.023975 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9977fa-5179-435e-a9fc-4b32a77f62a6 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:08.024497 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9977fa-5179-435e-a9fc-4b32a77f62a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:08.024977 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9977fa-5179-435e-a9fc-4b32a77f62a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:08.026015 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9977fa-5179-435e-a9fc-4b32a77f62a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:08.028440 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9977fa-5179-435e-a9fc-4b32a77f62a6 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:08.048382 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-acf87df4-1096-4a62-9382-04008335e1a0 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:08.050473 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-acf87df4-1096-4a62-9382-04008335e1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:08.075611 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 774/1543] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:08.076856 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0efc0-1646-47e2-8473-a03b2bdfd3d8 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:08.077114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0efc0-1646-47e2-8473-a03b2bdfd3d8 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:08.077365 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0efc0-1646-47e2-8473-a03b2bdfd3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:08.102854 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-efd0efc0-1646-47e2-8473-a03b2bdfd3d8 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:08.104002 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-efd0efc0-1646-47e2-8473-a03b2bdfd3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:08.113351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 775/1544] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:08.114381 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a8d5b-5206-4325-ac29-9578873f69f3 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:08.114665 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a8d5b-5206-4325-ac29-9578873f69f3 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:08.114938 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a8d5b-5206-4325-ac29-9578873f69f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:08.136508 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-ba5a8d5b-5206-4325-ac29-9578873f69f3 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:08.137697 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ba5a8d5b-5206-4325-ac29-9578873f69f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:08.147231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 776/1545] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:08.150189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462db2d6-c45a-4d12-a18f-0d47d18ab779 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:08.150189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462db2d6-c45a-4d12-a18f-0d47d18ab779 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:08.150189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462db2d6-c45a-4d12-a18f-0d47d18ab779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:08.173618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 770/1546] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:07 2022] POST /identity/v3/projects => generated 377 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:08.177650 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-462db2d6-c45a-4d12-a18f-0d47d18ab779 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:08.177650 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-462db2d6-c45a-4d12-a18f-0d47d18ab779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:08.179785 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23e79c-536c-44d6-a888-22dfc56c4114 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:08.180454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23e79c-536c-44d6-a888-22dfc56c4114 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:08.180998 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23e79c-536c-44d6-a888-22dfc56c4114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:08.203451 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-9d23e79c-536c-44d6-a888-22dfc56c4114 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:08.204756 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-9d23e79c-536c-44d6-a888-22dfc56c4114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:08.253467 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 777/1547] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:08.255115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f944850-c762-4f00-913d-9e80d51395b4 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:08.255688 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f944850-c762-4f00-913d-9e80d51395b4 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:08.256166 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f944850-c762-4f00-913d-9e80d51395b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:08.279766 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-4f944850-c762-4f00-913d-9e80d51395b4 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:08.281023 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-4f944850-c762-4f00-913d-9e80d51395b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:08.281749 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 771/1548] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:08.283071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e8b90-f2a8-4351-859e-ea12d606d992 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:08.283438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e8b90-f2a8-4351-859e-ea12d606d992 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:08.289053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e8b90-f2a8-4351-859e-ea12d606d992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:08.296401 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 778/1549] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:08.297711 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa27ba-25f1-4161-b3dd-2ca4b77290dc None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:08.298001 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa27ba-25f1-4161-b3dd-2ca4b77290dc None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:08.298278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa27ba-25f1-4161-b3dd-2ca4b77290dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:08.309662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-009e8b90-f2a8-4351-859e-ea12d606d992 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:08.310882 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-009e8b90-f2a8-4351-859e-ea12d606d992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:08.318575 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-a9fa27ba-25f1-4161-b3dd-2ca4b77290dc None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:08.319931 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a9fa27ba-25f1-4161-b3dd-2ca4b77290dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:08.320083 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 772/1550] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:08.321430 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e8b90-f2a8-4351-859e-ea12d606d992 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:08.328551 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 779/1551] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:08.329879 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece36a72-6bc6-4081-9a25-4cc106ba105e None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:08.330167 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece36a72-6bc6-4081-9a25-4cc106ba105e None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:08.330447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece36a72-6bc6-4081-9a25-4cc106ba105e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:08.332350 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e8b90-f2a8-4351-859e-ea12d606d992 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:08.337413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa58c6e-1dd3-47c8-b691-9aa76195572e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:08.348356 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa58c6e-1dd3-47c8-b691-9aa76195572e admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:08.348356 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa58c6e-1dd3-47c8-b691-9aa76195572e admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:08.348356 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa58c6e-1dd3-47c8-b691-9aa76195572e admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:08.348356 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa58c6e-1dd3-47c8-b691-9aa76195572e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:08.348356 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: WARNING py.warnings [None req-efa58c6e-1dd3-47c8-b691-9aa76195572e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 13:54:08.348356 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: warnings.warn(msg) Sep 01 13:54:08.348356 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: Sep 01 13:54:08.348992 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa58c6e-1dd3-47c8-b691-9aa76195572e admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:08.351333 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-ece36a72-6bc6-4081-9a25-4cc106ba105e None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:08.352394 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ece36a72-6bc6-4081-9a25-4cc106ba105e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:08.360499 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 780/1552] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:08.361254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece36a72-6bc6-4081-9a25-4cc106ba105e None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:08.374000 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece36a72-6bc6-4081-9a25-4cc106ba105e None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:08.379226 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4471e3-794c-4c5e-a4e3-96d5b5867f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:08.379881 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4471e3-794c-4c5e-a4e3-96d5b5867f2a admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:08.380160 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4471e3-794c-4c5e-a4e3-96d5b5867f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:08.380430 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4471e3-794c-4c5e-a4e3-96d5b5867f2a admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:08.381087 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4471e3-794c-4c5e-a4e3-96d5b5867f2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:54:08.381391 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4471e3-794c-4c5e-a4e3-96d5b5867f2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:08.382997 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4471e3-794c-4c5e-a4e3-96d5b5867f2a admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:08.395780 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 781/1553] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:54:08.397368 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6fa0a-95b4-4742-b8c3-7f619711730b None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:08.397655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6fa0a-95b4-4742-b8c3-7f619711730b None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:08.397926 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6fa0a-95b4-4742-b8c3-7f619711730b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:08.417674 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-0ef6fa0a-95b4-4742-b8c3-7f619711730b None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:08.418894 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-0ef6fa0a-95b4-4742-b8c3-7f619711730b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:08.426811 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 782/1554] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:08.440370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9f61a-b24f-4532-bd98-9613e906ac8a None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:08.440370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9f61a-b24f-4532-bd98-9613e906ac8a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:08.440370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9f61a-b24f-4532-bd98-9613e906ac8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:08.450175 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-a7e9f61a-b24f-4532-bd98-9613e906ac8a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:08.451416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a7e9f61a-b24f-4532-bd98-9613e906ac8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:08.460197 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 783/1555] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:08.461433 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0a512-4d7a-4208-8ada-3f45c737bddb None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:08.461714 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0a512-4d7a-4208-8ada-3f45c737bddb None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:08.462032 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0a512-4d7a-4208-8ada-3f45c737bddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:08.481282 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-f1e0a512-4d7a-4208-8ada-3f45c737bddb None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:08.482556 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-f1e0a512-4d7a-4208-8ada-3f45c737bddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:08.491056 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 784/1556] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:08.492108 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0a512-4d7a-4208-8ada-3f45c737bddb None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:08.501749 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0a512-4d7a-4208-8ada-3f45c737bddb None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:08.506847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c040fee-4c14-475a-b42e-c37819f38283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:08.507476 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c040fee-4c14-475a-b42e-c37819f38283 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:08.507757 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c040fee-4c14-475a-b42e-c37819f38283 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:08.508026 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c040fee-4c14-475a-b42e-c37819f38283 admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:08.508666 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c040fee-4c14-475a-b42e-c37819f38283 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:54:08.508964 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c040fee-4c14-475a-b42e-c37819f38283 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:08.510558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c040fee-4c14-475a-b42e-c37819f38283 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:08.518935 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 773/1557] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:08 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:08.520224 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa58c6e-1dd3-47c8-b691-9aa76195572e admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:08.523339 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 785/1558] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:54:08.524801 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7300384-db10-421f-bfe2-ba48ae3ce525 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:08.525090 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7300384-db10-421f-bfe2-ba48ae3ce525 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:08.525364 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7300384-db10-421f-bfe2-ba48ae3ce525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:08.534209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa58c6e-1dd3-47c8-b691-9aa76195572e admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:08.539270 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f0669-c273-4e19-88ed-2fa9292041a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:08.539925 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f0669-c273-4e19-88ed-2fa9292041a3 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:08.540203 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f0669-c273-4e19-88ed-2fa9292041a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:08.540468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f0669-c273-4e19-88ed-2fa9292041a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:08.541112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f0669-c273-4e19-88ed-2fa9292041a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:54:08.541412 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f0669-c273-4e19-88ed-2fa9292041a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:08.542532 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: WARNING py.warnings [None req-358f0669-c273-4e19-88ed-2fa9292041a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 13:54:08.542532 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: warnings.warn(msg) Sep 01 13:54:08.542532 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: Sep 01 13:54:08.543439 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f0669-c273-4e19-88ed-2fa9292041a3 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:08.545723 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-f7300384-db10-421f-bfe2-ba48ae3ce525 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:08.546962 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-f7300384-db10-421f-bfe2-ba48ae3ce525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:08.556614 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 786/1559] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:08.560135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 774/1560] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:54:08.560135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f0669-c273-4e19-88ed-2fa9292041a3 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:08.563184 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13553305-6bc0-427d-8d4c-9c04da6fd818 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:08.563554 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13553305-6bc0-427d-8d4c-9c04da6fd818 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:08.563839 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13553305-6bc0-427d-8d4c-9c04da6fd818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:08.571767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f0669-c273-4e19-88ed-2fa9292041a3 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:08.576504 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c34ba4-9e95-4c3a-b60e-31e8d8472165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:08.577138 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c34ba4-9e95-4c3a-b60e-31e8d8472165 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:08.577418 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c34ba4-9e95-4c3a-b60e-31e8d8472165 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:08.577774 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c34ba4-9e95-4c3a-b60e-31e8d8472165 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:08.578332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c34ba4-9e95-4c3a-b60e-31e8d8472165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:08.580396 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c34ba4-9e95-4c3a-b60e-31e8d8472165 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:08.584642 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-13553305-6bc0-427d-8d4c-9c04da6fd818 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:08.586352 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-13553305-6bc0-427d-8d4c-9c04da6fd818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:08.594461 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 787/1561] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:08.595118 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13553305-6bc0-427d-8d4c-9c04da6fd818 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:08.605286 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13553305-6bc0-427d-8d4c-9c04da6fd818 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:08.610019 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e868d-74ea-46bf-aceb-3ba0dd411112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:08.611481 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e868d-74ea-46bf-aceb-3ba0dd411112 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:08.611481 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e868d-74ea-46bf-aceb-3ba0dd411112 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:08.611481 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e868d-74ea-46bf-aceb-3ba0dd411112 admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:08.612350 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e868d-74ea-46bf-aceb-3ba0dd411112 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:54:08.612616 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e868d-74ea-46bf-aceb-3ba0dd411112 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:08.614205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e868d-74ea-46bf-aceb-3ba0dd411112 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:08.626460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 788/1562] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:54:08.627305 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e868d-74ea-46bf-aceb-3ba0dd411112 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:08.639540 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e868d-74ea-46bf-aceb-3ba0dd411112 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:08.645394 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809855e-e257-4f9e-9142-caa21784f63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:08.646029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809855e-e257-4f9e-9142-caa21784f63e admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:08.646333 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809855e-e257-4f9e-9142-caa21784f63e admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:08.646609 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809855e-e257-4f9e-9142-caa21784f63e admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:08.647255 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809855e-e257-4f9e-9142-caa21784f63e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:54:08.647668 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809855e-e257-4f9e-9142-caa21784f63e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:08.649292 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809855e-e257-4f9e-9142-caa21784f63e admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:08.662560 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 789/1563] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:54:08.663420 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809855e-e257-4f9e-9142-caa21784f63e admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:08.671454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 775/1564] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:08 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:08.672781 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c34ba4-9e95-4c3a-b60e-31e8d8472165 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:08.674426 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809855e-e257-4f9e-9142-caa21784f63e admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:08.686939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:08.734623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323370d4-da0c-41bd-b1c0-4dd646745fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:08.735235 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323370d4-da0c-41bd-b1c0-4dd646745fdd admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:08.735547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323370d4-da0c-41bd-b1c0-4dd646745fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:08.735827 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323370d4-da0c-41bd-b1c0-4dd646745fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:08.736469 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323370d4-da0c-41bd-b1c0-4dd646745fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:08.738103 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323370d4-da0c-41bd-b1c0-4dd646745fdd admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:08.743917 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c34ba4-9e95-4c3a-b60e-31e8d8472165 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:08.748063 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 790/1565] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:08.751534 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323370d4-da0c-41bd-b1c0-4dd646745fdd admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:08.751656 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a6842-98e4-4241-8233-1a0a0867aa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:08.751656 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a6842-98e4-4241-8233-1a0a0867aa21 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:08.751656 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a6842-98e4-4241-8233-1a0a0867aa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:08.751656 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a6842-98e4-4241-8233-1a0a0867aa21 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:08.752028 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a6842-98e4-4241-8233-1a0a0867aa21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:08.753341 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a6842-98e4-4241-8233-1a0a0867aa21 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:08.758546 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323370d4-da0c-41bd-b1c0-4dd646745fdd admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:08.763320 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61521fd7-a16f-4cba-95e4-7e016d4ecef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:08.763506 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:08.763761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61521fd7-a16f-4cba-95e4-7e016d4ecef3 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:08.764045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61521fd7-a16f-4cba-95e4-7e016d4ecef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:08.764320 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61521fd7-a16f-4cba-95e4-7e016d4ecef3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:08.764957 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61521fd7-a16f-4cba-95e4-7e016d4ecef3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:54:08.765258 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61521fd7-a16f-4cba-95e4-7e016d4ecef3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:08.766881 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61521fd7-a16f-4cba-95e4-7e016d4ecef3 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:08.781100 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 791/1566] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:54:08.783082 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61521fd7-a16f-4cba-95e4-7e016d4ecef3 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:08.792441 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61521fd7-a16f-4cba-95e4-7e016d4ecef3 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:08.797025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37ffb7-7aaf-4b42-b99d-e608689f365b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:08.797618 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37ffb7-7aaf-4b42-b99d-e608689f365b admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:08.797897 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37ffb7-7aaf-4b42-b99d-e608689f365b admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:08.798170 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37ffb7-7aaf-4b42-b99d-e608689f365b admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:08.798793 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37ffb7-7aaf-4b42-b99d-e608689f365b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:08.799884 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: WARNING py.warnings [None req-8a37ffb7-7aaf-4b42-b99d-e608689f365b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 13:54:08.799884 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: warnings.warn(msg) Sep 01 13:54:08.799884 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: Sep 01 13:54:08.801061 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37ffb7-7aaf-4b42-b99d-e608689f365b admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:08.890811 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 776/1567] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:08 2022] POST /identity/v3/projects => generated 393 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:08.891684 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a6842-98e4-4241-8233-1a0a0867aa21 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:08.930418 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 792/1568] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:08 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:08.932591 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37ffb7-7aaf-4b42-b99d-e608689f365b admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:08.963510 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a6842-98e4-4241-8233-1a0a0867aa21 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:08.998569 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37ffb7-7aaf-4b42-b99d-e608689f365b admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:09.003893 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083c812-c690-4d1f-83c8-039c17910349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:09.004519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083c812-c690-4d1f-83c8-039c17910349 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:09.004794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083c812-c690-4d1f-83c8-039c17910349 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:09.005063 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083c812-c690-4d1f-83c8-039c17910349 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:09.005697 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083c812-c690-4d1f-83c8-039c17910349 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:09.007622 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083c812-c690-4d1f-83c8-039c17910349 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:09.024905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3485d0-05e8-4b3c-b9b9-fc4c96b40d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:09.025566 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3485d0-05e8-4b3c-b9b9-fc4c96b40d0a admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:09.025848 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3485d0-05e8-4b3c-b9b9-fc4c96b40d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:09.026145 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3485d0-05e8-4b3c-b9b9-fc4c96b40d0a admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:09.026830 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3485d0-05e8-4b3c-b9b9-fc4c96b40d0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:54:09.027130 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3485d0-05e8-4b3c-b9b9-fc4c96b40d0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:09.028852 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3485d0-05e8-4b3c-b9b9-fc4c96b40d0a admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:09.041425 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 777/1569] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:54:09.042414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3485d0-05e8-4b3c-b9b9-fc4c96b40d0a admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:09.052300 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3485d0-05e8-4b3c-b9b9-fc4c96b40d0a admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:09.057423 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed512024-5cef-4c89-bc57-2c6b0e27bad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:09.058179 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed512024-5cef-4c89-bc57-2c6b0e27bad9 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:09.058547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed512024-5cef-4c89-bc57-2c6b0e27bad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:09.058868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed512024-5cef-4c89-bc57-2c6b0e27bad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:09.059587 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed512024-5cef-4c89-bc57-2c6b0e27bad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:09.061643 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed512024-5cef-4c89-bc57-2c6b0e27bad9 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:09.116991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 793/1570] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:08 2022] POST /identity/v3/projects => generated 373 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:09.118097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083c812-c690-4d1f-83c8-039c17910349 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:09.179434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083c812-c690-4d1f-83c8-039c17910349 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:09.179865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 778/1571] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:09 2022] POST /identity/v3/projects => generated 403 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:09.180722 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed512024-5cef-4c89-bc57-2c6b0e27bad9 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:09.187664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:09.249158 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed512024-5cef-4c89-bc57-2c6b0e27bad9 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:09.252258 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c4c1f-08cf-4745-ad77-3d31d8809b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:09.253649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c4c1f-08cf-4745-ad77-3d31d8809b40 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:09.254029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c4c1f-08cf-4745-ad77-3d31d8809b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:09.254421 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c4c1f-08cf-4745-ad77-3d31d8809b40 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:09.254736 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ca1f4-667d-4892-8f1d-4b597ee71719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:09.255333 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c4c1f-08cf-4745-ad77-3d31d8809b40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:09.255580 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ca1f4-667d-4892-8f1d-4b597ee71719 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:09.255734 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ca1f4-667d-4892-8f1d-4b597ee71719 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:09.256479 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ca1f4-667d-4892-8f1d-4b597ee71719 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:09.256653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ca1f4-667d-4892-8f1d-4b597ee71719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:09.257871 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c4c1f-08cf-4745-ad77-3d31d8809b40 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:09.258280 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ca1f4-667d-4892-8f1d-4b597ee71719 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:09.270731 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 779/1572] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:09.271449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ca1f4-667d-4892-8f1d-4b597ee71719 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:09.278168 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:09.282735 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ca1f4-667d-4892-8f1d-4b597ee71719 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:09.288287 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3609ddb-a6de-4dba-af07-7923abcaa4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:09.294224 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3609ddb-a6de-4dba-af07-7923abcaa4cb admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:09.294224 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3609ddb-a6de-4dba-af07-7923abcaa4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:09.294224 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3609ddb-a6de-4dba-af07-7923abcaa4cb admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:09.294224 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3609ddb-a6de-4dba-af07-7923abcaa4cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:09.294224 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3609ddb-a6de-4dba-af07-7923abcaa4cb admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:09.363889 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 794/1573] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:09 2022] POST /identity/v3/users => generated 283 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:09.364715 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c4c1f-08cf-4745-ad77-3d31d8809b40 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:09.373991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c4c1f-08cf-4745-ad77-3d31d8809b40 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:09.379191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34a956-a6c4-424a-a778-e8e8a3a6a1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:09.379793 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34a956-a6c4-424a-a778-e8e8a3a6a1be admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:09.380071 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34a956-a6c4-424a-a778-e8e8a3a6a1be admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:09.380338 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34a956-a6c4-424a-a778-e8e8a3a6a1be admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:09.380951 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34a956-a6c4-424a-a778-e8e8a3a6a1be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:09.382837 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34a956-a6c4-424a-a778-e8e8a3a6a1be admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:09.398504 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 780/1574] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:09 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:09.402214 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3609ddb-a6de-4dba-af07-7923abcaa4cb admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:09.466926 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3609ddb-a6de-4dba-af07-7923abcaa4cb admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:09.471670 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6f989-835d-4215-bb53-2f7d47ddeb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:09.472285 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6f989-835d-4215-bb53-2f7d47ddeb6c admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:09.472569 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6f989-835d-4215-bb53-2f7d47ddeb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:09.472846 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6f989-835d-4215-bb53-2f7d47ddeb6c admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:09.473512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6f989-835d-4215-bb53-2f7d47ddeb6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:09.475484 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6f989-835d-4215-bb53-2f7d47ddeb6c admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:09.483566 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 795/1575] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:09 2022] POST /identity/v3/users => generated 297 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:09.484525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34a956-a6c4-424a-a778-e8e8a3a6a1be admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:09.495758 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34a956-a6c4-424a-a778-e8e8a3a6a1be admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:09.500422 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c4621-d5eb-4515-935f-f6b55ba7a995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:09.501027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c4621-d5eb-4515-935f-f6b55ba7a995 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:09.501305 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c4621-d5eb-4515-935f-f6b55ba7a995 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:09.501581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c4621-d5eb-4515-935f-f6b55ba7a995 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:09.502212 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c4621-d5eb-4515-935f-f6b55ba7a995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:09.504744 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c4621-d5eb-4515-935f-f6b55ba7a995 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:09.546547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 781/1576] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:09 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:09.547560 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6f989-835d-4215-bb53-2f7d47ddeb6c admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:09.557797 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6f989-835d-4215-bb53-2f7d47ddeb6c admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:09.562399 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986f73c-f996-46ef-9d20-c89ff3adc24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:09.563026 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986f73c-f996-46ef-9d20-c89ff3adc24c admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:09.563561 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986f73c-f996-46ef-9d20-c89ff3adc24c admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:09.563803 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986f73c-f996-46ef-9d20-c89ff3adc24c admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:09.564245 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986f73c-f996-46ef-9d20-c89ff3adc24c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:09.566805 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986f73c-f996-46ef-9d20-c89ff3adc24c admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:09.620233 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 796/1577] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:09 2022] POST /identity/v3/projects => generated 357 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:09.621048 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c4621-d5eb-4515-935f-f6b55ba7a995 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:09.666784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 782/1578] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:09 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:09.668085 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986f73c-f996-46ef-9d20-c89ff3adc24c admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:09.679839 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986f73c-f996-46ef-9d20-c89ff3adc24c admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:09.689547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c4621-d5eb-4515-935f-f6b55ba7a995 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:09.694454 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44ea9f-821e-447b-af7d-25643ec332a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:09.695059 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44ea9f-821e-447b-af7d-25643ec332a3 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:09.695335 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44ea9f-821e-447b-af7d-25643ec332a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:09.695642 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44ea9f-821e-447b-af7d-25643ec332a3 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:09.696270 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44ea9f-821e-447b-af7d-25643ec332a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:09.698183 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44ea9f-821e-447b-af7d-25643ec332a3 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:09.737553 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22899b88-717b-4e20-b015-a31658379e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:09.738142 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22899b88-717b-4e20-b015-a31658379e56 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:09.738416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22899b88-717b-4e20-b015-a31658379e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:09.738683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22899b88-717b-4e20-b015-a31658379e56 admin admin] PATH_INFO: `/v3/projects/b0d00b24399a40d2b070bfd90e73f407/users/e35ebc3dbc1f4f348f97041627fc68b9/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:09.753727 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22899b88-717b-4e20-b015-a31658379e56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d00b24399a40d2b070bfd90e73f407, user_id=e35ebc3dbc1f4f348f97041627fc68b9, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:09.756811 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22899b88-717b-4e20-b015-a31658379e56 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:09.798034 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 797/1579] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:09 2022] POST /identity/v3/users => generated 302 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:09.798862 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44ea9f-821e-447b-af7d-25643ec332a3 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:09.808892 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44ea9f-821e-447b-af7d-25643ec332a3 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:09.813528 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422070b5-64bb-44dc-bf9a-e8d842059b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:09.814132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422070b5-64bb-44dc-bf9a-e8d842059b4a admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:09.814413 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422070b5-64bb-44dc-bf9a-e8d842059b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:09.814687 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422070b5-64bb-44dc-bf9a-e8d842059b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:09.815326 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422070b5-64bb-44dc-bf9a-e8d842059b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:09.816963 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422070b5-64bb-44dc-bf9a-e8d842059b4a admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:09.827304 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 798/1580] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:09.831194 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422070b5-64bb-44dc-bf9a-e8d842059b4a admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:09.838045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422070b5-64bb-44dc-bf9a-e8d842059b4a admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:09.843141 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765005ef-e0e1-47d9-b59c-edd83a3466b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:09.843799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765005ef-e0e1-47d9-b59c-edd83a3466b8 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:09.844078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765005ef-e0e1-47d9-b59c-edd83a3466b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:09.844353 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765005ef-e0e1-47d9-b59c-edd83a3466b8 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:09.845018 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765005ef-e0e1-47d9-b59c-edd83a3466b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:09.847502 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765005ef-e0e1-47d9-b59c-edd83a3466b8 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:09.854938 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 783/1581] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:09 2022] PUT /identity/v3/projects/b0d00b24399a40d2b070bfd90e73f407/users/e35ebc3dbc1f4f348f97041627fc68b9/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:09.860210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22899b88-717b-4e20-b015-a31658379e56 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:09.899270 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:09.920992 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22899b88-717b-4e20-b015-a31658379e56 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:09.926609 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e36fd0-0266-4da2-8955-e4890d2614c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:09.927232 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e36fd0-0266-4da2-8955-e4890d2614c6 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:09.927544 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e36fd0-0266-4da2-8955-e4890d2614c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:09.927820 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e36fd0-0266-4da2-8955-e4890d2614c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:09.928476 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e36fd0-0266-4da2-8955-e4890d2614c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:09.930082 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e36fd0-0266-4da2-8955-e4890d2614c6 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:09.940823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 784/1582] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:09.941689 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e36fd0-0266-4da2-8955-e4890d2614c6 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:09.948465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 799/1583] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:09 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:09.950392 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765005ef-e0e1-47d9-b59c-edd83a3466b8 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:09.952299 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e36fd0-0266-4da2-8955-e4890d2614c6 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:09.957135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e411c-6d53-4ceb-bb5b-18a1e9fb6559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:09.957750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e411c-6d53-4ceb-bb5b-18a1e9fb6559 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:09.958021 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e411c-6d53-4ceb-bb5b-18a1e9fb6559 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:09.958293 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e411c-6d53-4ceb-bb5b-18a1e9fb6559 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:09.958936 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e411c-6d53-4ceb-bb5b-18a1e9fb6559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:09.959811 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765005ef-e0e1-47d9-b59c-edd83a3466b8 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:09.960592 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e411c-6d53-4ceb-bb5b-18a1e9fb6559 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:09.964673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdf04e-3ebf-4a9e-aa49-70d09bff3ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:09.965343 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdf04e-3ebf-4a9e-aa49-70d09bff3ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:09.965631 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdf04e-3ebf-4a9e-aa49-70d09bff3ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:09.965910 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdf04e-3ebf-4a9e-aa49-70d09bff3ff9 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:09.966542 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdf04e-3ebf-4a9e-aa49-70d09bff3ff9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:09.968744 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdf04e-3ebf-4a9e-aa49-70d09bff3ff9 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:09.972046 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 785/1584] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:09.972928 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e411c-6d53-4ceb-bb5b-18a1e9fb6559 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:09.985449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e411c-6d53-4ceb-bb5b-18a1e9fb6559 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:09.990933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3e9fe-e311-4bb8-b4c4-b816b29d8975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:09.991510 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3e9fe-e311-4bb8-b4c4-b816b29d8975 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:09.991958 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3e9fe-e311-4bb8-b4c4-b816b29d8975 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:09.992072 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3e9fe-e311-4bb8-b4c4-b816b29d8975 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:09.992704 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3e9fe-e311-4bb8-b4c4-b816b29d8975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:09.994328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3e9fe-e311-4bb8-b4c4-b816b29d8975 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:10.005179 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 786/1585] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:10.006013 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3e9fe-e311-4bb8-b4c4-b816b29d8975 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:10.016061 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3e9fe-e311-4bb8-b4c4-b816b29d8975 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:10.021527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc453e-32cd-4b4b-a928-b29fcc5db3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:10.022131 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc453e-32cd-4b4b-a928-b29fcc5db3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:10.022433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc453e-32cd-4b4b-a928-b29fcc5db3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:10.022698 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc453e-32cd-4b4b-a928-b29fcc5db3d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:10.023337 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc453e-32cd-4b4b-a928-b29fcc5db3d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:10.025031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc453e-32cd-4b4b-a928-b29fcc5db3d2 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:10.035737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 787/1586] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:10.036580 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc453e-32cd-4b4b-a928-b29fcc5db3d2 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:10.046370 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc453e-32cd-4b4b-a928-b29fcc5db3d2 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:10.051130 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c847a-fc48-407e-a2f3-6293fb9927fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:10.051738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c847a-fc48-407e-a2f3-6293fb9927fd admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:10.052035 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c847a-fc48-407e-a2f3-6293fb9927fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:10.052320 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c847a-fc48-407e-a2f3-6293fb9927fd admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:10.053013 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c847a-fc48-407e-a2f3-6293fb9927fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:10.054604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c847a-fc48-407e-a2f3-6293fb9927fd admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:10.063881 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 800/1587] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:09 2022] POST /identity/v3/users => generated 279 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:10.063881 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95f207-5ee8-4b3c-9382-510f95fb04b7 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:10.063881 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95f207-5ee8-4b3c-9382-510f95fb04b7 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:10.063881 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95f207-5ee8-4b3c-9382-510f95fb04b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:10.065962 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 788/1588] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:10.065962 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c847a-fc48-407e-a2f3-6293fb9927fd admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:10.070786 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=84,keystone:INSERT=16 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:10.078186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c847a-fc48-407e-a2f3-6293fb9927fd admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:10.083782 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f614c9-3390-4be7-8535-c0810f2dff83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:10.083983 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-7a95f207-5ee8-4b3c-9382-510f95fb04b7 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:10.084397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f614c9-3390-4be7-8535-c0810f2dff83 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:10.084678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f614c9-3390-4be7-8535-c0810f2dff83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:10.084950 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f614c9-3390-4be7-8535-c0810f2dff83 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:10.085125 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-7a95f207-5ee8-4b3c-9382-510f95fb04b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:10.085601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f614c9-3390-4be7-8535-c0810f2dff83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:10.087198 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f614c9-3390-4be7-8535-c0810f2dff83 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:10.093305 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 801/1589] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:10.094153 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95f207-5ee8-4b3c-9382-510f95fb04b7 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:10.099511 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 789/1590] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:10.100404 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f614c9-3390-4be7-8535-c0810f2dff83 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:10.107687 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95f207-5ee8-4b3c-9382-510f95fb04b7 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:10.111337 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f614c9-3390-4be7-8535-c0810f2dff83 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:10.113079 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843559bd-da52-4a2b-a0e7-3801b87d57a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:10.113694 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843559bd-da52-4a2b-a0e7-3801b87d57a8 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:10.113988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843559bd-da52-4a2b-a0e7-3801b87d57a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:10.114256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843559bd-da52-4a2b-a0e7-3801b87d57a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:10.114909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843559bd-da52-4a2b-a0e7-3801b87d57a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:10.116412 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e00d5a-08a0-44ee-a790-fdcefafe5fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:10.117108 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843559bd-da52-4a2b-a0e7-3801b87d57a8 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:10.117242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e00d5a-08a0-44ee-a790-fdcefafe5fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:10.117349 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e00d5a-08a0-44ee-a790-fdcefafe5fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:10.117629 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e00d5a-08a0-44ee-a790-fdcefafe5fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:10.118263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e00d5a-08a0-44ee-a790-fdcefafe5fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:10.119874 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e00d5a-08a0-44ee-a790-fdcefafe5fc5 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:10.130206 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 802/1591] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:10.130206 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843559bd-da52-4a2b-a0e7-3801b87d57a8 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:10.131121 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 790/1592] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:10.132033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e00d5a-08a0-44ee-a790-fdcefafe5fc5 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:10.140458 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843559bd-da52-4a2b-a0e7-3801b87d57a8 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:10.142231 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e00d5a-08a0-44ee-a790-fdcefafe5fc5 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:10.145851 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71bd1b-de10-4e4a-8ba8-c2539ec87502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:10.146457 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71bd1b-de10-4e4a-8ba8-c2539ec87502 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:10.146740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71bd1b-de10-4e4a-8ba8-c2539ec87502 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:10.147016 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71bd1b-de10-4e4a-8ba8-c2539ec87502 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:10.147514 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c2037-74c8-467c-ab5b-c110a0d9faee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:10.147765 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71bd1b-de10-4e4a-8ba8-c2539ec87502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:10.148120 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c2037-74c8-467c-ab5b-c110a0d9faee admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:10.148402 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c2037-74c8-467c-ab5b-c110a0d9faee admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:10.148679 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c2037-74c8-467c-ab5b-c110a0d9faee admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:10.149329 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c2037-74c8-467c-ab5b-c110a0d9faee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:10.149471 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71bd1b-de10-4e4a-8ba8-c2539ec87502 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:10.150937 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c2037-74c8-467c-ab5b-c110a0d9faee admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:10.161291 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 803/1593] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:10.162239 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71bd1b-de10-4e4a-8ba8-c2539ec87502 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:10.163996 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 791/1594] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:10.164638 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c2037-74c8-467c-ab5b-c110a0d9faee admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:10.173753 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71bd1b-de10-4e4a-8ba8-c2539ec87502 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:10.174691 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c2037-74c8-467c-ab5b-c110a0d9faee admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:10.178553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4c5b6-aaec-401d-9bbf-1343808a0a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:10.179158 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4c5b6-aaec-401d-9bbf-1343808a0a45 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:10.179480 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4c5b6-aaec-401d-9bbf-1343808a0a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:10.179649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39b8d2-b7d4-42ae-b5f6-b0d4b0b58384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:10.179783 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4c5b6-aaec-401d-9bbf-1343808a0a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:10.180318 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39b8d2-b7d4-42ae-b5f6-b0d4b0b58384 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:10.180439 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4c5b6-aaec-401d-9bbf-1343808a0a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:10.180624 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39b8d2-b7d4-42ae-b5f6-b0d4b0b58384 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:10.180921 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39b8d2-b7d4-42ae-b5f6-b0d4b0b58384 admin admin] PATH_INFO: `/v3/projects/7ac47c12ecb4482e85a7bdcee254be45/users/c869941d25094d049c60c6c80a392930/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:10.181972 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4c5b6-aaec-401d-9bbf-1343808a0a45 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:10.195445 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 804/1595] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:10.196484 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4c5b6-aaec-401d-9bbf-1343808a0a45 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:10.199816 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39b8d2-b7d4-42ae-b5f6-b0d4b0b58384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ac47c12ecb4482e85a7bdcee254be45, user_id=c869941d25094d049c60c6c80a392930, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:10.202525 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39b8d2-b7d4-42ae-b5f6-b0d4b0b58384 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:10.209767 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4c5b6-aaec-401d-9bbf-1343808a0a45 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:10.215430 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37dec0-119b-4bed-b16c-76c244646adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:10.216099 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37dec0-119b-4bed-b16c-76c244646adf admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:10.216382 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37dec0-119b-4bed-b16c-76c244646adf admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:10.216653 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37dec0-119b-4bed-b16c-76c244646adf admin admin] PATH_INFO: `/v3/projects/2c45ef65901048fe8966f332a04fb6c9/users/5a441adf6eee4ba78992aafbbf02f1c8/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:10.233559 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37dec0-119b-4bed-b16c-76c244646adf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c45ef65901048fe8966f332a04fb6c9, user_id=5a441adf6eee4ba78992aafbbf02f1c8, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:10.234635 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: WARNING py.warnings [None req-0e37dec0-119b-4bed-b16c-76c244646adf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 13:54:10.234635 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: warnings.warn(msg) Sep 01 13:54:10.234635 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: Sep 01 13:54:10.236666 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37dec0-119b-4bed-b16c-76c244646adf admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:10.273293 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 792/1596] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:10 2022] PUT /identity/v3/projects/7ac47c12ecb4482e85a7bdcee254be45/users/c869941d25094d049c60c6c80a392930/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:10.274145 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39b8d2-b7d4-42ae-b5f6-b0d4b0b58384 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:10.277549 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-8f39b8d2-b7d4-42ae-b5f6-b0d4b0b58384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:10.335429 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39b8d2-b7d4-42ae-b5f6-b0d4b0b58384 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:10.339111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e0882-3ac1-4c5b-80cf-304a238ffc36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:10.339760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e0882-3ac1-4c5b-80cf-304a238ffc36 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:10.340050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e0882-3ac1-4c5b-80cf-304a238ffc36 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:10.340324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e0882-3ac1-4c5b-80cf-304a238ffc36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:10.347507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 805/1597] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:10 2022] PUT /identity/v3/projects/2c45ef65901048fe8966f332a04fb6c9/users/5a441adf6eee4ba78992aafbbf02f1c8/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:10.348421 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37dec0-119b-4bed-b16c-76c244646adf admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:10.394754 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:10.412285 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e0882-3ac1-4c5b-80cf-304a238ffc36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:10.413771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e0882-3ac1-4c5b-80cf-304a238ffc36 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:10.415570 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37dec0-119b-4bed-b16c-76c244646adf admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:10.420425 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df19a9-4544-41c5-9bf5-65a8b41d2b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:10.421029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df19a9-4544-41c5-9bf5-65a8b41d2b22 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:10.421307 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df19a9-4544-41c5-9bf5-65a8b41d2b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:10.421579 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df19a9-4544-41c5-9bf5-65a8b41d2b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:10.422218 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df19a9-4544-41c5-9bf5-65a8b41d2b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:10.424055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 793/1598] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:10.424179 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df19a9-4544-41c5-9bf5-65a8b41d2b22 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:10.424608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e0882-3ac1-4c5b-80cf-304a238ffc36 service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:10.433695 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e0882-3ac1-4c5b-80cf-304a238ffc36 service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:10.439616 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3ad76-e334-4c5c-990a-075af63134fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:10.440764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3ad76-e334-4c5c-990a-075af63134fa admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:10.441042 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3ad76-e334-4c5c-990a-075af63134fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:10.441306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3ad76-e334-4c5c-990a-075af63134fa admin admin] PATH_INFO: `/v3/projects/32099e5371e84253afb8de38c9c06a82/users/90c2ce45096e4fb493314ad3af039724/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:10.442187 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 806/1599] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:10.442187 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df19a9-4544-41c5-9bf5-65a8b41d2b22 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:10.454669 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df19a9-4544-41c5-9bf5-65a8b41d2b22 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:10.458542 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3ad76-e334-4c5c-990a-075af63134fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=32099e5371e84253afb8de38c9c06a82, user_id=90c2ce45096e4fb493314ad3af039724, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:10.460302 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de7025-e732-4cf7-930d-f419d80a8be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:10.460967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de7025-e732-4cf7-930d-f419d80a8be8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:10.461246 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de7025-e732-4cf7-930d-f419d80a8be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:10.461344 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3ad76-e334-4c5c-990a-075af63134fa admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:10.461531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de7025-e732-4cf7-930d-f419d80a8be8 admin admin] PATH_INFO: `/v3/projects/59789c5c55db4b6395ef40c4738eec45/users/add0f94ff060423393c124ea26ee1a8c/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:10.478401 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de7025-e732-4cf7-930d-f419d80a8be8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59789c5c55db4b6395ef40c4738eec45, user_id=add0f94ff060423393c124ea26ee1a8c, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:10.481188 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de7025-e732-4cf7-930d-f419d80a8be8 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:10.553431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 807/1600] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:10 2022] PUT /identity/v3/projects/59789c5c55db4b6395ef40c4738eec45/users/add0f94ff060423393c124ea26ee1a8c/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:10.554547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de7025-e732-4cf7-930d-f419d80a8be8 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:10.554688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 794/1601] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:10 2022] PUT /identity/v3/projects/32099e5371e84253afb8de38c9c06a82/users/90c2ce45096e4fb493314ad3af039724/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:10.555715 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3ad76-e334-4c5c-990a-075af63134fa admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:10.635246 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3ad76-e334-4c5c-990a-075af63134fa admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:10.641744 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de7025-e732-4cf7-930d-f419d80a8be8 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:10.642563 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409e330-e1a3-46af-8571-f89ff131e633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:10.643784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409e330-e1a3-46af-8571-f89ff131e633 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:10.644065 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409e330-e1a3-46af-8571-f89ff131e633 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:10.644364 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409e330-e1a3-46af-8571-f89ff131e633 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:10.645061 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409e330-e1a3-46af-8571-f89ff131e633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:10.646743 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409e330-e1a3-46af-8571-f89ff131e633 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:10.647154 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f01b1e-e343-4be1-b723-47decc3d96cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:10.647918 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f01b1e-e343-4be1-b723-47decc3d96cc admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:10.648333 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f01b1e-e343-4be1-b723-47decc3d96cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:10.648668 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f01b1e-e343-4be1-b723-47decc3d96cc admin admin] PATH_INFO: `/v3/projects/e983271524f54a2aada61ba1aa471e5d/users/f42c70ed48c34bfd92762ccd71ee64d2/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:10.658708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 795/1602] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:10.661170 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbe292-f657-45df-b05a-46746c8437e3 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:10.661533 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbe292-f657-45df-b05a-46746c8437e3 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:10.662149 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbe292-f657-45df-b05a-46746c8437e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:10.669771 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f01b1e-e343-4be1-b723-47decc3d96cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e983271524f54a2aada61ba1aa471e5d, user_id=f42c70ed48c34bfd92762ccd71ee64d2, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:10.672624 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f01b1e-e343-4be1-b723-47decc3d96cc admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:10.675310 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:10.694287 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-82cbe292-f657-45df-b05a-46746c8437e3 None None] MFA Rules not processed for user `c869941d25094d049c60c6c80a392930`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:10.695548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-82cbe292-f657-45df-b05a-46746c8437e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:10.766580 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 796/1603] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:10.768609 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e3585-ca49-4052-a6c6-7526cba81d15 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:10.768835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e3585-ca49-4052-a6c6-7526cba81d15 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:10.769112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e3585-ca49-4052-a6c6-7526cba81d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:10.790034 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-6c6e3585-ca49-4052-a6c6-7526cba81d15 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:10.791352 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-6c6e3585-ca49-4052-a6c6-7526cba81d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:10.799963 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 797/1604] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:10.800525 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e3585-ca49-4052-a6c6-7526cba81d15 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:10.810904 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e3585-ca49-4052-a6c6-7526cba81d15 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:10.822978 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 808/1605] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:10 2022] PUT /identity/v3/projects/e983271524f54a2aada61ba1aa471e5d/users/f42c70ed48c34bfd92762ccd71ee64d2/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:10.822978 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65355edb-8e3e-4843-881e-cbefd0799281 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:10.822978 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65355edb-8e3e-4843-881e-cbefd0799281 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:10.822978 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65355edb-8e3e-4843-881e-cbefd0799281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:10.865765 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-65355edb-8e3e-4843-881e-cbefd0799281 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:10.867039 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-65355edb-8e3e-4843-881e-cbefd0799281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:10.868945 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:10.901300 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8a6cb-5caf-4998-9512-65edac42479b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:10.902028 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8a6cb-5caf-4998-9512-65edac42479b admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:10.902310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8a6cb-5caf-4998-9512-65edac42479b admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:10.902590 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8a6cb-5caf-4998-9512-65edac42479b admin admin] PATH_INFO: `/v3/projects/8301923dd09442f7a43bf28f66ce7fcf/users/a199c1f27219455eb24fb1ff2a373aec/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:10.925577 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a8a6cb-5caf-4998-9512-65edac42479b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8301923dd09442f7a43bf28f66ce7fcf, user_id=a199c1f27219455eb24fb1ff2a373aec, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:10.928404 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a8a6cb-5caf-4998-9512-65edac42479b admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:10.938523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 809/1606] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:10.940480 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26248c-7db5-4b89-80a8-d97ffb89039c None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:10.940772 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26248c-7db5-4b89-80a8-d97ffb89039c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:10.945609 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26248c-7db5-4b89-80a8-d97ffb89039c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:10.969226 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-ec26248c-7db5-4b89-80a8-d97ffb89039c None None] MFA Rules not processed for user `add0f94ff060423393c124ea26ee1a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:10.970469 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ec26248c-7db5-4b89-80a8-d97ffb89039c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:11.010340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 798/1607] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:10 2022] PUT /identity/v3/projects/8301923dd09442f7a43bf28f66ce7fcf/users/a199c1f27219455eb24fb1ff2a373aec/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:11.011095 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8a6cb-5caf-4998-9512-65edac42479b admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:11.053137 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 810/1608] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:11.057618 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26248c-7db5-4b89-80a8-d97ffb89039c None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:11.088392 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8a6cb-5caf-4998-9512-65edac42479b admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:11.106269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43d5ad-9c83-472b-bb2a-3b0efdb1eb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:11.107413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43d5ad-9c83-472b-bb2a-3b0efdb1eb01 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:11.107774 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43d5ad-9c83-472b-bb2a-3b0efdb1eb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:11.108116 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43d5ad-9c83-472b-bb2a-3b0efdb1eb01 admin admin] PATH_INFO: `/v3/projects/8acd0cfd4c7e4f06b101b1bc34d9fcea/users/d36f5a4715f14523a5f66c27a851d50b/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:11.123820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26248c-7db5-4b89-80a8-d97ffb89039c None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:11.128259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43d5ad-9c83-472b-bb2a-3b0efdb1eb01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8acd0cfd4c7e4f06b101b1bc34d9fcea, user_id=d36f5a4715f14523a5f66c27a851d50b, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:11.131234 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43d5ad-9c83-472b-bb2a-3b0efdb1eb01 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:11.172545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:11.186064 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97ea60-fd1d-41be-85ef-242f97ab2510 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:11.186686 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97ea60-fd1d-41be-85ef-242f97ab2510 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:11.186966 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97ea60-fd1d-41be-85ef-242f97ab2510 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:11.187236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97ea60-fd1d-41be-85ef-242f97ab2510 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:11.224525 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 799/1609] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:11 2022] PUT /identity/v3/projects/8acd0cfd4c7e4f06b101b1bc34d9fcea/users/d36f5a4715f14523a5f66c27a851d50b/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:11.243398 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43d5ad-9c83-472b-bb2a-3b0efdb1eb01 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:11.256726 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d97ea60-fd1d-41be-85ef-242f97ab2510 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:11.258528 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d97ea60-fd1d-41be-85ef-242f97ab2510 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:11.268784 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 811/1610] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:11.270088 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582d320-0708-4029-9090-e88be20d642f None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:11.270372 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582d320-0708-4029-9090-e88be20d642f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:11.271089 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582d320-0708-4029-9090-e88be20d642f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:11.308131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-6582d320-0708-4029-9090-e88be20d642f None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:11.310185 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43d5ad-9c83-472b-bb2a-3b0efdb1eb01 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:11.313529 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-6582d320-0708-4029-9090-e88be20d642f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:11.316132 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68dd61-021d-4a6f-8f27-323a8588e7e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:11.317275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68dd61-021d-4a6f-8f27-323a8588e7e1 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:11.322510 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68dd61-021d-4a6f-8f27-323a8588e7e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:11.322510 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68dd61-021d-4a6f-8f27-323a8588e7e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:11.394806 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 812/1611] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:11.398905 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582d320-0708-4029-9090-e88be20d642f None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:11.404656 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:11.407301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68dd61-021d-4a6f-8f27-323a8588e7e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:11.409264 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582d320-0708-4029-9090-e88be20d642f None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:11.409412 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68dd61-021d-4a6f-8f27-323a8588e7e1 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:11.413867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec090069-c250-4dbd-b392-57436e8ae73f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:11.414787 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec090069-c250-4dbd-b392-57436e8ae73f service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:11.415169 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec090069-c250-4dbd-b392-57436e8ae73f service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:11.415612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec090069-c250-4dbd-b392-57436e8ae73f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:11.422505 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 800/1612] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:11.424173 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1851b23-de44-4449-99e3-e066442045ee None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:11.424966 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1851b23-de44-4449-99e3-e066442045ee None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:11.425686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1851b23-de44-4449-99e3-e066442045ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:11.428526 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec090069-c250-4dbd-b392-57436e8ae73f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:11.435188 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec090069-c250-4dbd-b392-57436e8ae73f service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:11.444210 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 813/1613] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:11.446638 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6529b-ba73-4d5d-8f10-44bdae64bab9 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:11.447085 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6529b-ba73-4d5d-8f10-44bdae64bab9 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:11.447453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6529b-ba73-4d5d-8f10-44bdae64bab9 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:11.449360 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 814/1614] 10.222.0.50 () {54 vars in 962 bytes} [Thu Sep 1 13:54:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:54:11.451005 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6831e28-034e-4ea9-8bd1-393ac306f889 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:11.451549 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6831e28-034e-4ea9-8bd1-393ac306f889 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:11.451927 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6831e28-034e-4ea9-8bd1-393ac306f889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:11.461805 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-f1851b23-de44-4449-99e3-e066442045ee None None] MFA Rules not processed for user `a199c1f27219455eb24fb1ff2a373aec`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:11.467677 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-f1851b23-de44-4449-99e3-e066442045ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:11.500247 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-c6831e28-034e-4ea9-8bd1-393ac306f889 None None] MFA Rules not processed for user `d36f5a4715f14523a5f66c27a851d50b`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:11.503990 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c6831e28-034e-4ea9-8bd1-393ac306f889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:11.563422 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 801/1615] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:11.564412 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1851b23-de44-4449-99e3-e066442045ee None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:11.597551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1851b23-de44-4449-99e3-e066442045ee None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:11.603625 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05adcf5-dc5c-4dc7-9941-60faf139aeaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:11.604503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05adcf5-dc5c-4dc7-9941-60faf139aeaf service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:11.612859 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05adcf5-dc5c-4dc7-9941-60faf139aeaf service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:11.612859 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05adcf5-dc5c-4dc7-9941-60faf139aeaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:11.613312 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 815/1616] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:11 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:11.613312 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9a902-aa27-4a4b-bb63-32fe908b7845 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:11.613312 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9a902-aa27-4a4b-bb63-32fe908b7845 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:11.613312 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9a902-aa27-4a4b-bb63-32fe908b7845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:11.621754 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05adcf5-dc5c-4dc7-9941-60faf139aeaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:11.623658 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05adcf5-dc5c-4dc7-9941-60faf139aeaf service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:11.635959 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 802/1617] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:11.637311 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5803c-7022-4d14-b429-7a6d36a967db None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:11.637705 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5803c-7022-4d14-b429-7a6d36a967db None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:11.638084 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5803c-7022-4d14-b429-7a6d36a967db None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:11.639686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 803/1618] 10.222.0.50 () {54 vars in 962 bytes} [Thu Sep 1 13:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:54:11.645497 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5803c-7022-4d14-b429-7a6d36a967db None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:11.656480 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-46f9a902-aa27-4a4b-bb63-32fe908b7845 None None] MFA Rules not processed for user `2d231136bcd44d9a97efe6c257f936ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:11.657920 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-46f9a902-aa27-4a4b-bb63-32fe908b7845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:11.659002 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5803c-7022-4d14-b429-7a6d36a967db None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:11.665095 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccdc29-e5d1-4166-9f1a-2760b94292e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:11.665816 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccdc29-e5d1-4166-9f1a-2760b94292e1 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:11.666201 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccdc29-e5d1-4166-9f1a-2760b94292e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:11.666579 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccdc29-e5d1-4166-9f1a-2760b94292e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:11.667321 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ccdc29-e5d1-4166-9f1a-2760b94292e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:11.669397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ccdc29-e5d1-4166-9f1a-2760b94292e1 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:11.687588 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:11.733659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 816/1619] 10.222.0.50 () {58 vars in 1059 bytes} [Thu Sep 1 13:54:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:11.734953 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb06b9-da79-480f-b5cc-d78ab77a26a0 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:11.735237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb06b9-da79-480f-b5cc-d78ab77a26a0 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:11.735599 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb06b9-da79-480f-b5cc-d78ab77a26a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:11.757467 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-e8fb06b9-da79-480f-b5cc-d78ab77a26a0 None None] MFA Rules not processed for user `2d231136bcd44d9a97efe6c257f936ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:11.758668 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-e8fb06b9-da79-480f-b5cc-d78ab77a26a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:11.768162 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 817/1620] 10.222.0.50 () {58 vars in 1059 bytes} [Thu Sep 1 13:54:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:11.769115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb06b9-da79-480f-b5cc-d78ab77a26a0 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:11.780256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb06b9-da79-480f-b5cc-d78ab77a26a0 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:11.785791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28b2b8-1183-4907-ac9a-1364fe29e452 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:11.796734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28b2b8-1183-4907-ac9a-1364fe29e452 service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:11.796734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28b2b8-1183-4907-ac9a-1364fe29e452 service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:11.796734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28b2b8-1183-4907-ac9a-1364fe29e452 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:11.860630 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28b2b8-1183-4907-ac9a-1364fe29e452 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:11.862756 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28b2b8-1183-4907-ac9a-1364fe29e452 service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:11.872385 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 818/1621] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:11.873198 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28b2b8-1183-4907-ac9a-1364fe29e452 service nova] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:11.884006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 804/1622] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:11 2022] POST /identity/v3/projects => generated 357 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:11.885905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccdc29-e5d1-4166-9f1a-2760b94292e1 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:11.886462 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28b2b8-1183-4907-ac9a-1364fe29e452 service nova] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:11.967890 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1a57d-b096-4ad8-998c-69682d02053d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:11.968870 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1a57d-b096-4ad8-998c-69682d02053d service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:11.969308 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1a57d-b096-4ad8-998c-69682d02053d service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:11.969893 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1a57d-b096-4ad8-998c-69682d02053d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:12.011916 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccdc29-e5d1-4166-9f1a-2760b94292e1 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:12.026240 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77dbbe8-210e-48e3-a84c-b9911973e014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:12.027120 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77dbbe8-210e-48e3-a84c-b9911973e014 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:12.027675 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77dbbe8-210e-48e3-a84c-b9911973e014 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:12.028104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77dbbe8-210e-48e3-a84c-b9911973e014 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:12.029289 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77dbbe8-210e-48e3-a84c-b9911973e014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:12.031563 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77dbbe8-210e-48e3-a84c-b9911973e014 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:12.045425 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1a57d-b096-4ad8-998c-69682d02053d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:12.047525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1a57d-b096-4ad8-998c-69682d02053d service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:12.059925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 819/1623] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:12.181561 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1a57d-b096-4ad8-998c-69682d02053d service nova] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:12.181675 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 805/1624] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:11 2022] POST /identity/v3/users => generated 285 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:12.202436 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1a57d-b096-4ad8-998c-69682d02053d service nova] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:12.210721 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35554109-a875-4cd4-9bdb-cdf3e06fbc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:12.211419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35554109-a875-4cd4-9bdb-cdf3e06fbc2e admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:12.211889 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35554109-a875-4cd4-9bdb-cdf3e06fbc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:12.212171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35554109-a875-4cd4-9bdb-cdf3e06fbc2e admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:12.212887 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35554109-a875-4cd4-9bdb-cdf3e06fbc2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:12.214608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35554109-a875-4cd4-9bdb-cdf3e06fbc2e admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:12.230874 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9248ba-09fd-4f53-aef6-5ca6576c0e25 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:12.231328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9248ba-09fd-4f53-aef6-5ca6576c0e25 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:12.232472 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9248ba-09fd-4f53-aef6-5ca6576c0e25 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:12.234439 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 806/1625] 10.222.0.50 () {54 vars in 912 bytes} [Thu Sep 1 13:54:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:54:12.241341 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812031c-8377-4b07-abb8-13634ae221a4 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:12.241793 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812031c-8377-4b07-abb8-13634ae221a4 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:12.242668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812031c-8377-4b07-abb8-13634ae221a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:12.249093 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 820/1626] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:12.254138 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35554109-a875-4cd4-9bdb-cdf3e06fbc2e admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:12.271386 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-c812031c-8377-4b07-abb8-13634ae221a4 None None] MFA Rules not processed for user `2d231136bcd44d9a97efe6c257f936ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:12.271386 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c812031c-8377-4b07-abb8-13634ae221a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:12.276150 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35554109-a875-4cd4-9bdb-cdf3e06fbc2e admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:12.287691 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 807/1627] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 1 13:54:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:12.288117 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509a97e-4804-4ea1-97f6-02ae61b7ca25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:12.288869 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509a97e-4804-4ea1-97f6-02ae61b7ca25 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:12.289166 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509a97e-4804-4ea1-97f6-02ae61b7ca25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:12.289435 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509a97e-4804-4ea1-97f6-02ae61b7ca25 admin admin] PATH_INFO: `/v3/projects/7ad86b7d27b74b8488f988b3081c314b/users/0afda676165c4983b07821574c467a6e/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:12.302137 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812031c-8377-4b07-abb8-13634ae221a4 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:12.311883 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5509a97e-4804-4ea1-97f6-02ae61b7ca25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad86b7d27b74b8488f988b3081c314b, user_id=0afda676165c4983b07821574c467a6e, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:12.316468 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5509a97e-4804-4ea1-97f6-02ae61b7ca25 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:12.350360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:12.384498 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812031c-8377-4b07-abb8-13634ae221a4 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:12.387604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8184a0-0336-45cb-8e50-9b1b8c054266 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:12.388381 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8184a0-0336-45cb-8e50-9b1b8c054266 service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:12.388666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8184a0-0336-45cb-8e50-9b1b8c054266 service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:12.388941 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8184a0-0336-45cb-8e50-9b1b8c054266 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:12.399888 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8184a0-0336-45cb-8e50-9b1b8c054266 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:12.401443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8184a0-0336-45cb-8e50-9b1b8c054266 service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:12.407483 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:12.414364 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 821/1628] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:12 2022] PUT /identity/v3/projects/7ad86b7d27b74b8488f988b3081c314b/users/0afda676165c4983b07821574c467a6e/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:12.416835 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daade6b9-4211-40bd-a31c-83f16e74ae62 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:12.416835 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daade6b9-4211-40bd-a31c-83f16e74ae62 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:12.416835 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daade6b9-4211-40bd-a31c-83f16e74ae62 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:12.417273 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 822/1629] 10.222.0.50 () {54 vars in 912 bytes} [Thu Sep 1 13:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:54:12.418780 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daade6b9-4211-40bd-a31c-83f16e74ae62 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:12.420364 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 808/1630] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 13:54:12.425261 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8f14a-c691-478a-a92a-d404e5b1c52d None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:12.425581 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8f14a-c691-478a-a92a-d404e5b1c52d None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:12.425893 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8f14a-c691-478a-a92a-d404e5b1c52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:12.451614 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-ccb8f14a-c691-478a-a92a-d404e5b1c52d None None] MFA Rules not processed for user `2d231136bcd44d9a97efe6c257f936ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:12.453188 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-ccb8f14a-c691-478a-a92a-d404e5b1c52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:12.524052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daade6b9-4211-40bd-a31c-83f16e74ae62 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:12.535050 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42c58e-4fa3-475d-96de-3409f25e529b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:12.538620 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42c58e-4fa3-475d-96de-3409f25e529b admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:12.538620 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42c58e-4fa3-475d-96de-3409f25e529b admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:12.538620 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42c58e-4fa3-475d-96de-3409f25e529b admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:12.538620 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f42c58e-4fa3-475d-96de-3409f25e529b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:12.572976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f42c58e-4fa3-475d-96de-3409f25e529b admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:12.601390 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 809/1631] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 1 13:54:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:54:12.613874 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 823/1632] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 13:54:12.616947 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8f14a-c691-478a-a92a-d404e5b1c52d None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:12.617293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42c58e-4fa3-475d-96de-3409f25e529b admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:12.636347 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42c58e-4fa3-475d-96de-3409f25e529b admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:12.648940 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fa502-a9ca-4401-95b9-cebb18217838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:12.663576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fa502-a9ca-4401-95b9-cebb18217838 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:12.663576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fa502-a9ca-4401-95b9-cebb18217838 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:12.663576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fa502-a9ca-4401-95b9-cebb18217838 admin admin] PATH_INFO: `/v3/projects/7ad86b7d27b74b8488f988b3081c314b/users/0afda676165c4983b07821574c467a6e/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:12.663576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34fa502-a9ca-4401-95b9-cebb18217838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad86b7d27b74b8488f988b3081c314b, user_id=0afda676165c4983b07821574c467a6e, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:12.663576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34fa502-a9ca-4401-95b9-cebb18217838 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:12.672085 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 824/1633] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:12 2022] PUT /identity/v3/projects/7ad86b7d27b74b8488f988b3081c314b/users/0afda676165c4983b07821574c467a6e/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:54:12.689029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1a12e-5468-4c2b-b08c-69d980fbc5c9 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:12.690664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1a12e-5468-4c2b-b08c-69d980fbc5c9 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:12.692985 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1a12e-5468-4c2b-b08c-69d980fbc5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:12.735345 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8f14a-c691-478a-a92a-d404e5b1c52d None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:12.767584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-8ef1a12e-5468-4c2b-b08c-69d980fbc5c9 None None] MFA Rules not processed for user `0afda676165c4983b07821574c467a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:12.769699 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-8ef1a12e-5468-4c2b-b08c-69d980fbc5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:13.122928 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:13.129608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10edc012-0893-49e3-9f35-4bf235f60b52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:13.129608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edc012-0893-49e3-9f35-4bf235f60b52 service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:13.129608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edc012-0893-49e3-9f35-4bf235f60b52 service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:13.129608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edc012-0893-49e3-9f35-4bf235f60b52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:13.131650 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 825/1634] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:12 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:13.131650 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1a12e-5468-4c2b-b08c-69d980fbc5c9 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:13.133420 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10edc012-0893-49e3-9f35-4bf235f60b52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:13.133420 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10edc012-0893-49e3-9f35-4bf235f60b52 service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:13.133987 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1a12e-5468-4c2b-b08c-69d980fbc5c9 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:13.133987 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91583545-abdf-4759-9211-ba0a975f91ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:13.133987 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91583545-abdf-4759-9211-ba0a975f91ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:13.133987 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91583545-abdf-4759-9211-ba0a975f91ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:13.136514 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91583545-abdf-4759-9211-ba0a975f91ea admin admin] PATH_INFO: `/v3/users/add0f94ff060423393c124ea26ee1a8c` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:13.136854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 810/1635] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:13.137062 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91583545-abdf-4759-9211-ba0a975f91ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=add0f94ff060423393c124ea26ee1a8c)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:13.137142 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10edc012-0893-49e3-9f35-4bf235f60b52 service cinder] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:13.137267 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: WARNING py.warnings [None req-91583545-abdf-4759-9211-ba0a975f91ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 13:54:13.137267 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: warnings.warn(msg) Sep 01 13:54:13.137267 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: Sep 01 13:54:13.137267 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91583545-abdf-4759-9211-ba0a975f91ea admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:13.138107 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10edc012-0893-49e3-9f35-4bf235f60b52 service cinder] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:13.138107 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167c92a-69a8-424f-a85f-09376b803b2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:13.138107 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167c92a-69a8-424f-a85f-09376b803b2b service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:13.138107 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167c92a-69a8-424f-a85f-09376b803b2b service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:13.139630 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167c92a-69a8-424f-a85f-09376b803b2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:13.139630 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167c92a-69a8-424f-a85f-09376b803b2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:13.139630 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167c92a-69a8-424f-a85f-09376b803b2b service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:13.139630 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 811/1636] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:13 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:13.139630 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:13.445267 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-91583545-abdf-4759-9211-ba0a975f91ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'add0f94ff060423393c124ea26ee1a8c'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:13.523545 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167c92a-69a8-424f-a85f-09376b803b2b service cinder] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:13.541664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-91583545-abdf-4759-9211-ba0a975f91ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'add0f94ff060423393c124ea26ee1a8c'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:13.550498 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167c92a-69a8-424f-a85f-09376b803b2b service cinder] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:13.560538 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4358f0-9d92-47b8-b0b4-70b3345a0756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:13.561600 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4358f0-9d92-47b8-b0b4-70b3345a0756 service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:13.562710 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4358f0-9d92-47b8-b0b4-70b3345a0756 service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:13.568552 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4358f0-9d92-47b8-b0b4-70b3345a0756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:13.568881 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-91583545-abdf-4759-9211-ba0a975f91ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'add0f94ff060423393c124ea26ee1a8c'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:13.595615 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-91583545-abdf-4759-9211-ba0a975f91ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'add0f94ff060423393c124ea26ee1a8c'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:13.597296 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-91583545-abdf-4759-9211-ba0a975f91ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'add0f94ff060423393c124ea26ee1a8c'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:13.612866 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 826/1637] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:54:12 2022] DELETE /identity/v3/users/add0f94ff060423393c124ea26ee1a8c => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:13.614889 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180d94f-aa5f-4540-bfef-5cbd5098541d None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:13.615447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180d94f-aa5f-4540-bfef-5cbd5098541d None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:13.616396 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180d94f-aa5f-4540-bfef-5cbd5098541d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:13.647224 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-3180d94f-aa5f-4540-bfef-5cbd5098541d None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:13.649669 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-3180d94f-aa5f-4540-bfef-5cbd5098541d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:13.657308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4358f0-9d92-47b8-b0b4-70b3345a0756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:13.659744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4358f0-9d92-47b8-b0b4-70b3345a0756 service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:13.672622 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 812/1638] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:13 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 13:54:13.781938 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 827/1639] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:13.809466 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4358f0-9d92-47b8-b0b4-70b3345a0756 service cinder] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:13.905896 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4358f0-9d92-47b8-b0b4-70b3345a0756 service cinder] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:13.994358 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02314331-9902-4483-bfb1-e716977b46c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:13.995002 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02314331-9902-4483-bfb1-e716977b46c8 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:13.995462 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02314331-9902-4483-bfb1-e716977b46c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:13.995799 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02314331-9902-4483-bfb1-e716977b46c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:14.018973 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02314331-9902-4483-bfb1-e716977b46c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:14.021416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02314331-9902-4483-bfb1-e716977b46c8 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:14.038532 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 813/1640] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:14.733146 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa586f-e292-4671-9961-54339099472b None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:14.733654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa586f-e292-4671-9961-54339099472b None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:14.733876 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa586f-e292-4671-9961-54339099472b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:14.765522 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:14.780351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-b1fa586f-e292-4671-9961-54339099472b None None] MFA Rules not processed for user `f42c70ed48c34bfd92762ccd71ee64d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:14.781809 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b1fa586f-e292-4671-9961-54339099472b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:14.894368 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 828/1641] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:14 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:14.898974 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02314331-9902-4483-bfb1-e716977b46c8 service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:14.900599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-02314331-9902-4483-bfb1-e716977b46c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:14.916564 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02314331-9902-4483-bfb1-e716977b46c8 service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:14.922610 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758585a1-82e1-4ad0-8214-3c9e3e6a6a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:14.923088 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758585a1-82e1-4ad0-8214-3c9e3e6a6a50 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:14.923951 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758585a1-82e1-4ad0-8214-3c9e3e6a6a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:14.923951 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758585a1-82e1-4ad0-8214-3c9e3e6a6a50 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:14.924839 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758585a1-82e1-4ad0-8214-3c9e3e6a6a50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:14.929428 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758585a1-82e1-4ad0-8214-3c9e3e6a6a50 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:14.935629 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:15.061888 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 814/1642] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:14 2022] POST /identity/v3/projects => generated 405 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:15.066505 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa586f-e292-4671-9961-54339099472b None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:15.079135 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa586f-e292-4671-9961-54339099472b None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:15.166254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734b146-4968-43e7-8259-81aead8d0d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:15.166938 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734b146-4968-43e7-8259-81aead8d0d05 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:15.167217 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734b146-4968-43e7-8259-81aead8d0d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:15.167527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734b146-4968-43e7-8259-81aead8d0d05 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:15.168203 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734b146-4968-43e7-8259-81aead8d0d05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:15.170377 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734b146-4968-43e7-8259-81aead8d0d05 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:15.305898 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 829/1643] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:15 2022] POST /identity/v3/users => generated 309 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:15.306940 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758585a1-82e1-4ad0-8214-3c9e3e6a6a50 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:15.321786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758585a1-82e1-4ad0-8214-3c9e3e6a6a50 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:15.328653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f30cf8-610a-4a75-a942-e72ac930c3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:15.329681 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f30cf8-610a-4a75-a942-e72ac930c3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:15.333579 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f30cf8-610a-4a75-a942-e72ac930c3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:15.333579 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f30cf8-610a-4a75-a942-e72ac930c3f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:15.333579 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f30cf8-610a-4a75-a942-e72ac930c3f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:15.334596 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f30cf8-610a-4a75-a942-e72ac930c3f7 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:15.352735 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734b146-4968-43e7-8259-81aead8d0d05 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:15.360071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 815/1644] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:15.366986 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734b146-4968-43e7-8259-81aead8d0d05 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:15.372458 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9ef00-03e0-41f7-860c-cd8a94046d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:15.373470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9ef00-03e0-41f7-860c-cd8a94046d28 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:15.373941 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9ef00-03e0-41f7-860c-cd8a94046d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:15.374501 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9ef00-03e0-41f7-860c-cd8a94046d28 admin admin] PATH_INFO: `/v3/projects/748ca97ad0c64c47ab21c2e6716de19b/users/dfa1a7d3bbae4837b972c6ed0ebadcc0/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:15.420930 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9ef00-03e0-41f7-860c-cd8a94046d28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=748ca97ad0c64c47ab21c2e6716de19b, user_id=dfa1a7d3bbae4837b972c6ed0ebadcc0, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:15.426153 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9ef00-03e0-41f7-860c-cd8a94046d28 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:15.573282 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 830/1645] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:15 2022] PUT /identity/v3/projects/748ca97ad0c64c47ab21c2e6716de19b/users/dfa1a7d3bbae4837b972c6ed0ebadcc0/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:54:15.578116 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f30cf8-610a-4a75-a942-e72ac930c3f7 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:15.593469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f30cf8-610a-4a75-a942-e72ac930c3f7 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:15.789335 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3463cac-a65d-4934-a9cd-741bd2434e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:15.792214 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3463cac-a65d-4934-a9cd-741bd2434e64 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:15.792214 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3463cac-a65d-4934-a9cd-741bd2434e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:15.792214 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3463cac-a65d-4934-a9cd-741bd2434e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:15.792214 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3463cac-a65d-4934-a9cd-741bd2434e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:15.798883 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3463cac-a65d-4934-a9cd-741bd2434e64 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:15.845263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 816/1646] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:15.849817 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9ef00-03e0-41f7-860c-cd8a94046d28 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:15.865543 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9ef00-03e0-41f7-860c-cd8a94046d28 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:15.880845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6dc84-93e2-4659-a6b5-baa1f173fec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:15.882005 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6dc84-93e2-4659-a6b5-baa1f173fec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:15.882005 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6dc84-93e2-4659-a6b5-baa1f173fec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:15.882273 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6dc84-93e2-4659-a6b5-baa1f173fec6 admin admin] PATH_INFO: `/v3/projects/748ca97ad0c64c47ab21c2e6716de19b/users/dfa1a7d3bbae4837b972c6ed0ebadcc0/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:15.885565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a6dc84-93e2-4659-a6b5-baa1f173fec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=748ca97ad0c64c47ab21c2e6716de19b, user_id=dfa1a7d3bbae4837b972c6ed0ebadcc0, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:15.890450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a6dc84-93e2-4659-a6b5-baa1f173fec6 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:15.918459 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 831/1647] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:15 2022] PUT /identity/v3/projects/748ca97ad0c64c47ab21c2e6716de19b/users/dfa1a7d3bbae4837b972c6ed0ebadcc0/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:16.040363 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3463cac-a65d-4934-a9cd-741bd2434e64 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:16.048575 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-d3463cac-a65d-4934-a9cd-741bd2434e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:16.103137 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3463cac-a65d-4934-a9cd-741bd2434e64 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:16.275958 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6329b63-0200-4f65-b201-35a968e7101d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:16.278610 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6329b63-0200-4f65-b201-35a968e7101d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:16.287301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6329b63-0200-4f65-b201-35a968e7101d admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:16.301441 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6329b63-0200-4f65-b201-35a968e7101d admin admin] PATH_INFO: `/v3/projects/59789c5c55db4b6395ef40c4738eec45` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:16.328799 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6329b63-0200-4f65-b201-35a968e7101d admin admin] RBAC: Authorizing `identity:delete_project(project_id=59789c5c55db4b6395ef40c4738eec45)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:16.335177 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: WARNING py.warnings [None req-d6329b63-0200-4f65-b201-35a968e7101d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 13:54:16.335177 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: warnings.warn(msg) Sep 01 13:54:16.335177 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: Sep 01 13:54:16.340844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6329b63-0200-4f65-b201-35a968e7101d admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:16.622163 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-d6329b63-0200-4f65-b201-35a968e7101d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59789c5c55db4b6395ef40c4738eec45', 'request_id': 'req-d6329b63-0200-4f65-b201-35a968e7101d'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:16.639705 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-d6329b63-0200-4f65-b201-35a968e7101d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59789c5c55db4b6395ef40c4738eec45', 'request_id': 'req-d6329b63-0200-4f65-b201-35a968e7101d'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:16.680230 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-d6329b63-0200-4f65-b201-35a968e7101d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59789c5c55db4b6395ef40c4738eec45', 'request_id': 'req-d6329b63-0200-4f65-b201-35a968e7101d'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:16.761011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:16.765561 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-d6329b63-0200-4f65-b201-35a968e7101d admin admin] The token cache is being invalidate because project 59789c5c55db4b6395ef40c4738eec45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:54:16.766013 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-d6329b63-0200-4f65-b201-35a968e7101d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:16.767938 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-d6329b63-0200-4f65-b201-35a968e7101d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:16.770575 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 817/1648] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:54:16 2022] DELETE /identity/v3/projects/59789c5c55db4b6395ef40c4738eec45 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:16.776374 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0705b-676b-4c27-b083-4cf026818819 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:16.777496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0705b-676b-4c27-b083-4cf026818819 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:16.780429 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0705b-676b-4c27-b083-4cf026818819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:16.864631 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-53a0705b-676b-4c27-b083-4cf026818819 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:16.866789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-53a0705b-676b-4c27-b083-4cf026818819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:17.076338 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:17.125352 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 832/1649] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:17.133138 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65208db-2b7b-4986-882c-1630662c2270 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:17.134170 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65208db-2b7b-4986-882c-1630662c2270 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:17.134647 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65208db-2b7b-4986-882c-1630662c2270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:17.173529 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-e65208db-2b7b-4986-882c-1630662c2270 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:17.175006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-e65208db-2b7b-4986-882c-1630662c2270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:17.215762 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 818/1650] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:17.220322 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0705b-676b-4c27-b083-4cf026818819 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:17.244948 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0705b-676b-4c27-b083-4cf026818819 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:17.259592 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2fdb7-04e5-4142-83fa-12c0c0e17d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:17.260488 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2fdb7-04e5-4142-83fa-12c0c0e17d07 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:17.260948 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2fdb7-04e5-4142-83fa-12c0c0e17d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:17.261416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2fdb7-04e5-4142-83fa-12c0c0e17d07 admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:17.262895 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2fdb7-04e5-4142-83fa-12c0c0e17d07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:54:17.263466 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2fdb7-04e5-4142-83fa-12c0c0e17d07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:17.265509 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2fdb7-04e5-4142-83fa-12c0c0e17d07 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:17.283941 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 833/1651] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:54:17.292213 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65208db-2b7b-4986-882c-1630662c2270 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:17.335118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65208db-2b7b-4986-882c-1630662c2270 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:17.348683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42ff09-7305-4ba0-909a-13f790aa0371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:17.349424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42ff09-7305-4ba0-909a-13f790aa0371 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:17.349712 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42ff09-7305-4ba0-909a-13f790aa0371 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:17.349987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42ff09-7305-4ba0-909a-13f790aa0371 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:17.350641 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42ff09-7305-4ba0-909a-13f790aa0371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:17.365380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42ff09-7305-4ba0-909a-13f790aa0371 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:17.511703 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 819/1652] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:17 2022] POST /identity/v3/projects => generated 405 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:17.513025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2fdb7-04e5-4142-83fa-12c0c0e17d07 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:17.532939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2fdb7-04e5-4142-83fa-12c0c0e17d07 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:17.669851 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b7677-4fae-4aab-a4a5-42b8d49b9903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:17.670471 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b7677-4fae-4aab-a4a5-42b8d49b9903 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:17.671891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b7677-4fae-4aab-a4a5-42b8d49b9903 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:17.672355 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b7677-4fae-4aab-a4a5-42b8d49b9903 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:17.673166 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b7677-4fae-4aab-a4a5-42b8d49b9903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:17.676416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b7677-4fae-4aab-a4a5-42b8d49b9903 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:17.695838 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42ff09-7305-4ba0-909a-13f790aa0371 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:17.698090 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-cd42ff09-7305-4ba0-909a-13f790aa0371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:17.735326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42ff09-7305-4ba0-909a-13f790aa0371 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:17.747224 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27c08c-e866-4fa0-b021-98a4ab503cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:17.747948 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27c08c-e866-4fa0-b021-98a4ab503cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:17.748333 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27c08c-e866-4fa0-b021-98a4ab503cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:17.748611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27c08c-e866-4fa0-b021-98a4ab503cc3 admin admin] PATH_INFO: `/v3/users/a199c1f27219455eb24fb1ff2a373aec` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:17.750729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27c08c-e866-4fa0-b021-98a4ab503cc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a199c1f27219455eb24fb1ff2a373aec)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:17.755597 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27c08c-e866-4fa0-b021-98a4ab503cc3 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:17.811843 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 834/1653] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:17 2022] POST /identity/v3/users => generated 303 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:17.822597 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b7677-4fae-4aab-a4a5-42b8d49b9903 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:17.857083 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b7677-4fae-4aab-a4a5-42b8d49b9903 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:17.865138 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177d221-a604-45c0-a7c4-851a763ade97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:17.865802 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177d221-a604-45c0-a7c4-851a763ade97 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:17.866029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177d221-a604-45c0-a7c4-851a763ade97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:17.866489 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177d221-a604-45c0-a7c4-851a763ade97 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:17.867158 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177d221-a604-45c0-a7c4-851a763ade97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:17.868887 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177d221-a604-45c0-a7c4-851a763ade97 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:17.885052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 835/1654] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:17.889276 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177d221-a604-45c0-a7c4-851a763ade97 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:17.901267 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177d221-a604-45c0-a7c4-851a763ade97 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:17.910624 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2735d66-f922-4ddd-ad90-3e4d8cc5f45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:17.911336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2735d66-f922-4ddd-ad90-3e4d8cc5f45b admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:17.911669 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2735d66-f922-4ddd-ad90-3e4d8cc5f45b admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:17.912223 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2735d66-f922-4ddd-ad90-3e4d8cc5f45b admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:17.913096 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2735d66-f922-4ddd-ad90-3e4d8cc5f45b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:17.916056 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2735d66-f922-4ddd-ad90-3e4d8cc5f45b admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:17.932568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 836/1655] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 13:54:17.942393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2735d66-f922-4ddd-ad90-3e4d8cc5f45b admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:17.958844 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2735d66-f922-4ddd-ad90-3e4d8cc5f45b admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:17.965049 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790020e-1c40-46e1-bac2-5fe9487ca0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:17.965731 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790020e-1c40-46e1-bac2-5fe9487ca0f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:17.968336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790020e-1c40-46e1-bac2-5fe9487ca0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:17.968336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790020e-1c40-46e1-bac2-5fe9487ca0f6 admin admin] PATH_INFO: `/v3/projects/962a27e17c08444a989b17851920a3e0/users/00948d7d10a941ecb69b8f6767ee3439/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:17.986655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790020e-1c40-46e1-bac2-5fe9487ca0f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=962a27e17c08444a989b17851920a3e0, user_id=00948d7d10a941ecb69b8f6767ee3439, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:17.990249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790020e-1c40-46e1-bac2-5fe9487ca0f6 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:18.008078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-da27c08c-e866-4fa0-b021-98a4ab503cc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a199c1f27219455eb24fb1ff2a373aec'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:18.008784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-da27c08c-e866-4fa0-b021-98a4ab503cc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a199c1f27219455eb24fb1ff2a373aec'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:18.039941 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-da27c08c-e866-4fa0-b021-98a4ab503cc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a199c1f27219455eb24fb1ff2a373aec'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:18.064817 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-da27c08c-e866-4fa0-b021-98a4ab503cc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a199c1f27219455eb24fb1ff2a373aec'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:18.089510 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 837/1656] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:17 2022] PUT /identity/v3/projects/962a27e17c08444a989b17851920a3e0/users/00948d7d10a941ecb69b8f6767ee3439/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:18.091626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacb40e-eef2-4f64-816f-516c2051bb03 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:18.092310 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacb40e-eef2-4f64-816f-516c2051bb03 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:18.092735 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacb40e-eef2-4f64-816f-516c2051bb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:18.133223 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-cdacb40e-eef2-4f64-816f-516c2051bb03 None None] MFA Rules not processed for user `00948d7d10a941ecb69b8f6767ee3439`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:18.135001 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-cdacb40e-eef2-4f64-816f-516c2051bb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:18.146364 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-da27c08c-e866-4fa0-b021-98a4ab503cc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a199c1f27219455eb24fb1ff2a373aec'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:18.154432 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 820/1657] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:54:17 2022] DELETE /identity/v3/users/a199c1f27219455eb24fb1ff2a373aec => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:18.160151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a614b8e-44c0-422d-b942-61c652a04c34 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:18.160899 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a614b8e-44c0-422d-b942-61c652a04c34 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:18.161502 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a614b8e-44c0-422d-b942-61c652a04c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:18.217123 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-9a614b8e-44c0-422d-b942-61c652a04c34 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:18.224033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-9a614b8e-44c0-422d-b942-61c652a04c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:18.239951 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 838/1658] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:18 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:18.242822 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866667b-9f73-4084-8309-83316419242b None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:18.243108 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866667b-9f73-4084-8309-83316419242b None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:18.243419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866667b-9f73-4084-8309-83316419242b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:18.327702 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-4866667b-9f73-4084-8309-83316419242b None None] MFA Rules not processed for user `dfa1a7d3bbae4837b972c6ed0ebadcc0`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:18.329032 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-4866667b-9f73-4084-8309-83316419242b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:18.376249 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 821/1659] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:54:18.377306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a614b8e-44c0-422d-b942-61c652a04c34 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:18.382747 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-9a614b8e-44c0-422d-b942-61c652a04c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:18.408713 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a614b8e-44c0-422d-b942-61c652a04c34 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:18.430426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8007282-1dac-432c-9cca-61fb90f5f2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:18.431308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8007282-1dac-432c-9cca-61fb90f5f2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:18.432091 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8007282-1dac-432c-9cca-61fb90f5f2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:18.432378 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8007282-1dac-432c-9cca-61fb90f5f2f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:18.433192 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8007282-1dac-432c-9cca-61fb90f5f2f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:18.435328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8007282-1dac-432c-9cca-61fb90f5f2f2 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:18.546367 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:18.567709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 822/1660] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:18 2022] POST /identity/v3/projects => generated 403 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:18.568719 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8007282-1dac-432c-9cca-61fb90f5f2f2 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:18.573092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a8007282-1dac-432c-9cca-61fb90f5f2f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:18.601306 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 839/1661] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:18 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:18.602588 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866667b-9f73-4084-8309-83316419242b None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:18.666513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866667b-9f73-4084-8309-83316419242b None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:18.743149 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8007282-1dac-432c-9cca-61fb90f5f2f2 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:18.753494 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f72e77-2e79-42d9-aebc-060d39d06d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:18.754135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f72e77-2e79-42d9-aebc-060d39d06d19 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:18.754562 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f72e77-2e79-42d9-aebc-060d39d06d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:18.754689 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f72e77-2e79-42d9-aebc-060d39d06d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:18.924463 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:18.956246 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f72e77-2e79-42d9-aebc-060d39d06d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:18.958184 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f72e77-2e79-42d9-aebc-060d39d06d19 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:18.968115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb8bc5-0f29-4d94-86d8-6249e74e82c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:18.968732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb8bc5-0f29-4d94-86d8-6249e74e82c3 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:18.968921 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb8bc5-0f29-4d94-86d8-6249e74e82c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:18.972704 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb8bc5-0f29-4d94-86d8-6249e74e82c3 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:18.976991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb8bc5-0f29-4d94-86d8-6249e74e82c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:18.990017 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb8bc5-0f29-4d94-86d8-6249e74e82c3 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:18.992420 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 823/1662] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:19.147537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 840/1663] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:18 2022] POST /identity/v3/users => generated 308 bytes in 546 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:19.151958 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f72e77-2e79-42d9-aebc-060d39d06d19 service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:19.169311 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f72e77-2e79-42d9-aebc-060d39d06d19 service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:19.188094 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82187f0-e61b-41ac-8556-f739d94f31b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:19.188811 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82187f0-e61b-41ac-8556-f739d94f31b6 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:19.189555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82187f0-e61b-41ac-8556-f739d94f31b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:19.189924 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82187f0-e61b-41ac-8556-f739d94f31b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:19.190725 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82187f0-e61b-41ac-8556-f739d94f31b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:19.193841 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82187f0-e61b-41ac-8556-f739d94f31b6 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:19.212235 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 824/1664] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:19.216346 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb8bc5-0f29-4d94-86d8-6249e74e82c3 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:19.235328 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb8bc5-0f29-4d94-86d8-6249e74e82c3 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:19.271188 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4944e70-e71a-437f-94f5-b26a24c85bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:19.272566 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4944e70-e71a-437f-94f5-b26a24c85bc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:19.275770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4944e70-e71a-437f-94f5-b26a24c85bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:19.278575 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4944e70-e71a-437f-94f5-b26a24c85bc9 admin admin] PATH_INFO: `/v3/projects/58125dd9c51e409884807a04a4f67877/users/5af1db124061445db86abaa7d9327ec4/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:19.310913 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4944e70-e71a-437f-94f5-b26a24c85bc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58125dd9c51e409884807a04a4f67877, user_id=5af1db124061445db86abaa7d9327ec4, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:19.314299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4944e70-e71a-437f-94f5-b26a24c85bc9 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:19.424168 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 841/1665] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:19 2022] PUT /identity/v3/projects/58125dd9c51e409884807a04a4f67877/users/5af1db124061445db86abaa7d9327ec4/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:19.429440 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82187f0-e61b-41ac-8556-f739d94f31b6 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:19.480686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82187f0-e61b-41ac-8556-f739d94f31b6 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:19.716530 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23faa8-9ae8-4563-8fe2-1a77739e1305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:19.717256 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23faa8-9ae8-4563-8fe2-1a77739e1305 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:19.719538 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23faa8-9ae8-4563-8fe2-1a77739e1305 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:19.720833 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23faa8-9ae8-4563-8fe2-1a77739e1305 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:19.721564 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23faa8-9ae8-4563-8fe2-1a77739e1305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:19.729736 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23faa8-9ae8-4563-8fe2-1a77739e1305 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:19.771722 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 825/1666] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:19.774604 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4944e70-e71a-437f-94f5-b26a24c85bc9 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:19.804485 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4944e70-e71a-437f-94f5-b26a24c85bc9 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:19.818264 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acf528-a35c-4261-9991-9af96c27dc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:19.819134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acf528-a35c-4261-9991-9af96c27dc9c admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:19.819448 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acf528-a35c-4261-9991-9af96c27dc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:19.819726 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acf528-a35c-4261-9991-9af96c27dc9c admin admin] PATH_INFO: `/v3/projects/58125dd9c51e409884807a04a4f67877/users/5af1db124061445db86abaa7d9327ec4/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:19.827180 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acf528-a35c-4261-9991-9af96c27dc9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=58125dd9c51e409884807a04a4f67877, user_id=5af1db124061445db86abaa7d9327ec4, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:19.836263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acf528-a35c-4261-9991-9af96c27dc9c admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:19.892966 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 842/1667] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:19 2022] PUT /identity/v3/projects/58125dd9c51e409884807a04a4f67877/users/5af1db124061445db86abaa7d9327ec4/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:19.903000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab137b24-d42e-424b-947f-8936938206e5 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:19.903434 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab137b24-d42e-424b-947f-8936938206e5 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:19.903856 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab137b24-d42e-424b-947f-8936938206e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:19.966589 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-ab137b24-d42e-424b-947f-8936938206e5 None None] MFA Rules not processed for user `5af1db124061445db86abaa7d9327ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:19.968591 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-ab137b24-d42e-424b-947f-8936938206e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:20.132696 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 826/1668] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:19 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:20.153406 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acf528-a35c-4261-9991-9af96c27dc9c admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:20.156071 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-16acf528-a35c-4261-9991-9af96c27dc9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:20.280664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acf528-a35c-4261-9991-9af96c27dc9c admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:20.293762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caceb93-de21-46bc-bf6e-8812911cc57d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:20.294435 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caceb93-de21-46bc-bf6e-8812911cc57d service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:20.294719 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caceb93-de21-46bc-bf6e-8812911cc57d service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:20.294997 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caceb93-de21-46bc-bf6e-8812911cc57d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:20.307557 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:20.315770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caceb93-de21-46bc-bf6e-8812911cc57d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:20.318069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caceb93-de21-46bc-bf6e-8812911cc57d service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:20.328347 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab137b24-d42e-424b-947f-8936938206e5 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:20.329882 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-ab137b24-d42e-424b-947f-8936938206e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:20.344379 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 843/1669] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:20 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:20.391682 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:20.498938 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab137b24-d42e-424b-947f-8936938206e5 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:20.527083 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221593f-7004-4796-afd2-cac3f69f2a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:20.528660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221593f-7004-4796-afd2-cac3f69f2a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:20.529523 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221593f-7004-4796-afd2-cac3f69f2a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:20.530969 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221593f-7004-4796-afd2-cac3f69f2a0a admin admin] PATH_INFO: `/v3/projects/8301923dd09442f7a43bf28f66ce7fcf` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:20.535699 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221593f-7004-4796-afd2-cac3f69f2a0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8301923dd09442f7a43bf28f66ce7fcf)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:20.544811 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221593f-7004-4796-afd2-cac3f69f2a0a admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:20.731398 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caceb93-de21-46bc-bf6e-8812911cc57d service cinder] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:20.757277 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-d221593f-7004-4796-afd2-cac3f69f2a0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8301923dd09442f7a43bf28f66ce7fcf', 'request_id': 'req-d221593f-7004-4796-afd2-cac3f69f2a0a'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:20.761762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caceb93-de21-46bc-bf6e-8812911cc57d service cinder] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:20.767811 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-d221593f-7004-4796-afd2-cac3f69f2a0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8301923dd09442f7a43bf28f66ce7fcf', 'request_id': 'req-d221593f-7004-4796-afd2-cac3f69f2a0a'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:20.780322 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-d221593f-7004-4796-afd2-cac3f69f2a0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8301923dd09442f7a43bf28f66ce7fcf', 'request_id': 'req-d221593f-7004-4796-afd2-cac3f69f2a0a'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:20.889333 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-d221593f-7004-4796-afd2-cac3f69f2a0a admin admin] The token cache is being invalidate because project 8301923dd09442f7a43bf28f66ce7fcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:54:20.890146 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-d221593f-7004-4796-afd2-cac3f69f2a0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:20.890576 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-d221593f-7004-4796-afd2-cac3f69f2a0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:20.893751 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 827/1670] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:54:20 2022] DELETE /identity/v3/projects/8301923dd09442f7a43bf28f66ce7fcf => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:54:20.900443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec30e21-3d32-4e7f-9313-e14f26fc6538 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:20.901377 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec30e21-3d32-4e7f-9313-e14f26fc6538 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:20.902346 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec30e21-3d32-4e7f-9313-e14f26fc6538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:20.910660 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd710c-4ff8-426d-9d1f-d6114ffbafd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:20.912836 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd710c-4ff8-426d-9d1f-d6114ffbafd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:20.915068 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd710c-4ff8-426d-9d1f-d6114ffbafd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:20.916552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd710c-4ff8-426d-9d1f-d6114ffbafd5 admin admin] PATH_INFO: `/v3/users/00948d7d10a941ecb69b8f6767ee3439` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:20.921018 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd710c-4ff8-426d-9d1f-d6114ffbafd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00948d7d10a941ecb69b8f6767ee3439)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:20.927132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd710c-4ff8-426d-9d1f-d6114ffbafd5 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:20.970393 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-4ec30e21-3d32-4e7f-9313-e14f26fc6538 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:20.974230 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-4ec30e21-3d32-4e7f-9313-e14f26fc6538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:21.009383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 828/1671] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:21.009383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25016c0f-6d38-4479-bcfb-a22997906c08 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:21.009383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25016c0f-6d38-4479-bcfb-a22997906c08 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:21.009383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25016c0f-6d38-4479-bcfb-a22997906c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:21.042504 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-25016c0f-6d38-4479-bcfb-a22997906c08 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:21.042504 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-25016c0f-6d38-4479-bcfb-a22997906c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:21.054897 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 829/1672] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:54:21.056720 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25016c0f-6d38-4479-bcfb-a22997906c08 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:21.069498 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25016c0f-6d38-4479-bcfb-a22997906c08 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:21.075925 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c629f0a-62bc-4966-95eb-1b83ff927aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:21.082483 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c629f0a-62bc-4966-95eb-1b83ff927aca admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:21.083110 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c629f0a-62bc-4966-95eb-1b83ff927aca admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:21.083918 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c629f0a-62bc-4966-95eb-1b83ff927aca admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:21.084657 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c629f0a-62bc-4966-95eb-1b83ff927aca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:54:21.085205 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c629f0a-62bc-4966-95eb-1b83ff927aca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:21.087815 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c629f0a-62bc-4966-95eb-1b83ff927aca admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:21.112312 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 830/1673] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:54:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:54:21.113476 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c629f0a-62bc-4966-95eb-1b83ff927aca admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:21.128177 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c629f0a-62bc-4966-95eb-1b83ff927aca admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:21.137308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4b733-8cc0-4a3c-9ccb-ecea03b63c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:21.141012 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4b733-8cc0-4a3c-9ccb-ecea03b63c9d admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:21.141012 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4b733-8cc0-4a3c-9ccb-ecea03b63c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:21.141012 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4b733-8cc0-4a3c-9ccb-ecea03b63c9d admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:21.141012 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4b733-8cc0-4a3c-9ccb-ecea03b63c9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:21.144674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4b733-8cc0-4a3c-9ccb-ecea03b63c9d admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:21.239845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-3dfd710c-4ff8-426d-9d1f-d6114ffbafd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00948d7d10a941ecb69b8f6767ee3439'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:21.304060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 831/1674] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:21 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:21.305847 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60a430-7692-445c-92c2-47fc5cedb131 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:21.306906 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60a430-7692-445c-92c2-47fc5cedb131 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:21.307433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60a430-7692-445c-92c2-47fc5cedb131 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:21.309002 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 832/1675] 10.222.0.50 () {54 vars in 921 bytes} [Thu Sep 1 13:54:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:54:21.310432 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60a430-7692-445c-92c2-47fc5cedb131 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:21.352510 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-3dfd710c-4ff8-426d-9d1f-d6114ffbafd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00948d7d10a941ecb69b8f6767ee3439'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:21.366847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-3dfd710c-4ff8-426d-9d1f-d6114ffbafd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00948d7d10a941ecb69b8f6767ee3439'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:21.395831 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:21.409962 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-3dfd710c-4ff8-426d-9d1f-d6114ffbafd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00948d7d10a941ecb69b8f6767ee3439'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:21.411618 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-3dfd710c-4ff8-426d-9d1f-d6114ffbafd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00948d7d10a941ecb69b8f6767ee3439'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:21.455322 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 844/1676] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:54:20 2022] DELETE /identity/v3/users/00948d7d10a941ecb69b8f6767ee3439 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:21.461540 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68d58e-7d9f-493c-b14f-8299eb5a4963 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:21.461540 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68d58e-7d9f-493c-b14f-8299eb5a4963 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:21.464991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68d58e-7d9f-493c-b14f-8299eb5a4963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:21.505183 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60a430-7692-445c-92c2-47fc5cedb131 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:21.528662 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-fa68d58e-7d9f-493c-b14f-8299eb5a4963 None None] MFA Rules not processed for user `63e675d44d2c49929feb0ec0d2c0d0eb`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:21.530523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-fa68d58e-7d9f-493c-b14f-8299eb5a4963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:21.596875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4b701-849c-46a2-9b9b-8bb806c328e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:21.597785 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4b701-849c-46a2-9b9b-8bb806c328e3 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:21.598134 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4b701-849c-46a2-9b9b-8bb806c328e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:21.598412 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4b701-849c-46a2-9b9b-8bb806c328e3 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:21.599069 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4b701-849c-46a2-9b9b-8bb806c328e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:21.602698 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4b701-849c-46a2-9b9b-8bb806c328e3 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:21.676958 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 845/1677] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Sep 1 13:54:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:21.678311 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdb724-6484-40f1-a516-14f40af0b3f1 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:21.678605 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdb724-6484-40f1-a516-14f40af0b3f1 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:21.678883 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdb724-6484-40f1-a516-14f40af0b3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:21.687443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 833/1678] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:21 2022] POST /identity/v3/users => generated 294 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:21.693668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4b701-849c-46a2-9b9b-8bb806c328e3 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:21.699078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-4bb4b701-849c-46a2-9b9b-8bb806c328e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:21.714417 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-fecdb724-6484-40f1-a516-14f40af0b3f1 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:21.715761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-fecdb724-6484-40f1-a516-14f40af0b3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:21.747004 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 846/1679] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:21.761816 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4b701-849c-46a2-9b9b-8bb806c328e3 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:21.769567 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c664202-fa4c-40e2-9cbb-c59fd6e0591c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:21.771003 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c664202-fa4c-40e2-9cbb-c59fd6e0591c admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:21.771003 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c664202-fa4c-40e2-9cbb-c59fd6e0591c admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:21.771003 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c664202-fa4c-40e2-9cbb-c59fd6e0591c admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:21.771704 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c664202-fa4c-40e2-9cbb-c59fd6e0591c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:21.773439 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c664202-fa4c-40e2-9cbb-c59fd6e0591c admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:21.781753 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdb724-6484-40f1-a516-14f40af0b3f1 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:21.783420 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-fecdb724-6484-40f1-a516-14f40af0b3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:21.802083 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:21.819312 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdb724-6484-40f1-a516-14f40af0b3f1 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:21.822247 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 834/1680] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:21.828825 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c664202-fa4c-40e2-9cbb-c59fd6e0591c admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:21.835065 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-4c664202-fa4c-40e2-9cbb-c59fd6e0591c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:21.838997 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54246e5-7815-46ec-b1cb-56883ce7e796 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e675d44d2c49929feb0ec0d2c0d0eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:21.838997 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54246e5-7815-46ec-b1cb-56883ce7e796 service placement] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:21.838997 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54246e5-7815-46ec-b1cb-56883ce7e796 service placement] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:21.838997 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54246e5-7815-46ec-b1cb-56883ce7e796 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:21.860053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54246e5-7815-46ec-b1cb-56883ce7e796 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:21.862794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54246e5-7815-46ec-b1cb-56883ce7e796 service placement] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:21.895101 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 847/1681] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 13:54:21.896246 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54246e5-7815-46ec-b1cb-56883ce7e796 service placement] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:21.916351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54246e5-7815-46ec-b1cb-56883ce7e796 service placement] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:21.931849 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15926ba1-499d-4863-a66a-ebb8c9145dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:21.932658 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15926ba1-499d-4863-a66a-ebb8c9145dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:21.932897 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15926ba1-499d-4863-a66a-ebb8c9145dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:21.934646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15926ba1-499d-4863-a66a-ebb8c9145dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:21.934646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15926ba1-499d-4863-a66a-ebb8c9145dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:21.937018 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15926ba1-499d-4863-a66a-ebb8c9145dc5 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:21.964346 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 848/1682] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:21.966475 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15926ba1-499d-4863-a66a-ebb8c9145dc5 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:21.989707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c664202-fa4c-40e2-9cbb-c59fd6e0591c admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:22.000366 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a73d9-8ffa-4341-aa53-a74a19ddbefb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:22.001288 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a73d9-8ffa-4341-aa53-a74a19ddbefb service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:22.003864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15926ba1-499d-4863-a66a-ebb8c9145dc5 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:22.004147 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a73d9-8ffa-4341-aa53-a74a19ddbefb service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:22.004638 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a73d9-8ffa-4341-aa53-a74a19ddbefb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:22.035175 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a73d9-8ffa-4341-aa53-a74a19ddbefb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:22.038466 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a73d9-8ffa-4341-aa53-a74a19ddbefb service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:22.042846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fc8eb-85f3-46f6-ab07-367274f54a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:22.045029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fc8eb-85f3-46f6-ab07-367274f54a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:22.045323 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fc8eb-85f3-46f6-ab07-367274f54a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:22.045600 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fc8eb-85f3-46f6-ab07-367274f54a2e admin admin] PATH_INFO: `/v3/projects/76943b9450114e2e8ac0bc5ee59f3a9d/users/1da48eae46d14dd3a8bd346a05f5aebd/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:22.074203 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 835/1683] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:22.100540 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4fc8eb-85f3-46f6-ab07-367274f54a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=76943b9450114e2e8ac0bc5ee59f3a9d, user_id=1da48eae46d14dd3a8bd346a05f5aebd, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:22.103801 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4fc8eb-85f3-46f6-ab07-367274f54a2e admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:22.238220 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 849/1684] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:21 2022] PUT /identity/v3/projects/76943b9450114e2e8ac0bc5ee59f3a9d/users/1da48eae46d14dd3a8bd346a05f5aebd/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:22.250495 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef28ed4-5447-4803-b866-a2139c0bfd3b None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:22.251048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef28ed4-5447-4803-b866-a2139c0bfd3b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:22.251337 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef28ed4-5447-4803-b866-a2139c0bfd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:22.291789 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-2ef28ed4-5447-4803-b866-a2139c0bfd3b None None] MFA Rules not processed for user `1da48eae46d14dd3a8bd346a05f5aebd`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:22.293332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-2ef28ed4-5447-4803-b866-a2139c0bfd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:22.406035 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 836/1685] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:54:22.417190 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fc8eb-85f3-46f6-ab07-367274f54a2e admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:22.592853 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fc8eb-85f3-46f6-ab07-367274f54a2e admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:22.605294 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef15bcb-55e8-43f0-ba23-c2867710908d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:22.605928 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef15bcb-55e8-43f0-ba23-c2867710908d admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:22.606374 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef15bcb-55e8-43f0-ba23-c2867710908d admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:22.606814 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef15bcb-55e8-43f0-ba23-c2867710908d admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:22.607512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef15bcb-55e8-43f0-ba23-c2867710908d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:22.609447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef15bcb-55e8-43f0-ba23-c2867710908d admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:22.753821 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 850/1686] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:22 2022] POST /identity/v3/projects => generated 387 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:22.757806 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef28ed4-5447-4803-b866-a2139c0bfd3b None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:22.781189 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef28ed4-5447-4803-b866-a2139c0bfd3b None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:22.843040 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef15bcb-55e8-43f0-ba23-c2867710908d admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:22.845361 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-2ef15bcb-55e8-43f0-ba23-c2867710908d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:22.955192 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882da1f-7d63-47a9-8c26-5050e93830ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:22.961236 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882da1f-7d63-47a9-8c26-5050e93830ba admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:22.971540 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882da1f-7d63-47a9-8c26-5050e93830ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:22.971540 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882da1f-7d63-47a9-8c26-5050e93830ba admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:22.971540 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882da1f-7d63-47a9-8c26-5050e93830ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:22.971540 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882da1f-7d63-47a9-8c26-5050e93830ba admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:23.045042 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef15bcb-55e8-43f0-ba23-c2867710908d admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:23.052527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c0c4a-1d79-45be-aee1-2ea104c66697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:23.053272 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c0c4a-1d79-45be-aee1-2ea104c66697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:23.053647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c0c4a-1d79-45be-aee1-2ea104c66697 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:23.054139 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c0c4a-1d79-45be-aee1-2ea104c66697 admin admin] PATH_INFO: `/v3/projects/962a27e17c08444a989b17851920a3e0` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:23.055900 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c0c4a-1d79-45be-aee1-2ea104c66697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=962a27e17c08444a989b17851920a3e0)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:23.058524 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c0c4a-1d79-45be-aee1-2ea104c66697 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:23.114456 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 837/1687] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:22 2022] POST /identity/v3/users => generated 300 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:23.118392 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882da1f-7d63-47a9-8c26-5050e93830ba admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:23.133215 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882da1f-7d63-47a9-8c26-5050e93830ba admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:23.143464 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4f870-6a72-4a9c-8455-14a4f63e3003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:23.143464 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4f870-6a72-4a9c-8455-14a4f63e3003 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:23.143464 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4f870-6a72-4a9c-8455-14a4f63e3003 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:23.143464 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4f870-6a72-4a9c-8455-14a4f63e3003 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:23.143921 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4f870-6a72-4a9c-8455-14a4f63e3003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:23.147829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4f870-6a72-4a9c-8455-14a4f63e3003 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:23.171671 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 838/1688] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:23.176386 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4f870-6a72-4a9c-8455-14a4f63e3003 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:23.194794 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4f870-6a72-4a9c-8455-14a4f63e3003 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:23.201972 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719d473-54af-4d5f-9c8c-dabdaa4e83c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:23.202775 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719d473-54af-4d5f-9c8c-dabdaa4e83c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:23.203069 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719d473-54af-4d5f-9c8c-dabdaa4e83c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:23.203515 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719d473-54af-4d5f-9c8c-dabdaa4e83c4 admin admin] PATH_INFO: `/v3/projects/2d6058eb4f4c4df99070417754b55edf/users/e00e3fbc801d42879939b01493091667/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:23.233533 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719d473-54af-4d5f-9c8c-dabdaa4e83c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d6058eb4f4c4df99070417754b55edf, user_id=e00e3fbc801d42879939b01493091667, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:23.237031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719d473-54af-4d5f-9c8c-dabdaa4e83c4 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:23.371634 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 839/1689] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:23 2022] PUT /identity/v3/projects/2d6058eb4f4c4df99070417754b55edf/users/e00e3fbc801d42879939b01493091667/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:54:23.384657 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719d473-54af-4d5f-9c8c-dabdaa4e83c4 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:23.413266 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-238c0c4a-1d79-45be-aee1-2ea104c66697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '962a27e17c08444a989b17851920a3e0', 'request_id': 'req-238c0c4a-1d79-45be-aee1-2ea104c66697'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:23.443832 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-238c0c4a-1d79-45be-aee1-2ea104c66697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '962a27e17c08444a989b17851920a3e0', 'request_id': 'req-238c0c4a-1d79-45be-aee1-2ea104c66697'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:23.521167 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719d473-54af-4d5f-9c8c-dabdaa4e83c4 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:23.533489 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b97de5-eb6a-437f-af0c-0a3fc0bd0f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:23.534127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b97de5-eb6a-437f-af0c-0a3fc0bd0f1e admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:23.534407 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b97de5-eb6a-437f-af0c-0a3fc0bd0f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:23.534686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b97de5-eb6a-437f-af0c-0a3fc0bd0f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:23.535349 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b97de5-eb6a-437f-af0c-0a3fc0bd0f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:23.538567 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b97de5-eb6a-437f-af0c-0a3fc0bd0f1e admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:23.558639 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 840/1690] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 13:54:23.562802 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b97de5-eb6a-437f-af0c-0a3fc0bd0f1e admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:23.573151 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-238c0c4a-1d79-45be-aee1-2ea104c66697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '962a27e17c08444a989b17851920a3e0', 'request_id': 'req-238c0c4a-1d79-45be-aee1-2ea104c66697'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:23.592266 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-238c0c4a-1d79-45be-aee1-2ea104c66697 admin admin] The token cache is being invalidate because project 962a27e17c08444a989b17851920a3e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:54:23.592899 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-238c0c4a-1d79-45be-aee1-2ea104c66697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:23.597976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-238c0c4a-1d79-45be-aee1-2ea104c66697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:23.604778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b97de5-eb6a-437f-af0c-0a3fc0bd0f1e admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:23.605426 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 851/1691] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:54:22 2022] DELETE /identity/v3/projects/962a27e17c08444a989b17851920a3e0 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:23.610090 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c0c4a-1d79-45be-aee1-2ea104c66697 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:23.612608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-238c0c4a-1d79-45be-aee1-2ea104c66697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:23.620599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0c4b9-916d-4c1b-9ff8-e2541fd5439b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:23.621670 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0c4b9-916d-4c1b-9ff8-e2541fd5439b admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:23.622150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0c4b9-916d-4c1b-9ff8-e2541fd5439b admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:23.622677 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0c4b9-916d-4c1b-9ff8-e2541fd5439b admin admin] PATH_INFO: `/v3/projects/2d6058eb4f4c4df99070417754b55edf/users/e00e3fbc801d42879939b01493091667/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:23.630279 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f0c4b9-916d-4c1b-9ff8-e2541fd5439b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d6058eb4f4c4df99070417754b55edf, user_id=e00e3fbc801d42879939b01493091667, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:23.641248 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f0c4b9-916d-4c1b-9ff8-e2541fd5439b admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:23.681075 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 841/1692] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:23 2022] PUT /identity/v3/projects/2d6058eb4f4c4df99070417754b55edf/users/e00e3fbc801d42879939b01493091667/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:23.682634 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c576908-0b88-4918-9833-3ec6620edf28 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:23.686260 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c576908-0b88-4918-9833-3ec6620edf28 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:23.686717 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c576908-0b88-4918-9833-3ec6620edf28 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:23.694424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 842/1693] 10.222.0.50 () {54 vars in 921 bytes} [Thu Sep 1 13:54:23 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:54:23.695976 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089977d-61fa-48f2-9eb4-2e4c7982ee4c None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:23.699949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089977d-61fa-48f2-9eb4-2e4c7982ee4c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:23.699949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089977d-61fa-48f2-9eb4-2e4c7982ee4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:23.773134 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-c089977d-61fa-48f2-9eb4-2e4c7982ee4c None None] MFA Rules not processed for user `e00e3fbc801d42879939b01493091667`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:23.778353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c089977d-61fa-48f2-9eb4-2e4c7982ee4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:23.807503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c0c4a-1d79-45be-aee1-2ea104c66697 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:23.901374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 843/1694] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:23 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:23.903691 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295a652-6db7-406d-ae5e-b04c97f6f13e None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:23.904154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295a652-6db7-406d-ae5e-b04c97f6f13e None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:23.904795 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295a652-6db7-406d-ae5e-b04c97f6f13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:23.923124 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d5355-721b-4cbd-840d-435973dc06d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:23.923901 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d5355-721b-4cbd-840d-435973dc06d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:23.925929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d5355-721b-4cbd-840d-435973dc06d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:23.926369 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d5355-721b-4cbd-840d-435973dc06d2 admin admin] PATH_INFO: `/v3/users/5af1db124061445db86abaa7d9327ec4` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:23.927658 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d5355-721b-4cbd-840d-435973dc06d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5af1db124061445db86abaa7d9327ec4)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:23.929686 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d5355-721b-4cbd-840d-435973dc06d2 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:23.930742 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-6295a652-6db7-406d-ae5e-b04c97f6f13e None None] MFA Rules not processed for user `63e675d44d2c49929feb0ec0d2c0d0eb`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:23.932747 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-6295a652-6db7-406d-ae5e-b04c97f6f13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:23.973977 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:24.026556 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 844/1695] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Sep 1 13:54:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:24.027913 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295a652-6db7-406d-ae5e-b04c97f6f13e None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:24.029557 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-6295a652-6db7-406d-ae5e-b04c97f6f13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:24.142595 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295a652-6db7-406d-ae5e-b04c97f6f13e None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:24.148345 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819ec3b-9bd3-4cfb-b1ad-31d2e634bb77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:24.148975 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819ec3b-9bd3-4cfb-b1ad-31d2e634bb77 service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:24.149308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819ec3b-9bd3-4cfb-b1ad-31d2e634bb77 service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:24.149660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819ec3b-9bd3-4cfb-b1ad-31d2e634bb77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:24.163492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:24.164271 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819ec3b-9bd3-4cfb-b1ad-31d2e634bb77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:24.169235 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819ec3b-9bd3-4cfb-b1ad-31d2e634bb77 service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:24.181884 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 845/1696] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:24 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:24.183433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819ec3b-9bd3-4cfb-b1ad-31d2e634bb77 service cinder] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:24.184836 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-423d5355-721b-4cbd-840d-435973dc06d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5af1db124061445db86abaa7d9327ec4'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:24.188656 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a819ec3b-9bd3-4cfb-b1ad-31d2e634bb77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:24.216697 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819ec3b-9bd3-4cfb-b1ad-31d2e634bb77 service cinder] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:24.238798 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52af77-1c96-4e25-87a3-e2be0d2c9977 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e675d44d2c49929feb0ec0d2c0d0eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:24.252838 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52af77-1c96-4e25-87a3-e2be0d2c9977 service placement] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:24.255668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52af77-1c96-4e25-87a3-e2be0d2c9977 service placement] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:24.255668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52af77-1c96-4e25-87a3-e2be0d2c9977 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:24.274987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52af77-1c96-4e25-87a3-e2be0d2c9977 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:24.277155 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52af77-1c96-4e25-87a3-e2be0d2c9977 service placement] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:24.294861 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 846/1697] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:24.294861 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52af77-1c96-4e25-87a3-e2be0d2c9977 service placement] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:24.296319 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-0a52af77-1c96-4e25-87a3-e2be0d2c9977 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:24.312666 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-423d5355-721b-4cbd-840d-435973dc06d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5af1db124061445db86abaa7d9327ec4'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:24.322796 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-423d5355-721b-4cbd-840d-435973dc06d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5af1db124061445db86abaa7d9327ec4'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:24.326990 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52af77-1c96-4e25-87a3-e2be0d2c9977 service placement] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:24.335542 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d4721-c368-4615-86e7-187605a28ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:24.336354 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d4721-c368-4615-86e7-187605a28ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:24.336733 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d4721-c368-4615-86e7-187605a28ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:24.337105 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d4721-c368-4615-86e7-187605a28ff0 admin admin] PATH_INFO: `/v3/users/f42c70ed48c34bfd92762ccd71ee64d2` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:24.338367 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d4721-c368-4615-86e7-187605a28ff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f42c70ed48c34bfd92762ccd71ee64d2)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:24.340540 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d4721-c368-4615-86e7-187605a28ff0 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:24.364291 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-423d5355-721b-4cbd-840d-435973dc06d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5af1db124061445db86abaa7d9327ec4'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:24.365047 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-423d5355-721b-4cbd-840d-435973dc06d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5af1db124061445db86abaa7d9327ec4'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:24.376787 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 852/1698] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:54:23 2022] DELETE /identity/v3/users/5af1db124061445db86abaa7d9327ec4 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:24.376787 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d5355-721b-4cbd-840d-435973dc06d2 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:24.379106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-423d5355-721b-4cbd-840d-435973dc06d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:24.508071 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d5355-721b-4cbd-840d-435973dc06d2 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:24.520241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7964b5a-ee52-4340-a19f-97ec158a44bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:24.526221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7964b5a-ee52-4340-a19f-97ec158a44bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:24.526221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7964b5a-ee52-4340-a19f-97ec158a44bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:24.526221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7964b5a-ee52-4340-a19f-97ec158a44bb admin admin] PATH_INFO: `/v3/users/1da48eae46d14dd3a8bd346a05f5aebd` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:24.526221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7964b5a-ee52-4340-a19f-97ec158a44bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da48eae46d14dd3a8bd346a05f5aebd)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:24.529515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7964b5a-ee52-4340-a19f-97ec158a44bb admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:24.580056 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-526d4721-c368-4615-86e7-187605a28ff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f42c70ed48c34bfd92762ccd71ee64d2'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:24.581879 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-526d4721-c368-4615-86e7-187605a28ff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f42c70ed48c34bfd92762ccd71ee64d2'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:24.609518 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-526d4721-c368-4615-86e7-187605a28ff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f42c70ed48c34bfd92762ccd71ee64d2'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:24.624337 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-526d4721-c368-4615-86e7-187605a28ff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f42c70ed48c34bfd92762ccd71ee64d2'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:24.752628 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-526d4721-c368-4615-86e7-187605a28ff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f42c70ed48c34bfd92762ccd71ee64d2'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:24.765537 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 847/1699] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:54:24 2022] DELETE /identity/v3/users/f42c70ed48c34bfd92762ccd71ee64d2 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:24.803448 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a7964b5a-ee52-4340-a19f-97ec158a44bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da48eae46d14dd3a8bd346a05f5aebd'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:24.893688 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a7964b5a-ee52-4340-a19f-97ec158a44bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da48eae46d14dd3a8bd346a05f5aebd'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:24.904913 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a7964b5a-ee52-4340-a19f-97ec158a44bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da48eae46d14dd3a8bd346a05f5aebd'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:24.925956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a7964b5a-ee52-4340-a19f-97ec158a44bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da48eae46d14dd3a8bd346a05f5aebd'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:24.926836 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a7964b5a-ee52-4340-a19f-97ec158a44bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da48eae46d14dd3a8bd346a05f5aebd'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:24.935234 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 853/1700] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:54:24 2022] DELETE /identity/v3/users/1da48eae46d14dd3a8bd346a05f5aebd => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:24.940468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8ebfd-167f-4d63-8392-6e6e9c5fac0c None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:24.940739 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8ebfd-167f-4d63-8392-6e6e9c5fac0c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:24.941025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8ebfd-167f-4d63-8392-6e6e9c5fac0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:24.987266 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-a3b8ebfd-167f-4d63-8392-6e6e9c5fac0c None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:24.988677 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a3b8ebfd-167f-4d63-8392-6e6e9c5fac0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:25.097100 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 848/1701] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:25.112747 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7964b5a-ee52-4340-a19f-97ec158a44bb admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:25.113466 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a7964b5a-ee52-4340-a19f-97ec158a44bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:25.235478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8ebfd-167f-4d63-8392-6e6e9c5fac0c None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:25.236824 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a3b8ebfd-167f-4d63-8392-6e6e9c5fac0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:25.249737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7964b5a-ee52-4340-a19f-97ec158a44bb admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:25.255263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8ebfd-167f-4d63-8392-6e6e9c5fac0c None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:25.262957 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e7852-36fa-40ee-9b8b-0ae5ca413586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:25.263633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e7852-36fa-40ee-9b8b-0ae5ca413586 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:25.263927 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e7852-36fa-40ee-9b8b-0ae5ca413586 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:25.264189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e7852-36fa-40ee-9b8b-0ae5ca413586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:25.272163 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecd42b-b978-4b01-952c-70bc3d546965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:25.272833 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecd42b-b978-4b01-952c-70bc3d546965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:25.273115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecd42b-b978-4b01-952c-70bc3d546965 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:25.273392 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecd42b-b978-4b01-952c-70bc3d546965 admin admin] PATH_INFO: `/v3/projects/58125dd9c51e409884807a04a4f67877` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:25.277310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecd42b-b978-4b01-952c-70bc3d546965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58125dd9c51e409884807a04a4f67877)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:25.278295 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecd42b-b978-4b01-952c-70bc3d546965 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:25.287708 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e7852-36fa-40ee-9b8b-0ae5ca413586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:25.294479 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e7852-36fa-40ee-9b8b-0ae5ca413586 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:25.340665 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 854/1702] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:25.455427 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e7852-36fa-40ee-9b8b-0ae5ca413586 service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:25.457579 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-302e7852-36fa-40ee-9b8b-0ae5ca413586 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:25.471346 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e7852-36fa-40ee-9b8b-0ae5ca413586 service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:25.499033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-bdecd42b-b978-4b01-952c-70bc3d546965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58125dd9c51e409884807a04a4f67877', 'request_id': 'req-bdecd42b-b978-4b01-952c-70bc3d546965'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:25.516396 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-bdecd42b-b978-4b01-952c-70bc3d546965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58125dd9c51e409884807a04a4f67877', 'request_id': 'req-bdecd42b-b978-4b01-952c-70bc3d546965'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:25.524352 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:25.532726 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-bdecd42b-b978-4b01-952c-70bc3d546965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58125dd9c51e409884807a04a4f67877', 'request_id': 'req-bdecd42b-b978-4b01-952c-70bc3d546965'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:25.590481 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25381c8a-7faf-4c52-a5f2-89621799782a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:25.591231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25381c8a-7faf-4c52-a5f2-89621799782a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:25.591617 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25381c8a-7faf-4c52-a5f2-89621799782a admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:25.591989 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25381c8a-7faf-4c52-a5f2-89621799782a admin admin] PATH_INFO: `/v3/users/c869941d25094d049c60c6c80a392930` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:25.594451 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25381c8a-7faf-4c52-a5f2-89621799782a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c869941d25094d049c60c6c80a392930)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:25.596585 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25381c8a-7faf-4c52-a5f2-89621799782a admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:25.671272 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-bdecd42b-b978-4b01-952c-70bc3d546965 admin admin] The token cache is being invalidate because project 58125dd9c51e409884807a04a4f67877 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:54:25.675806 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-bdecd42b-b978-4b01-952c-70bc3d546965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:25.681356 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-bdecd42b-b978-4b01-952c-70bc3d546965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:25.685107 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 849/1703] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:54:25 2022] DELETE /identity/v3/projects/58125dd9c51e409884807a04a4f67877 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:25.690971 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4ca17-8667-431a-8b7c-1d76d6957b9b None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:25.691387 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4ca17-8667-431a-8b7c-1d76d6957b9b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:25.691784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4ca17-8667-431a-8b7c-1d76d6957b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:25.737556 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-09a4ca17-8667-431a-8b7c-1d76d6957b9b None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:25.739208 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-09a4ca17-8667-431a-8b7c-1d76d6957b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:25.772647 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 850/1704] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:54:25.776986 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fb7f4-4a9b-4547-b4fe-b25eb358a4b7 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:25.777356 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fb7f4-4a9b-4547-b4fe-b25eb358a4b7 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:25.777781 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fb7f4-4a9b-4547-b4fe-b25eb358a4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:25.896790 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-2f1fb7f4-4a9b-4547-b4fe-b25eb358a4b7 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:25.898337 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-2f1fb7f4-4a9b-4547-b4fe-b25eb358a4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:25.898936 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-25381c8a-7faf-4c52-a5f2-89621799782a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c869941d25094d049c60c6c80a392930'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:25.946723 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 851/1705] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:25.948648 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fb7f4-4a9b-4547-b4fe-b25eb358a4b7 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:25.959405 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fb7f4-4a9b-4547-b4fe-b25eb358a4b7 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:25.972810 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba585cf-f44f-4228-8364-50644a7a492a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:25.973663 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba585cf-f44f-4228-8364-50644a7a492a admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:25.974155 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba585cf-f44f-4228-8364-50644a7a492a admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:25.974625 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba585cf-f44f-4228-8364-50644a7a492a admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:25.976221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba585cf-f44f-4228-8364-50644a7a492a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:54:25.976773 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba585cf-f44f-4228-8364-50644a7a492a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:25.978716 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba585cf-f44f-4228-8364-50644a7a492a admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:25.986757 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-25381c8a-7faf-4c52-a5f2-89621799782a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c869941d25094d049c60c6c80a392930'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:26.009960 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-25381c8a-7faf-4c52-a5f2-89621799782a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c869941d25094d049c60c6c80a392930'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:26.012574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 852/1706] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:54:26.017597 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba585cf-f44f-4228-8364-50644a7a492a admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:26.043318 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba585cf-f44f-4228-8364-50644a7a492a admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:26.052551 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-25381c8a-7faf-4c52-a5f2-89621799782a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c869941d25094d049c60c6c80a392930'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:26.055444 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-25381c8a-7faf-4c52-a5f2-89621799782a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c869941d25094d049c60c6c80a392930'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:26.056522 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ede3a5-3932-42a4-8906-ee5f4c59a02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:26.057167 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ede3a5-3932-42a4-8906-ee5f4c59a02d admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:26.057452 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ede3a5-3932-42a4-8906-ee5f4c59a02d admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:26.057728 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ede3a5-3932-42a4-8906-ee5f4c59a02d admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:26.058376 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ede3a5-3932-42a4-8906-ee5f4c59a02d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:26.074321 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ede3a5-3932-42a4-8906-ee5f4c59a02d admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:26.076586 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 855/1707] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:54:25 2022] DELETE /identity/v3/users/c869941d25094d049c60c6c80a392930 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:54:26.080689 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4093e30-d121-48f0-826c-e0df458a18db None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:26.081191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4093e30-d121-48f0-826c-e0df458a18db None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:26.083201 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4093e30-d121-48f0-826c-e0df458a18db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:26.128550 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-f4093e30-d121-48f0-826c-e0df458a18db None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:26.128550 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-f4093e30-d121-48f0-826c-e0df458a18db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:26.216982 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 853/1708] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:26 2022] POST /identity/v3/projects => generated 387 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:54:26.216982 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ede3a5-3932-42a4-8906-ee5f4c59a02d admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:26.216982 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-d6ede3a5-3932-42a4-8906-ee5f4c59a02d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:26.226855 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 856/1709] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:26.228185 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4093e30-d121-48f0-826c-e0df458a18db None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:26.237110 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-f4093e30-d121-48f0-826c-e0df458a18db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:26.265300 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4093e30-d121-48f0-826c-e0df458a18db None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:26.350251 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fd2bf-c797-4002-81a9-33e38e7a6006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:26.351243 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fd2bf-c797-4002-81a9-33e38e7a6006 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:26.351628 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fd2bf-c797-4002-81a9-33e38e7a6006 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:26.352078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fd2bf-c797-4002-81a9-33e38e7a6006 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:26.353160 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28fd2bf-c797-4002-81a9-33e38e7a6006 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:26.355406 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28fd2bf-c797-4002-81a9-33e38e7a6006 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:26.380097 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ede3a5-3932-42a4-8906-ee5f4c59a02d admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:26.389889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25299a00-d867-4724-b10a-0757bc2e5e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:26.390858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25299a00-d867-4724-b10a-0757bc2e5e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:26.391285 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25299a00-d867-4724-b10a-0757bc2e5e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:26.391776 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25299a00-d867-4724-b10a-0757bc2e5e29 admin admin] PATH_INFO: `/v3/projects/e983271524f54a2aada61ba1aa471e5d` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:26.394396 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25299a00-d867-4724-b10a-0757bc2e5e29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e983271524f54a2aada61ba1aa471e5d)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:26.397942 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25299a00-d867-4724-b10a-0757bc2e5e29 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:26.467087 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 857/1710] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:26 2022] POST /identity/v3/users => generated 294 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:26.468030 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fd2bf-c797-4002-81a9-33e38e7a6006 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:26.476231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c28fd2bf-c797-4002-81a9-33e38e7a6006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:26.521404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:26.622807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-25299a00-d867-4724-b10a-0757bc2e5e29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e983271524f54a2aada61ba1aa471e5d', 'request_id': 'req-25299a00-d867-4724-b10a-0757bc2e5e29'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:26.629469 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fd2bf-c797-4002-81a9-33e38e7a6006 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:26.639647 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-25299a00-d867-4724-b10a-0757bc2e5e29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e983271524f54a2aada61ba1aa471e5d', 'request_id': 'req-25299a00-d867-4724-b10a-0757bc2e5e29'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:26.659032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-25299a00-d867-4724-b10a-0757bc2e5e29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e983271524f54a2aada61ba1aa471e5d', 'request_id': 'req-25299a00-d867-4724-b10a-0757bc2e5e29'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:26.739867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739ab6e-a620-47e1-8783-7bab894f4f57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:26.740598 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739ab6e-a620-47e1-8783-7bab894f4f57 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:26.740953 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739ab6e-a620-47e1-8783-7bab894f4f57 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:26.741291 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739ab6e-a620-47e1-8783-7bab894f4f57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:26.781452 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-25299a00-d867-4724-b10a-0757bc2e5e29 admin admin] The token cache is being invalidate because project e983271524f54a2aada61ba1aa471e5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:54:26.782030 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-25299a00-d867-4724-b10a-0757bc2e5e29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:26.785816 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-25299a00-d867-4724-b10a-0757bc2e5e29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:26.788133 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 854/1711] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:54:26 2022] DELETE /identity/v3/projects/e983271524f54a2aada61ba1aa471e5d => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:26.789022 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25299a00-d867-4724-b10a-0757bc2e5e29 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:26.791331 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-25299a00-d867-4724-b10a-0757bc2e5e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:26.884133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739ab6e-a620-47e1-8783-7bab894f4f57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:26.890085 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739ab6e-a620-47e1-8783-7bab894f4f57 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:26.916558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 858/1712] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:26.918017 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739ab6e-a620-47e1-8783-7bab894f4f57 service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:26.928718 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25299a00-d867-4724-b10a-0757bc2e5e29 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:26.930632 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739ab6e-a620-47e1-8783-7bab894f4f57 service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:26.935746 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e51e5b-e832-44c6-9f96-595e52721f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:26.936943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e51e5b-e832-44c6-9f96-595e52721f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:26.937235 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e51e5b-e832-44c6-9f96-595e52721f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:26.937334 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac3a89-b407-4300-82d0-020843e181ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:26.937518 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e51e5b-e832-44c6-9f96-595e52721f28 admin admin] PATH_INFO: `/v3/projects/76943b9450114e2e8ac0bc5ee59f3a9d` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:26.938496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac3a89-b407-4300-82d0-020843e181ba admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:26.939584 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e51e5b-e832-44c6-9f96-595e52721f28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76943b9450114e2e8ac0bc5ee59f3a9d)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:26.939771 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac3a89-b407-4300-82d0-020843e181ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:26.940283 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac3a89-b407-4300-82d0-020843e181ba admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:26.941465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac3a89-b407-4300-82d0-020843e181ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:26.941806 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e51e5b-e832-44c6-9f96-595e52721f28 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:26.944874 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac3a89-b407-4300-82d0-020843e181ba admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:26.964850 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 859/1713] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:26.966583 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1de68f-348a-4206-8fa2-bca71faa36f5 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:26.967082 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1de68f-348a-4206-8fa2-bca71faa36f5 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:26.967391 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1de68f-348a-4206-8fa2-bca71faa36f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:27.015575 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:27.041626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-ca1de68f-348a-4206-8fa2-bca71faa36f5 None None] MFA Rules not processed for user `e35ebc3dbc1f4f348f97041627fc68b9`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:27.045347 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ca1de68f-348a-4206-8fa2-bca71faa36f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:27.203608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 860/1714] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:27.204994 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1de68f-348a-4206-8fa2-bca71faa36f5 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:27.213014 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ca1de68f-348a-4206-8fa2-bca71faa36f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:27.215558 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f0e51e5b-e832-44c6-9f96-595e52721f28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76943b9450114e2e8ac0bc5ee59f3a9d', 'request_id': 'req-f0e51e5b-e832-44c6-9f96-595e52721f28'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:27.244985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f0e51e5b-e832-44c6-9f96-595e52721f28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76943b9450114e2e8ac0bc5ee59f3a9d', 'request_id': 'req-f0e51e5b-e832-44c6-9f96-595e52721f28'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:27.263981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1de68f-348a-4206-8fa2-bca71faa36f5 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:27.267446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f0e51e5b-e832-44c6-9f96-595e52721f28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76943b9450114e2e8ac0bc5ee59f3a9d', 'request_id': 'req-f0e51e5b-e832-44c6-9f96-595e52721f28'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:27.378756 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b95566-f42a-4b73-aa01-0f7d1ee9b31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:27.378756 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b95566-f42a-4b73-aa01-0f7d1ee9b31d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:27.378756 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b95566-f42a-4b73-aa01-0f7d1ee9b31d admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:27.378756 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b95566-f42a-4b73-aa01-0f7d1ee9b31d admin admin] PATH_INFO: `/v3/users/dfa1a7d3bbae4837b972c6ed0ebadcc0` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:27.379399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b95566-f42a-4b73-aa01-0f7d1ee9b31d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfa1a7d3bbae4837b972c6ed0ebadcc0)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:27.379399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b95566-f42a-4b73-aa01-0f7d1ee9b31d admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:27.403753 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f0e51e5b-e832-44c6-9f96-595e52721f28 admin admin] The token cache is being invalidate because project 76943b9450114e2e8ac0bc5ee59f3a9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:54:27.410275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f0e51e5b-e832-44c6-9f96-595e52721f28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:27.410275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f0e51e5b-e832-44c6-9f96-595e52721f28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:27.411289 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 855/1715] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:54:26 2022] DELETE /identity/v3/projects/76943b9450114e2e8ac0bc5ee59f3a9d => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:27.412279 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e51e5b-e832-44c6-9f96-595e52721f28 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:27.417477 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-f0e51e5b-e832-44c6-9f96-595e52721f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:27.453758 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e51e5b-e832-44c6-9f96-595e52721f28 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:27.461013 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed481380-6cb9-4b88-91d9-ab5b5f2d57d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:27.461641 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed481380-6cb9-4b88-91d9-ab5b5f2d57d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:27.462132 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed481380-6cb9-4b88-91d9-ab5b5f2d57d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:27.462590 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed481380-6cb9-4b88-91d9-ab5b5f2d57d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:27.463481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed481380-6cb9-4b88-91d9-ab5b5f2d57d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:27.465846 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed481380-6cb9-4b88-91d9-ab5b5f2d57d5 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:27.478259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 856/1716] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:27.482595 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed481380-6cb9-4b88-91d9-ab5b5f2d57d5 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:27.485375 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-ed481380-6cb9-4b88-91d9-ab5b5f2d57d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:27.601266 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed481380-6cb9-4b88-91d9-ab5b5f2d57d5 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:27.607457 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fc114-ba0a-4e3f-a371-f403e62e6a44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:27.608038 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fc114-ba0a-4e3f-a371-f403e62e6a44 service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:27.608459 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fc114-ba0a-4e3f-a371-f403e62e6a44 service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:27.608741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fc114-ba0a-4e3f-a371-f403e62e6a44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:27.610736 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-811fc114-ba0a-4e3f-a371-f403e62e6a44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:27.702376 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-56b95566-f42a-4b73-aa01-0f7d1ee9b31d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfa1a7d3bbae4837b972c6ed0ebadcc0'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:27.723200 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811fc114-ba0a-4e3f-a371-f403e62e6a44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:27.724965 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811fc114-ba0a-4e3f-a371-f403e62e6a44 service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:27.740337 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 857/1717] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:27.741405 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fc114-ba0a-4e3f-a371-f403e62e6a44 service nova] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:27.742913 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-811fc114-ba0a-4e3f-a371-f403e62e6a44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:27.761411 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fc114-ba0a-4e3f-a371-f403e62e6a44 service nova] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:27.768992 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c1727-cf48-42d0-b025-3f3951d5117c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:27.769948 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c1727-cf48-42d0-b025-3f3951d5117c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:27.770373 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c1727-cf48-42d0-b025-3f3951d5117c admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:27.770787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c1727-cf48-42d0-b025-3f3951d5117c admin admin] PATH_INFO: `/v3/users/e00e3fbc801d42879939b01493091667` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:27.772330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c1727-cf48-42d0-b025-3f3951d5117c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e00e3fbc801d42879939b01493091667)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:27.774665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c1727-cf48-42d0-b025-3f3951d5117c admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:27.823234 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-56b95566-f42a-4b73-aa01-0f7d1ee9b31d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfa1a7d3bbae4837b972c6ed0ebadcc0'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:27.846448 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-56b95566-f42a-4b73-aa01-0f7d1ee9b31d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfa1a7d3bbae4837b972c6ed0ebadcc0'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:27.884730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-56b95566-f42a-4b73-aa01-0f7d1ee9b31d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfa1a7d3bbae4837b972c6ed0ebadcc0'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:27.885868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-56b95566-f42a-4b73-aa01-0f7d1ee9b31d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfa1a7d3bbae4837b972c6ed0ebadcc0'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:27.902819 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 861/1718] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:54:27 2022] DELETE /identity/v3/users/dfa1a7d3bbae4837b972c6ed0ebadcc0 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:27.904142 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b95566-f42a-4b73-aa01-0f7d1ee9b31d admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:27.916104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-56b95566-f42a-4b73-aa01-0f7d1ee9b31d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:28.044389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f08c1727-cf48-42d0-b025-3f3951d5117c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e00e3fbc801d42879939b01493091667'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:28.046908 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f08c1727-cf48-42d0-b025-3f3951d5117c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e00e3fbc801d42879939b01493091667'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:28.082681 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f08c1727-cf48-42d0-b025-3f3951d5117c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e00e3fbc801d42879939b01493091667'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:28.087870 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b95566-f42a-4b73-aa01-0f7d1ee9b31d admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:28.095987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f08c1727-cf48-42d0-b025-3f3951d5117c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e00e3fbc801d42879939b01493091667'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:28.104171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e46af4-f62f-4bf5-9789-9263f66d9053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:28.105250 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e46af4-f62f-4bf5-9789-9263f66d9053 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:28.105718 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e46af4-f62f-4bf5-9789-9263f66d9053 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:28.106162 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e46af4-f62f-4bf5-9789-9263f66d9053 admin admin] PATH_INFO: `/v3/projects/b54abd54e1fb4b77b7e80b0ea7edc534/users/1c9b35bae3b844c3b04dc22140623ae0/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:28.125425 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e46af4-f62f-4bf5-9789-9263f66d9053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b54abd54e1fb4b77b7e80b0ea7edc534, user_id=1c9b35bae3b844c3b04dc22140623ae0, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:28.135734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e46af4-f62f-4bf5-9789-9263f66d9053 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:28.224090 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:28.226150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f08c1727-cf48-42d0-b025-3f3951d5117c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e00e3fbc801d42879939b01493091667'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:28.239058 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 862/1719] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:27 2022] PUT /identity/v3/projects/b54abd54e1fb4b77b7e80b0ea7edc534/users/1c9b35bae3b844c3b04dc22140623ae0/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:28.242239 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 858/1720] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:54:27 2022] DELETE /identity/v3/users/e00e3fbc801d42879939b01493091667 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:28.243005 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e46af4-f62f-4bf5-9789-9263f66d9053 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:28.255196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-f8e46af4-f62f-4bf5-9789-9263f66d9053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:28.258383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04577533-c22f-4e8e-831c-4ad837c44517 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:28.258739 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04577533-c22f-4e8e-831c-4ad837c44517 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:28.259109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04577533-c22f-4e8e-831c-4ad837c44517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:28.336452 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-04577533-c22f-4e8e-831c-4ad837c44517 None None] MFA Rules not processed for user `1c9b35bae3b844c3b04dc22140623ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:28.337865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-04577533-c22f-4e8e-831c-4ad837c44517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:28.355655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:28.451272 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e46af4-f62f-4bf5-9789-9263f66d9053 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:28.491551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 859/1721] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:28.494078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04577533-c22f-4e8e-831c-4ad837c44517 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:28.497207 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-04577533-c22f-4e8e-831c-4ad837c44517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:28.610543 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa4c54-2f6b-46aa-a568-7d5ab88601a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:28.611184 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa4c54-2f6b-46aa-a568-7d5ab88601a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:28.611561 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa4c54-2f6b-46aa-a568-7d5ab88601a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:28.611899 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa4c54-2f6b-46aa-a568-7d5ab88601a1 admin admin] PATH_INFO: `/v3/projects/7ac47c12ecb4482e85a7bdcee254be45` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:28.614379 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa4c54-2f6b-46aa-a568-7d5ab88601a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ac47c12ecb4482e85a7bdcee254be45)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:28.616429 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa4c54-2f6b-46aa-a568-7d5ab88601a1 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:28.708322 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04577533-c22f-4e8e-831c-4ad837c44517 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:28.717855 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ec9e2-5e7c-4a82-82df-fe2c0f806556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:28.718807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ec9e2-5e7c-4a82-82df-fe2c0f806556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:28.719306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ec9e2-5e7c-4a82-82df-fe2c0f806556 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:28.720589 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ec9e2-5e7c-4a82-82df-fe2c0f806556 admin admin] PATH_INFO: `/v3/projects/748ca97ad0c64c47ab21c2e6716de19b` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:28.734983 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ec9e2-5e7c-4a82-82df-fe2c0f806556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=748ca97ad0c64c47ab21c2e6716de19b)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:28.742101 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ec9e2-5e7c-4a82-82df-fe2c0f806556 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:28.843053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-9daa4c54-2f6b-46aa-a568-7d5ab88601a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ac47c12ecb4482e85a7bdcee254be45', 'request_id': 'req-9daa4c54-2f6b-46aa-a568-7d5ab88601a1'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:28.858128 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-9daa4c54-2f6b-46aa-a568-7d5ab88601a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ac47c12ecb4482e85a7bdcee254be45', 'request_id': 'req-9daa4c54-2f6b-46aa-a568-7d5ab88601a1'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:28.880012 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-232ec9e2-5e7c-4a82-82df-fe2c0f806556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '748ca97ad0c64c47ab21c2e6716de19b', 'request_id': 'req-232ec9e2-5e7c-4a82-82df-fe2c0f806556'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:28.889340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-232ec9e2-5e7c-4a82-82df-fe2c0f806556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '748ca97ad0c64c47ab21c2e6716de19b', 'request_id': 'req-232ec9e2-5e7c-4a82-82df-fe2c0f806556'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:28.899837 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-232ec9e2-5e7c-4a82-82df-fe2c0f806556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '748ca97ad0c64c47ab21c2e6716de19b', 'request_id': 'req-232ec9e2-5e7c-4a82-82df-fe2c0f806556'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:28.939764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-9daa4c54-2f6b-46aa-a568-7d5ab88601a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ac47c12ecb4482e85a7bdcee254be45', 'request_id': 'req-9daa4c54-2f6b-46aa-a568-7d5ab88601a1'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:28.958913 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-9daa4c54-2f6b-46aa-a568-7d5ab88601a1 admin admin] The token cache is being invalidate because project 7ac47c12ecb4482e85a7bdcee254be45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:54:28.959770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-9daa4c54-2f6b-46aa-a568-7d5ab88601a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:28.960743 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-9daa4c54-2f6b-46aa-a568-7d5ab88601a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:28.963161 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 863/1722] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:54:28 2022] DELETE /identity/v3/projects/7ac47c12ecb4482e85a7bdcee254be45 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:28.964580 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa4c54-2f6b-46aa-a568-7d5ab88601a1 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:28.966681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-9daa4c54-2f6b-46aa-a568-7d5ab88601a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:29.040691 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-232ec9e2-5e7c-4a82-82df-fe2c0f806556 admin admin] The token cache is being invalidate because project 748ca97ad0c64c47ab21c2e6716de19b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:54:29.040991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-232ec9e2-5e7c-4a82-82df-fe2c0f806556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:29.044500 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-232ec9e2-5e7c-4a82-82df-fe2c0f806556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:29.046567 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 860/1723] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:54:28 2022] DELETE /identity/v3/projects/748ca97ad0c64c47ab21c2e6716de19b => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:29.051004 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045dcf77-9ebb-4672-b8ed-840c22a5c7cb None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:29.051234 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045dcf77-9ebb-4672-b8ed-840c22a5c7cb None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:29.056398 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045dcf77-9ebb-4672-b8ed-840c22a5c7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:29.108371 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-045dcf77-9ebb-4672-b8ed-840c22a5c7cb None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:29.109851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-045dcf77-9ebb-4672-b8ed-840c22a5c7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:29.122994 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa4c54-2f6b-46aa-a568-7d5ab88601a1 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:29.266361 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 861/1724] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:29.274513 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045dcf77-9ebb-4672-b8ed-840c22a5c7cb None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:29.276162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-045dcf77-9ebb-4672-b8ed-840c22a5c7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:29.289080 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045dcf77-9ebb-4672-b8ed-840c22a5c7cb None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:29.294344 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a81e79-0da3-400f-b3d7-7479482a8584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:29.295405 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a81e79-0da3-400f-b3d7-7479482a8584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:29.295405 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a81e79-0da3-400f-b3d7-7479482a8584 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:29.295701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a81e79-0da3-400f-b3d7-7479482a8584 admin admin] PATH_INFO: `/v3/projects/2d6058eb4f4c4df99070417754b55edf` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:29.297191 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a81e79-0da3-400f-b3d7-7479482a8584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d6058eb4f4c4df99070417754b55edf)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:29.300815 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a81e79-0da3-400f-b3d7-7479482a8584 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:29.330386 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325e358-09ca-48b0-af32-073f2c2cd91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:29.331116 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325e358-09ca-48b0-af32-073f2c2cd91a admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:29.331995 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325e358-09ca-48b0-af32-073f2c2cd91a admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:29.332332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325e358-09ca-48b0-af32-073f2c2cd91a admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:29.333003 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325e358-09ca-48b0-af32-073f2c2cd91a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:29.337387 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325e358-09ca-48b0-af32-073f2c2cd91a admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:29.493219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 864/1725] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:28 2022] POST /identity/v3/projects => generated 387 bytes in 529 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:29.497225 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb97c7-a146-42d2-8b45-4da93783e166 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:29.497614 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb97c7-a146-42d2-8b45-4da93783e166 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:29.501430 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb97c7-a146-42d2-8b45-4da93783e166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:29.554402 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-30a81e79-0da3-400f-b3d7-7479482a8584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d6058eb4f4c4df99070417754b55edf', 'request_id': 'req-30a81e79-0da3-400f-b3d7-7479482a8584'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:29.570707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-30a81e79-0da3-400f-b3d7-7479482a8584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d6058eb4f4c4df99070417754b55edf', 'request_id': 'req-30a81e79-0da3-400f-b3d7-7479482a8584'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:29.581992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-c2eb97c7-a146-42d2-8b45-4da93783e166 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:29.588388 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c2eb97c7-a146-42d2-8b45-4da93783e166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:29.589451 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-30a81e79-0da3-400f-b3d7-7479482a8584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d6058eb4f4c4df99070417754b55edf', 'request_id': 'req-30a81e79-0da3-400f-b3d7-7479482a8584'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:29.752944 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-30a81e79-0da3-400f-b3d7-7479482a8584 admin admin] The token cache is being invalidate because project 2d6058eb4f4c4df99070417754b55edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:54:29.753464 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-30a81e79-0da3-400f-b3d7-7479482a8584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:29.754938 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-30a81e79-0da3-400f-b3d7-7479482a8584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:29.757080 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 862/1726] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:54:29 2022] DELETE /identity/v3/projects/2d6058eb4f4c4df99070417754b55edf => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:29.759099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e0473-362f-4901-9f54-2504288391ff None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:29.764808 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e0473-362f-4901-9f54-2504288391ff None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:29.765307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e0473-362f-4901-9f54-2504288391ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:29.805856 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 865/1727] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:29.811651 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c3ea5-297b-4cee-97dd-a2797dfc1af3 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:29.811979 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c3ea5-297b-4cee-97dd-a2797dfc1af3 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:29.812263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c3ea5-297b-4cee-97dd-a2797dfc1af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:29.862067 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-528e0473-362f-4901-9f54-2504288391ff None None] MFA Rules not processed for user `5a441adf6eee4ba78992aafbbf02f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:29.864358 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-635c3ea5-297b-4cee-97dd-a2797dfc1af3 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:29.865403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-528e0473-362f-4901-9f54-2504288391ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:29.865537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-635c3ea5-297b-4cee-97dd-a2797dfc1af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:29.888193 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 866/1728] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:29.889161 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c3ea5-297b-4cee-97dd-a2797dfc1af3 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:29.893056 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-635c3ea5-297b-4cee-97dd-a2797dfc1af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:29.949976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c3ea5-297b-4cee-97dd-a2797dfc1af3 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:29.956780 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22fca4-2f09-4099-8420-7f3e005a5448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:29.957789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22fca4-2f09-4099-8420-7f3e005a5448 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:29.958126 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22fca4-2f09-4099-8420-7f3e005a5448 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:29.958409 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22fca4-2f09-4099-8420-7f3e005a5448 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:29.959129 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d22fca4-2f09-4099-8420-7f3e005a5448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:29.962697 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d22fca4-2f09-4099-8420-7f3e005a5448 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:30.138608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 867/1729] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:29 2022] POST /identity/v3/users => generated 300 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:30.140553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369c97d-6c27-493f-a7a9-f81a4daaa1bd None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:30.147970 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369c97d-6c27-493f-a7a9-f81a4daaa1bd None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:30.147970 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369c97d-6c27-493f-a7a9-f81a4daaa1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:30.188266 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-5369c97d-6c27-493f-a7a9-f81a4daaa1bd None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:30.205844 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-5369c97d-6c27-493f-a7a9-f81a4daaa1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:30.237689 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 863/1730] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:30.237689 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d0ff1-6384-40e2-8c7a-93893c4a36f0 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:30.237689 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d0ff1-6384-40e2-8c7a-93893c4a36f0 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:30.237689 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d0ff1-6384-40e2-8c7a-93893c4a36f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:30.247018 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 868/1731] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:30.247018 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369c97d-6c27-493f-a7a9-f81a4daaa1bd None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:30.274031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:30.321008 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369c97d-6c27-493f-a7a9-f81a4daaa1bd None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:30.344521 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc695c-9576-4762-9e9d-3871e5ae4bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:30.345823 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc695c-9576-4762-9e9d-3871e5ae4bdd admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:30.346123 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc695c-9576-4762-9e9d-3871e5ae4bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:30.346915 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc695c-9576-4762-9e9d-3871e5ae4bdd admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:30.347816 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc695c-9576-4762-9e9d-3871e5ae4bdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:54:30.348722 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc695c-9576-4762-9e9d-3871e5ae4bdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:30.355673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc695c-9576-4762-9e9d-3871e5ae4bdd admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:30.365180 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-0c5d0ff1-6384-40e2-8c7a-93893c4a36f0 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:30.365661 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:30.367228 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-0c5d0ff1-6384-40e2-8c7a-93893c4a36f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:30.397511 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 864/1732] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:30.397511 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592286b9-7907-4639-a6a2-b7e9292a933e None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:30.397511 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592286b9-7907-4639-a6a2-b7e9292a933e None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:30.397511 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592286b9-7907-4639-a6a2-b7e9292a933e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:30.403164 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 869/1733] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:54:30.404393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc695c-9576-4762-9e9d-3871e5ae4bdd admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:30.431752 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc695c-9576-4762-9e9d-3871e5ae4bdd admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:30.447230 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261dd833-a1d6-4ed4-a2db-ee2b54baad0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:30.448268 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261dd833-a1d6-4ed4-a2db-ee2b54baad0a admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:30.448743 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261dd833-a1d6-4ed4-a2db-ee2b54baad0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:30.449882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261dd833-a1d6-4ed4-a2db-ee2b54baad0a admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:30.450341 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261dd833-a1d6-4ed4-a2db-ee2b54baad0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:30.453266 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261dd833-a1d6-4ed4-a2db-ee2b54baad0a admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:30.487184 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-592286b9-7907-4639-a6a2-b7e9292a933e None None] MFA Rules not processed for user `90c2ce45096e4fb493314ad3af039724`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:30.488611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-592286b9-7907-4639-a6a2-b7e9292a933e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:30.501963 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 870/1734] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:30.504317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dbb28-e3cb-410e-adfd-e28f4292e5a5 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:30.504853 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dbb28-e3cb-410e-adfd-e28f4292e5a5 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:30.505319 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dbb28-e3cb-410e-adfd-e28f4292e5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:30.540284 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-b09dbb28-e3cb-410e-adfd-e28f4292e5a5 None None] MFA Rules not processed for user `5a441adf6eee4ba78992aafbbf02f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:30.541683 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b09dbb28-e3cb-410e-adfd-e28f4292e5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:30.567914 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 871/1735] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:30.569413 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb9752-06ef-470f-8e2a-d619506b73fa None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:30.570863 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb9752-06ef-470f-8e2a-d619506b73fa None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:30.571244 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb9752-06ef-470f-8e2a-d619506b73fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:30.596105 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 865/1736] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:30.597535 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592286b9-7907-4639-a6a2-b7e9292a933e None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:30.620349 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592286b9-7907-4639-a6a2-b7e9292a933e None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:30.627868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ec19d-3688-45f3-8d48-e82f347b292b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:30.628725 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ec19d-3688-45f3-8d48-e82f347b292b admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:30.629310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ec19d-3688-45f3-8d48-e82f347b292b admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:30.629746 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ec19d-3688-45f3-8d48-e82f347b292b admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:30.630668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ec19d-3688-45f3-8d48-e82f347b292b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:54:30.631107 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ec19d-3688-45f3-8d48-e82f347b292b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:30.633352 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ec19d-3688-45f3-8d48-e82f347b292b admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:30.638448 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-5dcb9752-06ef-470f-8e2a-d619506b73fa None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:30.639840 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-5dcb9752-06ef-470f-8e2a-d619506b73fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:30.666044 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 866/1737] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:54:30.667436 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ec19d-3688-45f3-8d48-e82f347b292b admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:30.669213 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 872/1738] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:30.670000 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb9752-06ef-470f-8e2a-d619506b73fa None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:30.686494 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ec19d-3688-45f3-8d48-e82f347b292b admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:30.690812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb9752-06ef-470f-8e2a-d619506b73fa None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:30.692220 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5550f7-fd95-431b-9d17-eb39647fac42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:30.693486 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5550f7-fd95-431b-9d17-eb39647fac42 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:30.693999 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5550f7-fd95-431b-9d17-eb39647fac42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:30.694478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5550f7-fd95-431b-9d17-eb39647fac42 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:30.695319 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5550f7-fd95-431b-9d17-eb39647fac42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:30.697561 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5550f7-fd95-431b-9d17-eb39647fac42 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:30.726536 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d42be-fd08-434a-ae78-17d1ee7e09dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:30.727499 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d42be-fd08-434a-ae78-17d1ee7e09dd admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:30.732154 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d42be-fd08-434a-ae78-17d1ee7e09dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:30.732154 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d42be-fd08-434a-ae78-17d1ee7e09dd admin admin] PATH_INFO: `/v3/projects/01fb419bdbf04c678ab58bf2e3712955/users/84fc812181144b94b290fb5ef091a574/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:30.757679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d42be-fd08-434a-ae78-17d1ee7e09dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=01fb419bdbf04c678ab58bf2e3712955, user_id=84fc812181144b94b290fb5ef091a574, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:30.760728 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d42be-fd08-434a-ae78-17d1ee7e09dd admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:30.790259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 867/1739] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:30 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:30.791401 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5550f7-fd95-431b-9d17-eb39647fac42 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:30.795690 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-bc5550f7-fd95-431b-9d17-eb39647fac42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:30.849516 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 873/1740] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:30 2022] PUT /identity/v3/projects/01fb419bdbf04c678ab58bf2e3712955/users/84fc812181144b94b290fb5ef091a574/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:30.851421 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347baea-fae5-4e8c-848e-c6d529eefd4f None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:30.851857 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347baea-fae5-4e8c-848e-c6d529eefd4f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:30.852275 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347baea-fae5-4e8c-848e-c6d529eefd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:30.876496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-5347baea-fae5-4e8c-848e-c6d529eefd4f None None] MFA Rules not processed for user `90c2ce45096e4fb493314ad3af039724`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:30.878280 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-5347baea-fae5-4e8c-848e-c6d529eefd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:31.010517 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 874/1741] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:31.012794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347baea-fae5-4e8c-848e-c6d529eefd4f None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:31.033098 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5550f7-fd95-431b-9d17-eb39647fac42 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:31.153209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6a3e4-588c-4545-b049-cbdb9f728ec0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:31.154458 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6a3e4-588c-4545-b049-cbdb9f728ec0 service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:31.154878 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6a3e4-588c-4545-b049-cbdb9f728ec0 service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:31.155400 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6a3e4-588c-4545-b049-cbdb9f728ec0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:31.173861 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347baea-fae5-4e8c-848e-c6d529eefd4f None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:31.184613 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906b86c-766f-44bf-862b-52019b89afae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:31.185695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906b86c-766f-44bf-862b-52019b89afae admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:31.189051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906b86c-766f-44bf-862b-52019b89afae admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:31.189051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906b86c-766f-44bf-862b-52019b89afae admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:31.189051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906b86c-766f-44bf-862b-52019b89afae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:31.192601 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906b86c-766f-44bf-862b-52019b89afae admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:31.236421 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6a3e4-588c-4545-b049-cbdb9f728ec0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:31.238106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6a3e4-588c-4545-b049-cbdb9f728ec0 service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:31.249123 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 868/1742] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:30 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:31.249995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6a3e4-588c-4545-b049-cbdb9f728ec0 service nova] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:31.272068 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6a3e4-588c-4545-b049-cbdb9f728ec0 service nova] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:31.285890 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb5167-7efd-408c-8fe9-6a12ebb4be72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:31.287082 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb5167-7efd-408c-8fe9-6a12ebb4be72 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:31.287558 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb5167-7efd-408c-8fe9-6a12ebb4be72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:31.287682 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb5167-7efd-408c-8fe9-6a12ebb4be72 admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:31.288534 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb5167-7efd-408c-8fe9-6a12ebb4be72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:54:31.288729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb5167-7efd-408c-8fe9-6a12ebb4be72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:31.291794 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb5167-7efd-408c-8fe9-6a12ebb4be72 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:31.316202 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 869/1743] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:54:31.317064 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb5167-7efd-408c-8fe9-6a12ebb4be72 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:31.329760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb5167-7efd-408c-8fe9-6a12ebb4be72 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:31.339712 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d65ae1-42b0-418a-b295-10cadc3b2e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:31.340309 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d65ae1-42b0-418a-b295-10cadc3b2e27 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:31.340586 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d65ae1-42b0-418a-b295-10cadc3b2e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:31.340853 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d65ae1-42b0-418a-b295-10cadc3b2e27 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:31.341492 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d65ae1-42b0-418a-b295-10cadc3b2e27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:31.343600 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d65ae1-42b0-418a-b295-10cadc3b2e27 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:31.353319 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 875/1744] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:31 2022] POST /identity/v3/projects => generated 379 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:31.355119 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906b86c-766f-44bf-862b-52019b89afae admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:31.466546 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906b86c-766f-44bf-862b-52019b89afae admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:31.479612 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 870/1745] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:31 2022] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:31.481113 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d65ae1-42b0-418a-b295-10cadc3b2e27 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:31.485468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-41d65ae1-42b0-418a-b295-10cadc3b2e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:31.490007 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd959a21-844f-4906-a7f2-90441d91ab2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:31.492576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd959a21-844f-4906-a7f2-90441d91ab2e admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:31.494816 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd959a21-844f-4906-a7f2-90441d91ab2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:31.495666 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd959a21-844f-4906-a7f2-90441d91ab2e admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:31.497584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd959a21-844f-4906-a7f2-90441d91ab2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:31.504079 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd959a21-844f-4906-a7f2-90441d91ab2e admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:31.529840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d65ae1-42b0-418a-b295-10cadc3b2e27 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:31.534911 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 876/1746] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:31.537230 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd959a21-844f-4906-a7f2-90441d91ab2e admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:31.560650 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd959a21-844f-4906-a7f2-90441d91ab2e admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:31.575270 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a6ff1-eb71-44c2-8496-4049ee871791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:31.577742 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a6ff1-eb71-44c2-8496-4049ee871791 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:31.578131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a6ff1-eb71-44c2-8496-4049ee871791 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:31.578506 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a6ff1-eb71-44c2-8496-4049ee871791 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:31.581753 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a6ff1-eb71-44c2-8496-4049ee871791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:31.585670 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a6ff1-eb71-44c2-8496-4049ee871791 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:31.663442 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8c1bf-9603-40bf-8c28-f4985f1bd22e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:31.664063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8c1bf-9603-40bf-8c28-f4985f1bd22e service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:31.664344 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8c1bf-9603-40bf-8c28-f4985f1bd22e service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:31.664616 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8c1bf-9603-40bf-8c28-f4985f1bd22e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:31.740262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda8c1bf-9603-40bf-8c28-f4985f1bd22e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:31.742304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda8c1bf-9603-40bf-8c28-f4985f1bd22e service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:31.755886 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 871/1747] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:31.756907 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8c1bf-9603-40bf-8c28-f4985f1bd22e service nova] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:31.771685 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8c1bf-9603-40bf-8c28-f4985f1bd22e service nova] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:31.787811 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 877/1748] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:31 2022] POST /identity/v3/projects => generated 401 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:31.788848 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a6ff1-eb71-44c2-8496-4049ee871791 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:31.800873 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4ec31-0a9c-4da4-b933-57d97eef17eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:31.801508 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4ec31-0a9c-4da4-b933-57d97eef17eb admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:31.801790 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4ec31-0a9c-4da4-b933-57d97eef17eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:31.802059 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4ec31-0a9c-4da4-b933-57d97eef17eb admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:31.802706 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4ec31-0a9c-4da4-b933-57d97eef17eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:31.811469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4ec31-0a9c-4da4-b933-57d97eef17eb admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:31.958084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a6ff1-eb71-44c2-8496-4049ee871791 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:31.968817 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 872/1749] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:31 2022] POST /identity/v3/users => generated 290 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:31.970046 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4ec31-0a9c-4da4-b933-57d97eef17eb admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:31.970341 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179d837-07db-4bb0-8699-f88f98d83832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:31.972249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179d837-07db-4bb0-8699-f88f98d83832 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:31.974224 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179d837-07db-4bb0-8699-f88f98d83832 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:31.974632 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179d837-07db-4bb0-8699-f88f98d83832 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:31.975398 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179d837-07db-4bb0-8699-f88f98d83832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:31.981506 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179d837-07db-4bb0-8699-f88f98d83832 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:32.008920 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 878/1750] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:32.010441 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4ec31-0a9c-4da4-b933-57d97eef17eb admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:32.011187 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179d837-07db-4bb0-8699-f88f98d83832 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:32.032540 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd29e3-6f79-415f-93a9-dcb45c69c362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:32.033228 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd29e3-6f79-415f-93a9-dcb45c69c362 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:32.033507 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd29e3-6f79-415f-93a9-dcb45c69c362 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:32.033780 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd29e3-6f79-415f-93a9-dcb45c69c362 admin admin] PATH_INFO: `/v3/projects/01fb419bdbf04c678ab58bf2e3712955/users/84fc812181144b94b290fb5ef091a574/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:32.035901 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd29e3-6f79-415f-93a9-dcb45c69c362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01fb419bdbf04c678ab58bf2e3712955, user_id=84fc812181144b94b290fb5ef091a574, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:32.039302 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179d837-07db-4bb0-8699-f88f98d83832 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:32.039406 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd29e3-6f79-415f-93a9-dcb45c69c362 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:32.048629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d7dba-b12a-46f0-bbd7-073767db180a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:32.049640 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d7dba-b12a-46f0-bbd7-073767db180a admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:32.051467 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d7dba-b12a-46f0-bbd7-073767db180a admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:32.051951 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d7dba-b12a-46f0-bbd7-073767db180a admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:32.067159 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d7dba-b12a-46f0-bbd7-073767db180a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:32.069721 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d7dba-b12a-46f0-bbd7-073767db180a admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:32.086672 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 873/1751] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:31 2022] PUT /identity/v3/projects/01fb419bdbf04c678ab58bf2e3712955/users/84fc812181144b94b290fb5ef091a574/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:32.099034 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd29e3-6f79-415f-93a9-dcb45c69c362 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:32.103231 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:32.199758 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd29e3-6f79-415f-93a9-dcb45c69c362 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:32.209364 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b9c02-614a-4bca-bb98-1cae80fdfa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:32.209364 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b9c02-614a-4bca-bb98-1cae80fdfa53 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:32.209364 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b9c02-614a-4bca-bb98-1cae80fdfa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:32.209364 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b9c02-614a-4bca-bb98-1cae80fdfa53 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:32.210191 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b9c02-614a-4bca-bb98-1cae80fdfa53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:32.211279 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b9c02-614a-4bca-bb98-1cae80fdfa53 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:32.228951 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 874/1752] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:32.228951 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b9c02-614a-4bca-bb98-1cae80fdfa53 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:32.239080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 879/1753] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:32 2022] POST /identity/v3/users => generated 301 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:32.239080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab0b47-2e96-4ef4-8a61-cb4298c10f3b None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:32.247075 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b9c02-614a-4bca-bb98-1cae80fdfa53 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:32.248029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab0b47-2e96-4ef4-8a61-cb4298c10f3b None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:32.248029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab0b47-2e96-4ef4-8a61-cb4298c10f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:32.248321 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42340cb-0b52-4b43-a198-7487fb557b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:32.248321 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42340cb-0b52-4b43-a198-7487fb557b49 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:32.248321 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42340cb-0b52-4b43-a198-7487fb557b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:32.248321 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42340cb-0b52-4b43-a198-7487fb557b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:32.248825 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42340cb-0b52-4b43-a198-7487fb557b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:32.249927 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42340cb-0b52-4b43-a198-7487fb557b49 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:32.300617 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 875/1754] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:32.307209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42340cb-0b52-4b43-a198-7487fb557b49 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:32.311962 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-85ab0b47-2e96-4ef4-8a61-cb4298c10f3b None None] MFA Rules not processed for user `84fc812181144b94b290fb5ef091a574`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:32.313805 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-85ab0b47-2e96-4ef4-8a61-cb4298c10f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:32.346243 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42340cb-0b52-4b43-a198-7487fb557b49 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:32.368239 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73876d2-e9e2-4136-bab3-ed5e2bd84eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:32.368977 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73876d2-e9e2-4136-bab3-ed5e2bd84eab admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:32.369475 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73876d2-e9e2-4136-bab3-ed5e2bd84eab admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:32.369961 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73876d2-e9e2-4136-bab3-ed5e2bd84eab admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:32.371207 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73876d2-e9e2-4136-bab3-ed5e2bd84eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:32.374476 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73876d2-e9e2-4136-bab3-ed5e2bd84eab admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:32.391050 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:32.410985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 876/1755] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:32.411533 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73876d2-e9e2-4136-bab3-ed5e2bd84eab admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:32.439065 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73876d2-e9e2-4136-bab3-ed5e2bd84eab admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:32.459236 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2050497-a6ed-4d68-98fe-cbb0d98d637e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:32.460310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2050497-a6ed-4d68-98fe-cbb0d98d637e admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:32.460812 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2050497-a6ed-4d68-98fe-cbb0d98d637e admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:32.461310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2050497-a6ed-4d68-98fe-cbb0d98d637e admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:32.462482 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2050497-a6ed-4d68-98fe-cbb0d98d637e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:32.465608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2050497-a6ed-4d68-98fe-cbb0d98d637e admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:32.516117 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 877/1756] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:32.518278 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2050497-a6ed-4d68-98fe-cbb0d98d637e admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:32.529541 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 880/1757] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:32 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:32.530951 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e751b-1be0-46e1-8ab4-ca081fc22016 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:32.531302 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e751b-1be0-46e1-8ab4-ca081fc22016 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:32.531617 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e751b-1be0-46e1-8ab4-ca081fc22016 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:32.536407 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 881/1758] 10.222.0.50 () {54 vars in 912 bytes} [Thu Sep 1 13:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:54:32.536407 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e751b-1be0-46e1-8ab4-ca081fc22016 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:32.550623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e751b-1be0-46e1-8ab4-ca081fc22016 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:32.556760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2050497-a6ed-4d68-98fe-cbb0d98d637e admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:32.557141 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94150f-7ea7-4089-bcb4-7037e9b3698c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:32.558335 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94150f-7ea7-4089-bcb4-7037e9b3698c admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:32.558818 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94150f-7ea7-4089-bcb4-7037e9b3698c admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:32.559261 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94150f-7ea7-4089-bcb4-7037e9b3698c admin admin] PATH_INFO: `/v3/projects/6aea8f9877ff449fa3d298a131e52094/users/b4d1d4e0d2e5453c8c4be1b04da372a9/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:32.577934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1a028-0624-400f-867f-42e79761e051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:32.579128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1a028-0624-400f-867f-42e79761e051 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:32.579733 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1a028-0624-400f-867f-42e79761e051 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:32.580218 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1a028-0624-400f-867f-42e79761e051 admin admin] PATH_INFO: `/v3/projects/e4e4f0384b384f1cab9d269eb98f6a1e/users/eeb6e1ba61124ec89df43363d6ac5a60/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:32.583610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94150f-7ea7-4089-bcb4-7037e9b3698c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aea8f9877ff449fa3d298a131e52094, user_id=b4d1d4e0d2e5453c8c4be1b04da372a9, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:32.587401 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94150f-7ea7-4089-bcb4-7037e9b3698c admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:32.617965 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1a028-0624-400f-867f-42e79761e051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4e4f0384b384f1cab9d269eb98f6a1e, user_id=eeb6e1ba61124ec89df43363d6ac5a60, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:32.634694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1a028-0624-400f-867f-42e79761e051 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:32.671448 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 882/1759] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:32 2022] PUT /identity/v3/projects/6aea8f9877ff449fa3d298a131e52094/users/b4d1d4e0d2e5453c8c4be1b04da372a9/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:32.671448 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94150f-7ea7-4089-bcb4-7037e9b3698c admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:32.751961 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 878/1760] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:32 2022] PUT /identity/v3/projects/e4e4f0384b384f1cab9d269eb98f6a1e/users/eeb6e1ba61124ec89df43363d6ac5a60/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:32.757537 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d52236-3e95-4780-ae8c-39eeb76da565 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:32.758123 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d52236-3e95-4780-ae8c-39eeb76da565 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:32.758674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d52236-3e95-4780-ae8c-39eeb76da565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:32.780447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94150f-7ea7-4089-bcb4-7037e9b3698c admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:32.824523 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-a2d52236-3e95-4780-ae8c-39eeb76da565 None None] MFA Rules not processed for user `72f0d372f6c34d1a9a990222d6b98948`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:32.825725 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a2d52236-3e95-4780-ae8c-39eeb76da565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:32.925839 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 879/1761] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 1 13:54:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:32.926776 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d52236-3e95-4780-ae8c-39eeb76da565 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:32.934308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a2d52236-3e95-4780-ae8c-39eeb76da565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:32.934686 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1541a18-a157-4c55-a9ca-833cb858b31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:32.934686 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1541a18-a157-4c55-a9ca-833cb858b31a admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:32.934686 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1541a18-a157-4c55-a9ca-833cb858b31a admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:32.934686 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1541a18-a157-4c55-a9ca-833cb858b31a admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:32.935243 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1541a18-a157-4c55-a9ca-833cb858b31a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:32.935243 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1541a18-a157-4c55-a9ca-833cb858b31a admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:32.963037 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 883/1762] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:32.964540 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece77993-d1c2-470b-92cb-fcdd44140c96 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:32.964781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece77993-d1c2-470b-92cb-fcdd44140c96 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:32.965067 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece77993-d1c2-470b-92cb-fcdd44140c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:33.033782 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d52236-3e95-4780-ae8c-39eeb76da565 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:33.034237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-ece77993-d1c2-470b-92cb-fcdd44140c96 None None] MFA Rules not processed for user `b4d1d4e0d2e5453c8c4be1b04da372a9`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:33.038667 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d61c8-1eaf-476f-8a1d-6cfcd1a7f446 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:33.039315 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d61c8-1eaf-476f-8a1d-6cfcd1a7f446 service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:33.039631 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d61c8-1eaf-476f-8a1d-6cfcd1a7f446 service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:33.039911 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d61c8-1eaf-476f-8a1d-6cfcd1a7f446 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:33.040111 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ece77993-d1c2-470b-92cb-fcdd44140c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:33.164627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 884/1763] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:33.167023 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b352d7-42ec-42ca-810b-8aef60367c72 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:33.167573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b352d7-42ec-42ca-810b-8aef60367c72 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:33.168613 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b352d7-42ec-42ca-810b-8aef60367c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:33.199328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d61c8-1eaf-476f-8a1d-6cfcd1a7f446 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:33.201066 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d61c8-1eaf-476f-8a1d-6cfcd1a7f446 service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:33.220067 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:33.228189 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 880/1764] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:32 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:33.229182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d61c8-1eaf-476f-8a1d-6cfcd1a7f446 service cinder] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:33.253520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-659d61c8-1eaf-476f-8a1d-6cfcd1a7f446 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:33.257553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-f9b352d7-42ec-42ca-810b-8aef60367c72 None None] MFA Rules not processed for user `eeb6e1ba61124ec89df43363d6ac5a60`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:33.259659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-f9b352d7-42ec-42ca-810b-8aef60367c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:33.295930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d61c8-1eaf-476f-8a1d-6cfcd1a7f446 service cinder] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:33.306409 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f6631-5a5c-426b-ae09-54416a699a5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:33.308398 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f6631-5a5c-426b-ae09-54416a699a5a service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:33.308398 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f6631-5a5c-426b-ae09-54416a699a5a service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:33.308398 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f6631-5a5c-426b-ae09-54416a699a5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:33.324911 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f6631-5a5c-426b-ae09-54416a699a5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:33.326739 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f6631-5a5c-426b-ae09-54416a699a5a service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:33.366469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 881/1765] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:33.370939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f6631-5a5c-426b-ae09-54416a699a5a service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:33.396085 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f6631-5a5c-426b-ae09-54416a699a5a service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:33.410027 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f98c9-8817-46b3-b19d-ef743ab480f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:33.410839 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f98c9-8817-46b3-b19d-ef743ab480f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:33.411195 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f98c9-8817-46b3-b19d-ef743ab480f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:33.411602 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f98c9-8817-46b3-b19d-ef743ab480f2 admin admin] PATH_INFO: `/v3/projects/7cd226ed69604b8281bac05b3df45659/users/58e06922dcde4f3c9eddf05cc826abfc/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:33.457705 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f98c9-8817-46b3-b19d-ef743ab480f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cd226ed69604b8281bac05b3df45659, user_id=58e06922dcde4f3c9eddf05cc826abfc, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:33.465130 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f98c9-8817-46b3-b19d-ef743ab480f2 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:33.471891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 885/1766] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:33.473337 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b352d7-42ec-42ca-810b-8aef60367c72 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:33.504374 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b352d7-42ec-42ca-810b-8aef60367c72 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:33.509584 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:33.537859 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca2340-65fb-4219-bcd4-682b54e89faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:33.543456 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca2340-65fb-4219-bcd4-682b54e89faa admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:33.545846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca2340-65fb-4219-bcd4-682b54e89faa admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:33.546751 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca2340-65fb-4219-bcd4-682b54e89faa admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:33.548174 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca2340-65fb-4219-bcd4-682b54e89faa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:33.571056 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 882/1767] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:33 2022] PUT /identity/v3/projects/7cd226ed69604b8281bac05b3df45659/users/58e06922dcde4f3c9eddf05cc826abfc/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:33.572722 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aff355-6bd9-47f4-b178-6a899571ba42 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:33.573395 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aff355-6bd9-47f4-b178-6a899571ba42 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:33.573866 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aff355-6bd9-47f4-b178-6a899571ba42 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:33.576903 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca2340-65fb-4219-bcd4-682b54e89faa admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:33.580256 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 883/1768] 10.222.0.50 () {54 vars in 912 bytes} [Thu Sep 1 13:54:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:54:33.582781 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aff355-6bd9-47f4-b178-6a899571ba42 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:33.714306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aff355-6bd9-47f4-b178-6a899571ba42 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:33.719999 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eba70c-10c3-46c4-b2d0-46f9dcf3d5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:33.720813 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eba70c-10c3-46c4-b2d0-46f9dcf3d5ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:33.721188 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eba70c-10c3-46c4-b2d0-46f9dcf3d5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:33.721562 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eba70c-10c3-46c4-b2d0-46f9dcf3d5ef admin admin] PATH_INFO: `/v3/users/1c9b35bae3b844c3b04dc22140623ae0` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:33.723181 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eba70c-10c3-46c4-b2d0-46f9dcf3d5ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c9b35bae3b844c3b04dc22140623ae0)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:33.725876 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eba70c-10c3-46c4-b2d0-46f9dcf3d5ef admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:33.775518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 886/1769] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:33 2022] POST /identity/v3/projects => generated 381 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:33.775518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca2340-65fb-4219-bcd4-682b54e89faa admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:33.959619 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f3eba70c-10c3-46c4-b2d0-46f9dcf3d5ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c9b35bae3b844c3b04dc22140623ae0'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:33.961232 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f3eba70c-10c3-46c4-b2d0-46f9dcf3d5ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c9b35bae3b844c3b04dc22140623ae0'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:33.991059 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f3eba70c-10c3-46c4-b2d0-46f9dcf3d5ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c9b35bae3b844c3b04dc22140623ae0'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:33.992909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca2340-65fb-4219-bcd4-682b54e89faa admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:34.003334 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5ee0e-650c-4bc0-a107-3ea1aee3ed96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:34.009666 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5ee0e-650c-4bc0-a107-3ea1aee3ed96 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:34.009953 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5ee0e-650c-4bc0-a107-3ea1aee3ed96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:34.010235 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5ee0e-650c-4bc0-a107-3ea1aee3ed96 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:34.011764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5ee0e-650c-4bc0-a107-3ea1aee3ed96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:34.013293 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f3eba70c-10c3-46c4-b2d0-46f9dcf3d5ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c9b35bae3b844c3b04dc22140623ae0'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:34.017733 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5ee0e-650c-4bc0-a107-3ea1aee3ed96 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:34.141254 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f3eba70c-10c3-46c4-b2d0-46f9dcf3d5ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c9b35bae3b844c3b04dc22140623ae0'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:34.155280 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 884/1770] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:54:33 2022] DELETE /identity/v3/users/1c9b35bae3b844c3b04dc22140623ae0 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:34.155989 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 887/1771] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:33 2022] POST /identity/v3/projects => generated 371 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:34.158380 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24391224-ea1b-4396-ab0e-5bfd58eddd7a None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:34.158671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24391224-ea1b-4396-ab0e-5bfd58eddd7a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:34.158940 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb6876-4578-4bd7-9496-e9ed94a56b29 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:34.159397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb6876-4578-4bd7-9496-e9ed94a56b29 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:34.159765 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb6876-4578-4bd7-9496-e9ed94a56b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:34.160497 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24391224-ea1b-4396-ab0e-5bfd58eddd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:34.200285 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-24391224-ea1b-4396-ab0e-5bfd58eddd7a None None] MFA Rules not processed for user `58e06922dcde4f3c9eddf05cc826abfc`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:34.200852 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-2dfb6876-4578-4bd7-9496-e9ed94a56b29 None None] MFA Rules not processed for user `72f0d372f6c34d1a9a990222d6b98948`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:34.201580 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-24391224-ea1b-4396-ab0e-5bfd58eddd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:34.202653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-2dfb6876-4578-4bd7-9496-e9ed94a56b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:34.328627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 888/1772] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:34 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:34.329973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24391224-ea1b-4396-ab0e-5bfd58eddd7a None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:34.334090 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-24391224-ea1b-4396-ab0e-5bfd58eddd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:34.372761 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 885/1773] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 1 13:54:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:34.374336 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fac2a-e493-4df1-ad93-66b4627128ed None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:34.374786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fac2a-e493-4df1-ad93-66b4627128ed None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:34.375134 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fac2a-e493-4df1-ad93-66b4627128ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:34.398106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-7d0fac2a-e493-4df1-ad93-66b4627128ed None None] MFA Rules not processed for user `e35ebc3dbc1f4f348f97041627fc68b9`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:34.399742 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-7d0fac2a-e493-4df1-ad93-66b4627128ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:34.471649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24391224-ea1b-4396-ab0e-5bfd58eddd7a None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:34.478207 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 886/1774] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:34.479718 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9ce37-395f-41ef-a359-ac5c5e3ce606 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:34.480008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9ce37-395f-41ef-a359-ac5c5e3ce606 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:34.480403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9ce37-395f-41ef-a359-ac5c5e3ce606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:34.480519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671735e-ba6c-480d-807c-409c8da53d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:34.487416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671735e-ba6c-480d-807c-409c8da53d86 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:34.487416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671735e-ba6c-480d-807c-409c8da53d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:34.487416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671735e-ba6c-480d-807c-409c8da53d86 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:34.487416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671735e-ba6c-480d-807c-409c8da53d86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:34.487416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671735e-ba6c-480d-807c-409c8da53d86 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:34.505923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-9fc9ce37-395f-41ef-a359-ac5c5e3ce606 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:34.507136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-9fc9ce37-395f-41ef-a359-ac5c5e3ce606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:34.515937 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 887/1775] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:34.516830 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9ce37-395f-41ef-a359-ac5c5e3ce606 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:34.518329 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-9fc9ce37-395f-41ef-a359-ac5c5e3ce606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:34.530647 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9ce37-395f-41ef-a359-ac5c5e3ce606 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:34.537390 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3e7fc-5def-4828-a1fd-f410af0f7975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:34.538128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3e7fc-5def-4828-a1fd-f410af0f7975 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:34.538603 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3e7fc-5def-4828-a1fd-f410af0f7975 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:34.538930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3e7fc-5def-4828-a1fd-f410af0f7975 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:34.539730 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3e7fc-5def-4828-a1fd-f410af0f7975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:34.541584 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3e7fc-5def-4828-a1fd-f410af0f7975 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:34.570417 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 889/1776] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:34 2022] POST /identity/v3/users => generated 297 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:34.572738 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671735e-ba6c-480d-807c-409c8da53d86 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:34.578609 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-e671735e-ba6c-480d-807c-409c8da53d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:34.591537 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671735e-ba6c-480d-807c-409c8da53d86 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:34.596223 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788e5d6-5424-4796-936d-16fb06a5c495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:34.596826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788e5d6-5424-4796-936d-16fb06a5c495 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:34.597103 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788e5d6-5424-4796-936d-16fb06a5c495 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:34.597373 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788e5d6-5424-4796-936d-16fb06a5c495 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:34.597996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788e5d6-5424-4796-936d-16fb06a5c495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:34.599939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788e5d6-5424-4796-936d-16fb06a5c495 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:34.649116 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 888/1777] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:34 2022] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:34.650288 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3e7fc-5def-4828-a1fd-f410af0f7975 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:34.653626 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b5f3e7fc-5def-4828-a1fd-f410af0f7975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:34.668853 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3e7fc-5def-4828-a1fd-f410af0f7975 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:34.672905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3159c8-05f6-4cf4-9928-43f352124853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:34.673750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3159c8-05f6-4cf4-9928-43f352124853 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:34.674033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3159c8-05f6-4cf4-9928-43f352124853 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:34.682153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3159c8-05f6-4cf4-9928-43f352124853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:34.683481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3159c8-05f6-4cf4-9928-43f352124853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:34.685064 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3159c8-05f6-4cf4-9928-43f352124853 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:34.698554 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 889/1778] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:34.699745 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3159c8-05f6-4cf4-9928-43f352124853 service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:34.705778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-ad3159c8-05f6-4cf4-9928-43f352124853 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:34.758055 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 890/1779] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:34 2022] POST /identity/v3/projects => generated 401 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:34.758055 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6687e4b-5654-42a2-b9f3-29209b4f8a20 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:34.758300 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6687e4b-5654-42a2-b9f3-29209b4f8a20 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:34.758584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6687e4b-5654-42a2-b9f3-29209b4f8a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:34.795387 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-d6687e4b-5654-42a2-b9f3-29209b4f8a20 None None] MFA Rules not processed for user `5a441adf6eee4ba78992aafbbf02f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:34.796640 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-d6687e4b-5654-42a2-b9f3-29209b4f8a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:34.812131 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3159c8-05f6-4cf4-9928-43f352124853 service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:34.833081 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:34.907718 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 891/1780] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:34.910376 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6687e4b-5654-42a2-b9f3-29209b4f8a20 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:34.945928 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09478654-d951-47a1-94b1-6f6b8adc28be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e675d44d2c49929feb0ec0d2c0d0eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:34.947614 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09478654-d951-47a1-94b1-6f6b8adc28be service placement] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:34.948131 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09478654-d951-47a1-94b1-6f6b8adc28be service placement] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:34.948476 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09478654-d951-47a1-94b1-6f6b8adc28be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:34.952674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-09478654-d951-47a1-94b1-6f6b8adc28be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:34.992102 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:34.999525 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09478654-d951-47a1-94b1-6f6b8adc28be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:35.009964 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09478654-d951-47a1-94b1-6f6b8adc28be service placement] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:35.023309 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 890/1781] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:35.024344 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09478654-d951-47a1-94b1-6f6b8adc28be service placement] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:35.050112 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6687e4b-5654-42a2-b9f3-29209b4f8a20 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:35.056573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863498c8-2cd9-4853-beac-1c54395f280e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:35.057601 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863498c8-2cd9-4853-beac-1c54395f280e service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:35.058036 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863498c8-2cd9-4853-beac-1c54395f280e service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:35.058995 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863498c8-2cd9-4853-beac-1c54395f280e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:35.188844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09478654-d951-47a1-94b1-6f6b8adc28be service placement] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:35.200965 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b5692-d3db-4d24-9ba0-64791f238302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:35.201708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b5692-d3db-4d24-9ba0-64791f238302 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:35.202123 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b5692-d3db-4d24-9ba0-64791f238302 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:35.202504 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b5692-d3db-4d24-9ba0-64791f238302 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:35.203510 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b5692-d3db-4d24-9ba0-64791f238302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:35.205941 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b5692-d3db-4d24-9ba0-64791f238302 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:35.223122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 891/1782] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:35.223305 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863498c8-2cd9-4853-beac-1c54395f280e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:35.223419 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b5692-d3db-4d24-9ba0-64791f238302 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:35.223502 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863498c8-2cd9-4853-beac-1c54395f280e service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:35.247976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 892/1783] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:35.248994 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863498c8-2cd9-4853-beac-1c54395f280e service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:35.261646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863498c8-2cd9-4853-beac-1c54395f280e service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:35.269035 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b5692-d3db-4d24-9ba0-64791f238302 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:35.270807 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41229857-58f0-4741-bbe4-3c218eb89144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:35.271774 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41229857-58f0-4741-bbe4-3c218eb89144 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:35.272598 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41229857-58f0-4741-bbe4-3c218eb89144 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:35.272984 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41229857-58f0-4741-bbe4-3c218eb89144 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:35.273864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41229857-58f0-4741-bbe4-3c218eb89144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:35.277321 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41229857-58f0-4741-bbe4-3c218eb89144 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:35.293393 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee1e04-3952-4e85-9a5a-8a6dcff905a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:35.294015 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee1e04-3952-4e85-9a5a-8a6dcff905a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:35.294302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee1e04-3952-4e85-9a5a-8a6dcff905a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:35.294584 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee1e04-3952-4e85-9a5a-8a6dcff905a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:35.295276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee1e04-3952-4e85-9a5a-8a6dcff905a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:35.297036 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee1e04-3952-4e85-9a5a-8a6dcff905a5 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:35.316043 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 892/1784] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:35.317513 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee1e04-3952-4e85-9a5a-8a6dcff905a5 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:35.359255 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee1e04-3952-4e85-9a5a-8a6dcff905a5 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:35.376010 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45826389-d78f-47ed-ae8d-2d0b737ef62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:35.376656 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45826389-d78f-47ed-ae8d-2d0b737ef62e admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:35.378814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45826389-d78f-47ed-ae8d-2d0b737ef62e admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:35.379600 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45826389-d78f-47ed-ae8d-2d0b737ef62e admin admin] PATH_INFO: `/v3/projects/7ce4871c67d2425ab973e66fa31d78a9/users/2a1b175677464b1a8dae0aacaa7ded7e/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:35.391327 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 893/1785] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:35 2022] POST /identity/v3/users => generated 307 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:35.392988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41229857-58f0-4741-bbe4-3c218eb89144 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:35.416400 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41229857-58f0-4741-bbe4-3c218eb89144 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:35.423122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45826389-d78f-47ed-ae8d-2d0b737ef62e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce4871c67d2425ab973e66fa31d78a9, user_id=2a1b175677464b1a8dae0aacaa7ded7e, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:35.448100 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45826389-d78f-47ed-ae8d-2d0b737ef62e admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:35.461998 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53f2ca-778c-4ccd-a592-79fad7fbdc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:35.463482 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53f2ca-778c-4ccd-a592-79fad7fbdc6f admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:35.470376 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53f2ca-778c-4ccd-a592-79fad7fbdc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:35.470639 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53f2ca-778c-4ccd-a592-79fad7fbdc6f admin admin] PATH_INFO: `/v3/projects/7a4afb03ec084139b1555ff9f30d95ae/users/b60e416e2a5945538e4bbfa9d21c2816/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:35.520524 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53f2ca-778c-4ccd-a592-79fad7fbdc6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a4afb03ec084139b1555ff9f30d95ae, user_id=b60e416e2a5945538e4bbfa9d21c2816, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:35.523247 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53f2ca-778c-4ccd-a592-79fad7fbdc6f admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:35.641938 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 893/1786] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:35 2022] PUT /identity/v3/projects/7ce4871c67d2425ab973e66fa31d78a9/users/2a1b175677464b1a8dae0aacaa7ded7e/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:35.643132 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45826389-d78f-47ed-ae8d-2d0b737ef62e admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:35.680274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 894/1787] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:35 2022] PUT /identity/v3/projects/7a4afb03ec084139b1555ff9f30d95ae/users/b60e416e2a5945538e4bbfa9d21c2816/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:35.681166 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53f2ca-778c-4ccd-a592-79fad7fbdc6f admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:35.842078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45826389-d78f-47ed-ae8d-2d0b737ef62e admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:35.877069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53f2ca-778c-4ccd-a592-79fad7fbdc6f admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:35.904264 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4ccf7-8257-4957-b260-b7ce5c00b7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:35.905906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4ccf7-8257-4957-b260-b7ce5c00b7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:35.906263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4ccf7-8257-4957-b260-b7ce5c00b7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:35.906637 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4ccf7-8257-4957-b260-b7ce5c00b7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:35.914342 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4ccf7-8257-4957-b260-b7ce5c00b7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:35.920068 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4ccf7-8257-4957-b260-b7ce5c00b7c4 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:35.947971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 895/1788] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:35.949274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4ccf7-8257-4957-b260-b7ce5c00b7c4 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:35.965845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4ccf7-8257-4957-b260-b7ce5c00b7c4 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:35.972887 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32695295-98c7-4e4c-a09a-fb0add0e7716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:35.974302 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32695295-98c7-4e4c-a09a-fb0add0e7716 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:35.975167 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32695295-98c7-4e4c-a09a-fb0add0e7716 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:35.975842 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32695295-98c7-4e4c-a09a-fb0add0e7716 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:35.976780 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32695295-98c7-4e4c-a09a-fb0add0e7716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:35.980361 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32695295-98c7-4e4c-a09a-fb0add0e7716 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:36.003903 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 896/1789] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:36.004944 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32695295-98c7-4e4c-a09a-fb0add0e7716 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:36.023695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32695295-98c7-4e4c-a09a-fb0add0e7716 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:36.027788 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3439e0-0f87-450c-a91f-edb9726b4b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:36.028639 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3439e0-0f87-450c-a91f-edb9726b4b6b admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:36.029267 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3439e0-0f87-450c-a91f-edb9726b4b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:36.029823 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3439e0-0f87-450c-a91f-edb9726b4b6b admin admin] PATH_INFO: `/v3/projects/7ce4871c67d2425ab973e66fa31d78a9/users/2a1b175677464b1a8dae0aacaa7ded7e/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:36.035996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3439e0-0f87-450c-a91f-edb9726b4b6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce4871c67d2425ab973e66fa31d78a9, user_id=2a1b175677464b1a8dae0aacaa7ded7e, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:36.039106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3439e0-0f87-450c-a91f-edb9726b4b6b admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:36.056263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:36.062911 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 897/1790] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:36 2022] PUT /identity/v3/projects/7ce4871c67d2425ab973e66fa31d78a9/users/2a1b175677464b1a8dae0aacaa7ded7e/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:36.069931 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3439e0-0f87-450c-a91f-edb9726b4b6b admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:36.085516 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0865c-c3b3-43e3-aadd-8dbbf249abca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:36.086406 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0865c-c3b3-43e3-aadd-8dbbf249abca admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:36.086828 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0865c-c3b3-43e3-aadd-8dbbf249abca admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:36.087268 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0865c-c3b3-43e3-aadd-8dbbf249abca admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:36.088084 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0865c-c3b3-43e3-aadd-8dbbf249abca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:36.089877 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0865c-c3b3-43e3-aadd-8dbbf249abca admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:36.118689 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 894/1791] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:36.123161 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1289e-81e5-403d-92c0-d964ad017013 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:36.123683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1289e-81e5-403d-92c0-d964ad017013 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:36.124127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1289e-81e5-403d-92c0-d964ad017013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:36.202639 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-fec1289e-81e5-403d-92c0-d964ad017013 None None] MFA Rules not processed for user `2a1b175677464b1a8dae0aacaa7ded7e`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:36.204601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-fec1289e-81e5-403d-92c0-d964ad017013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:36.283067 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:36.315205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3439e0-0f87-450c-a91f-edb9726b4b6b admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:36.317205 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 895/1792] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:36 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:36.318294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1289e-81e5-403d-92c0-d964ad017013 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:36.329353 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982851a9-87ae-49bd-915e-2f76a9eaedb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:36.330838 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982851a9-87ae-49bd-915e-2f76a9eaedb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:36.331344 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982851a9-87ae-49bd-915e-2f76a9eaedb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:36.331705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982851a9-87ae-49bd-915e-2f76a9eaedb4 admin admin] PATH_INFO: `/v3/projects/7a4afb03ec084139b1555ff9f30d95ae/users/b60e416e2a5945538e4bbfa9d21c2816/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:36.332191 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1289e-81e5-403d-92c0-d964ad017013 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:36.334830 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982851a9-87ae-49bd-915e-2f76a9eaedb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a4afb03ec084139b1555ff9f30d95ae, user_id=b60e416e2a5945538e4bbfa9d21c2816, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:36.338318 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913be8f-746f-40a5-8d89-f9bcada7e35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:36.339000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913be8f-746f-40a5-8d89-f9bcada7e35b admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:36.339345 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913be8f-746f-40a5-8d89-f9bcada7e35b admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:36.339566 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982851a9-87ae-49bd-915e-2f76a9eaedb4 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:36.339690 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913be8f-746f-40a5-8d89-f9bcada7e35b admin admin] PATH_INFO: `/v3/projects/30d60d86e5ac4ef987bced2c88c86a3f/users/8053b69b3d8045be8182d37eed6862f5/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:36.354769 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 898/1793] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:36 2022] PUT /identity/v3/projects/7a4afb03ec084139b1555ff9f30d95ae/users/b60e416e2a5945538e4bbfa9d21c2816/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:36.355549 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982851a9-87ae-49bd-915e-2f76a9eaedb4 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:36.358085 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913be8f-746f-40a5-8d89-f9bcada7e35b admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d60d86e5ac4ef987bced2c88c86a3f, user_id=8053b69b3d8045be8182d37eed6862f5, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:36.361548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913be8f-746f-40a5-8d89-f9bcada7e35b admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:36.367317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-982851a9-87ae-49bd-915e-2f76a9eaedb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:36.433678 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982851a9-87ae-49bd-915e-2f76a9eaedb4 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:36.437875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4e73f-33a6-4858-b1de-7f8484604b53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:36.439755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4e73f-33a6-4858-b1de-7f8484604b53 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:36.440061 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4e73f-33a6-4858-b1de-7f8484604b53 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:36.440341 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4e73f-33a6-4858-b1de-7f8484604b53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:36.492246 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 896/1794] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:36 2022] PUT /identity/v3/projects/30d60d86e5ac4ef987bced2c88c86a3f/users/8053b69b3d8045be8182d37eed6862f5/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:36.496221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd24404-0d50-4a5f-b66d-434e3e93ef5e None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:36.496624 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd24404-0d50-4a5f-b66d-434e3e93ef5e None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:36.497570 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd24404-0d50-4a5f-b66d-434e3e93ef5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:36.542758 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f4e73f-33a6-4858-b1de-7f8484604b53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:36.544617 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-abd24404-0d50-4a5f-b66d-434e3e93ef5e None None] MFA Rules not processed for user `b60e416e2a5945538e4bbfa9d21c2816`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:36.545054 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f4e73f-33a6-4858-b1de-7f8484604b53 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:36.547109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-abd24404-0d50-4a5f-b66d-434e3e93ef5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:36.576872 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 899/1795] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:36.577753 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4e73f-33a6-4858-b1de-7f8484604b53 service cinder] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:36.668369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 897/1796] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:36.669432 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd24404-0d50-4a5f-b66d-434e3e93ef5e None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:36.670736 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-abd24404-0d50-4a5f-b66d-434e3e93ef5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:36.686497 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4e73f-33a6-4858-b1de-7f8484604b53 service cinder] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:36.768468 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3979a-53b1-457c-a672-d921dfe16d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:36.770137 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3979a-53b1-457c-a672-d921dfe16d32 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:36.770137 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3979a-53b1-457c-a672-d921dfe16d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:36.770137 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3979a-53b1-457c-a672-d921dfe16d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:36.770473 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3979a-53b1-457c-a672-d921dfe16d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:36.771879 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd24404-0d50-4a5f-b66d-434e3e93ef5e None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:36.772302 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3979a-53b1-457c-a672-d921dfe16d32 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:36.786919 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e530b9-afdd-4d22-b7e4-c0161f848972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:36.787122 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 900/1797] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:36.787728 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e530b9-afdd-4d22-b7e4-c0161f848972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:36.787960 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e530b9-afdd-4d22-b7e4-c0161f848972 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:36.788241 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e530b9-afdd-4d22-b7e4-c0161f848972 admin admin] PATH_INFO: `/v3/projects/b54abd54e1fb4b77b7e80b0ea7edc534` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:36.788341 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3979a-53b1-457c-a672-d921dfe16d32 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:36.789598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e530b9-afdd-4d22-b7e4-c0161f848972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b54abd54e1fb4b77b7e80b0ea7edc534)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:36.790372 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-16c3979a-53b1-457c-a672-d921dfe16d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:36.794439 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e530b9-afdd-4d22-b7e4-c0161f848972 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:36.880021 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3979a-53b1-457c-a672-d921dfe16d32 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:36.886635 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c418d5-7a8c-4292-a243-d223eec23de1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:36.887860 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c418d5-7a8c-4292-a243-d223eec23de1 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:36.888221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c418d5-7a8c-4292-a243-d223eec23de1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:36.888571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c418d5-7a8c-4292-a243-d223eec23de1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:36.912016 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c418d5-7a8c-4292-a243-d223eec23de1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:36.912016 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c418d5-7a8c-4292-a243-d223eec23de1 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:36.923458 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 901/1798] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:36.952844 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c418d5-7a8c-4292-a243-d223eec23de1 service cinder] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:37.001865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-27e530b9-afdd-4d22-b7e4-c0161f848972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b54abd54e1fb4b77b7e80b0ea7edc534', 'request_id': 'req-27e530b9-afdd-4d22-b7e4-c0161f848972'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:37.012718 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c418d5-7a8c-4292-a243-d223eec23de1 service cinder] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:37.030596 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-27e530b9-afdd-4d22-b7e4-c0161f848972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b54abd54e1fb4b77b7e80b0ea7edc534', 'request_id': 'req-27e530b9-afdd-4d22-b7e4-c0161f848972'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:37.041577 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-27e530b9-afdd-4d22-b7e4-c0161f848972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b54abd54e1fb4b77b7e80b0ea7edc534', 'request_id': 'req-27e530b9-afdd-4d22-b7e4-c0161f848972'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:37.145307 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e660d-e372-4281-9e32-dc3992ea4c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:37.146157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e660d-e372-4281-9e32-dc3992ea4c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:37.146515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e660d-e372-4281-9e32-dc3992ea4c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:37.146863 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e660d-e372-4281-9e32-dc3992ea4c0c admin admin] PATH_INFO: `/v3/projects/30d60d86e5ac4ef987bced2c88c86a3f/users/8053b69b3d8045be8182d37eed6862f5/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:37.149686 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e660d-e372-4281-9e32-dc3992ea4c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d60d86e5ac4ef987bced2c88c86a3f, user_id=8053b69b3d8045be8182d37eed6862f5, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:37.153029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e660d-e372-4281-9e32-dc3992ea4c0c admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:37.176570 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 902/1799] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:36 2022] PUT /identity/v3/projects/30d60d86e5ac4ef987bced2c88c86a3f/users/8053b69b3d8045be8182d37eed6862f5/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:37.186870 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e660d-e372-4281-9e32-dc3992ea4c0c admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:37.240066 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-27e530b9-afdd-4d22-b7e4-c0161f848972 admin admin] The token cache is being invalidate because project b54abd54e1fb4b77b7e80b0ea7edc534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:54:37.240597 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-27e530b9-afdd-4d22-b7e4-c0161f848972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:37.253516 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-27e530b9-afdd-4d22-b7e4-c0161f848972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:37.257372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 898/1800] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:54:36 2022] DELETE /identity/v3/projects/b54abd54e1fb4b77b7e80b0ea7edc534 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:37.258793 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742e715-3df2-403a-bf1d-6f4f5adcf7aa None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:37.259041 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742e715-3df2-403a-bf1d-6f4f5adcf7aa None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:37.259323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742e715-3df2-403a-bf1d-6f4f5adcf7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:37.316328 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e660d-e372-4281-9e32-dc3992ea4c0c admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:37.322397 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52e080-00d0-43b5-98fd-9c711e913626 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:37.323077 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52e080-00d0-43b5-98fd-9c711e913626 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:37.323381 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52e080-00d0-43b5-98fd-9c711e913626 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:37.324211 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52e080-00d0-43b5-98fd-9c711e913626 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:37.329107 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:37.330485 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-1d52e080-00d0-43b5-98fd-9c711e913626 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:37.355824 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-3742e715-3df2-403a-bf1d-6f4f5adcf7aa None None] MFA Rules not processed for user `8053b69b3d8045be8182d37eed6862f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:37.358420 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-3742e715-3df2-403a-bf1d-6f4f5adcf7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:37.432057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52e080-00d0-43b5-98fd-9c711e913626 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:37.435661 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52e080-00d0-43b5-98fd-9c711e913626 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:37.450692 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 903/1801] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:37.451518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52e080-00d0-43b5-98fd-9c711e913626 service cinder] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:37.455046 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-1d52e080-00d0-43b5-98fd-9c711e913626 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:37.491400 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 899/1802] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:37 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:37.542491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742e715-3df2-403a-bf1d-6f4f5adcf7aa None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:37.544395 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-3742e715-3df2-403a-bf1d-6f4f5adcf7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:37.563919 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742e715-3df2-403a-bf1d-6f4f5adcf7aa None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:37.564793 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1300f-5873-465a-a183-79feee8d2a4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:37.565910 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1300f-5873-465a-a183-79feee8d2a4f service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:37.566385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1300f-5873-465a-a183-79feee8d2a4f service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:37.566719 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1300f-5873-465a-a183-79feee8d2a4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:37.568927 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-3bf1300f-5873-465a-a183-79feee8d2a4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:37.569189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52e080-00d0-43b5-98fd-9c711e913626 service cinder] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:37.574295 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999de174-32f4-453b-a0f2-80aeb957b0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:37.575405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999de174-32f4-453b-a0f2-80aeb957b0b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:37.575754 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999de174-32f4-453b-a0f2-80aeb957b0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:37.576093 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999de174-32f4-453b-a0f2-80aeb957b0b6 admin admin] PATH_INFO: `/v3/users/84fc812181144b94b290fb5ef091a574` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:37.577516 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999de174-32f4-453b-a0f2-80aeb957b0b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84fc812181144b94b290fb5ef091a574)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:37.579669 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999de174-32f4-453b-a0f2-80aeb957b0b6 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:37.641590 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1300f-5873-465a-a183-79feee8d2a4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:37.643233 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1300f-5873-465a-a183-79feee8d2a4f service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:37.653147 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 900/1803] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 13:54:37.682507 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:37.877714 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-999de174-32f4-453b-a0f2-80aeb957b0b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84fc812181144b94b290fb5ef091a574'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:37.985235 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-999de174-32f4-453b-a0f2-80aeb957b0b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84fc812181144b94b290fb5ef091a574'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:38.001948 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-999de174-32f4-453b-a0f2-80aeb957b0b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84fc812181144b94b290fb5ef091a574'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:38.033544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-999de174-32f4-453b-a0f2-80aeb957b0b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84fc812181144b94b290fb5ef091a574'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:38.034759 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-999de174-32f4-453b-a0f2-80aeb957b0b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84fc812181144b94b290fb5ef091a574'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:38.052560 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 904/1804] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:54:37 2022] DELETE /identity/v3/users/84fc812181144b94b290fb5ef091a574 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:38.056516 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1300f-5873-465a-a183-79feee8d2a4f service cinder] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:38.058110 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-3bf1300f-5873-465a-a183-79feee8d2a4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:38.074567 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1300f-5873-465a-a183-79feee8d2a4f service cinder] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:38.232405 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa22e7-28b6-479f-ab14-7dbae9f95f33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:38.233392 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa22e7-28b6-479f-ab14-7dbae9f95f33 service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:38.233741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa22e7-28b6-479f-ab14-7dbae9f95f33 service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:38.234083 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa22e7-28b6-479f-ab14-7dbae9f95f33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:38.236709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-2eaa22e7-28b6-479f-ab14-7dbae9f95f33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:38.252036 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:38.413121 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa22e7-28b6-479f-ab14-7dbae9f95f33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:38.417886 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa22e7-28b6-479f-ab14-7dbae9f95f33 service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:38.436575 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 901/1805] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:38 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:38.505533 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:38.737965 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999de174-32f4-453b-a0f2-80aeb957b0b6 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:38.739815 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-999de174-32f4-453b-a0f2-80aeb957b0b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:38.759765 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999de174-32f4-453b-a0f2-80aeb957b0b6 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:38.765180 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11acce4-3c0e-4ec3-8527-ec1d86a8ca47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:38.766503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11acce4-3c0e-4ec3-8527-ec1d86a8ca47 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:38.766806 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11acce4-3c0e-4ec3-8527-ec1d86a8ca47 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:38.767083 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11acce4-3c0e-4ec3-8527-ec1d86a8ca47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:38.769954 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b11acce4-3c0e-4ec3-8527-ec1d86a8ca47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:38.871177 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11acce4-3c0e-4ec3-8527-ec1d86a8ca47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:38.873320 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11acce4-3c0e-4ec3-8527-ec1d86a8ca47 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:38.903582 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 905/1806] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:38 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:38.950140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:38.986068 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa22e7-28b6-479f-ab14-7dbae9f95f33 service cinder] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:38.989560 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-2eaa22e7-28b6-479f-ab14-7dbae9f95f33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:39.060286 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:39.108057 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa22e7-28b6-479f-ab14-7dbae9f95f33 service cinder] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:39.113401 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8ba6c-1565-455a-b040-86c65241f02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:39.114074 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8ba6c-1565-455a-b040-86c65241f02d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:39.114358 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8ba6c-1565-455a-b040-86c65241f02d admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:39.114637 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8ba6c-1565-455a-b040-86c65241f02d admin admin] PATH_INFO: `/v3/projects/01fb419bdbf04c678ab58bf2e3712955` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:39.115825 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8ba6c-1565-455a-b040-86c65241f02d admin admin] RBAC: Authorizing `identity:delete_project(project_id=01fb419bdbf04c678ab58bf2e3712955)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:39.118225 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8ba6c-1565-455a-b040-86c65241f02d admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:39.256248 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-a6c8ba6c-1565-455a-b040-86c65241f02d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01fb419bdbf04c678ab58bf2e3712955', 'request_id': 'req-a6c8ba6c-1565-455a-b040-86c65241f02d'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:39.262150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-a6c8ba6c-1565-455a-b040-86c65241f02d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01fb419bdbf04c678ab58bf2e3712955', 'request_id': 'req-a6c8ba6c-1565-455a-b040-86c65241f02d'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:39.268983 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-a6c8ba6c-1565-455a-b040-86c65241f02d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01fb419bdbf04c678ab58bf2e3712955', 'request_id': 'req-a6c8ba6c-1565-455a-b040-86c65241f02d'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:39.339166 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-a6c8ba6c-1565-455a-b040-86c65241f02d admin admin] The token cache is being invalidate because project 01fb419bdbf04c678ab58bf2e3712955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:54:39.339501 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-a6c8ba6c-1565-455a-b040-86c65241f02d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:39.340189 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-a6c8ba6c-1565-455a-b040-86c65241f02d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:39.343310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 902/1807] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:54:38 2022] DELETE /identity/v3/projects/01fb419bdbf04c678ab58bf2e3712955 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:39.351103 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c82cf-4f8e-4b80-9826-f5b63ac959ad None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:39.351577 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c82cf-4f8e-4b80-9826-f5b63ac959ad None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:39.351802 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c82cf-4f8e-4b80-9826-f5b63ac959ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:39.372781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-bc4c82cf-4f8e-4b80-9826-f5b63ac959ad None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:39.374076 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-bc4c82cf-4f8e-4b80-9826-f5b63ac959ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:39.447965 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 906/1808] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:39.457076 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a68241-0a04-4abc-8501-b593c03edcc4 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:39.457323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a68241-0a04-4abc-8501-b593c03edcc4 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:39.457985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a68241-0a04-4abc-8501-b593c03edcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:39.495461 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-13a68241-0a04-4abc-8501-b593c03edcc4 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:39.496700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-13a68241-0a04-4abc-8501-b593c03edcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:39.504841 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 903/1809] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:39.509218 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c82cf-4f8e-4b80-9826-f5b63ac959ad None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:39.519728 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c82cf-4f8e-4b80-9826-f5b63ac959ad None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:39.524392 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13811fc5-5fa2-473b-a110-864832771692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:39.525007 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13811fc5-5fa2-473b-a110-864832771692 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:39.525293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13811fc5-5fa2-473b-a110-864832771692 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:39.525568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13811fc5-5fa2-473b-a110-864832771692 admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:39.526215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13811fc5-5fa2-473b-a110-864832771692 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:54:39.526548 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13811fc5-5fa2-473b-a110-864832771692 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:39.528228 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13811fc5-5fa2-473b-a110-864832771692 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:39.540942 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 907/1810] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:54:39.546193 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a68241-0a04-4abc-8501-b593c03edcc4 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:39.555924 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a68241-0a04-4abc-8501-b593c03edcc4 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:39.560659 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79044b46-3106-4f4a-8d12-01c1f63e6222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:39.561288 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79044b46-3106-4f4a-8d12-01c1f63e6222 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:39.561568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79044b46-3106-4f4a-8d12-01c1f63e6222 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:39.561842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79044b46-3106-4f4a-8d12-01c1f63e6222 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:39.562481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79044b46-3106-4f4a-8d12-01c1f63e6222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:39.564522 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79044b46-3106-4f4a-8d12-01c1f63e6222 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:39.679309 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 904/1811] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:39 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:39.682878 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13811fc5-5fa2-473b-a110-864832771692 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:39.695128 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13811fc5-5fa2-473b-a110-864832771692 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:39.838885 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:39.883687 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec16ee6-8ede-4ce1-9a81-c33c70cc5ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:39.884314 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec16ee6-8ede-4ce1-9a81-c33c70cc5ccc admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:39.884593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec16ee6-8ede-4ce1-9a81-c33c70cc5ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:39.884877 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec16ee6-8ede-4ce1-9a81-c33c70cc5ccc admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:39.885518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec16ee6-8ede-4ce1-9a81-c33c70cc5ccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:39.893404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec16ee6-8ede-4ce1-9a81-c33c70cc5ccc admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:40.043519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 908/1812] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:39 2022] POST /identity/v3/users => generated 294 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:40.047966 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79044b46-3106-4f4a-8d12-01c1f63e6222 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:40.073544 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79044b46-3106-4f4a-8d12-01c1f63e6222 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:40.077034 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:40.091572 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b7828-57c5-4d76-a56f-6cd6956912ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:40.093520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b7828-57c5-4d76-a56f-6cd6956912ae admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:40.096913 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b7828-57c5-4d76-a56f-6cd6956912ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:40.097745 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b7828-57c5-4d76-a56f-6cd6956912ae admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:40.098715 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b7828-57c5-4d76-a56f-6cd6956912ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:40.103615 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b7828-57c5-4d76-a56f-6cd6956912ae admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:40.147400 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 905/1813] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:40.158822 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec16ee6-8ede-4ce1-9a81-c33c70cc5ccc admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:40.229198 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec16ee6-8ede-4ce1-9a81-c33c70cc5ccc admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:40.254700 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe524b2-319e-4100-9799-6f21361dc5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:40.257550 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe524b2-319e-4100-9799-6f21361dc5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:40.257550 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe524b2-319e-4100-9799-6f21361dc5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:40.257550 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe524b2-319e-4100-9799-6f21361dc5f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:40.257550 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe524b2-319e-4100-9799-6f21361dc5f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:40.258399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe524b2-319e-4100-9799-6f21361dc5f5 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:40.285869 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 909/1814] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:40.290526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b7828-57c5-4d76-a56f-6cd6956912ae admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:40.308263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b7828-57c5-4d76-a56f-6cd6956912ae admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:40.325392 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7a4af-cce3-4ae2-ab7b-9e8b285fb4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:40.325646 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7a4af-cce3-4ae2-ab7b-9e8b285fb4f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:40.326253 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7a4af-cce3-4ae2-ab7b-9e8b285fb4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:40.326532 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7a4af-cce3-4ae2-ab7b-9e8b285fb4f6 admin admin] PATH_INFO: `/v3/projects/10942e2c9677484db8bfea8338970feb/users/525140e74de645908b6aa2994a952154/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:40.346039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7a4af-cce3-4ae2-ab7b-9e8b285fb4f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10942e2c9677484db8bfea8338970feb, user_id=525140e74de645908b6aa2994a952154, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:40.349040 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7a4af-cce3-4ae2-ab7b-9e8b285fb4f6 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:40.447889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 906/1815] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:40 2022] PUT /identity/v3/projects/10942e2c9677484db8bfea8338970feb/users/525140e74de645908b6aa2994a952154/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:40.460652 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2903d03-dfd0-4cf9-a9a2-3c669e447f54 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:40.461158 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2903d03-dfd0-4cf9-a9a2-3c669e447f54 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:40.461368 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2903d03-dfd0-4cf9-a9a2-3c669e447f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:40.503829 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-a2903d03-dfd0-4cf9-a9a2-3c669e447f54 None None] MFA Rules not processed for user `525140e74de645908b6aa2994a952154`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:40.505466 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a2903d03-dfd0-4cf9-a9a2-3c669e447f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:40.600870 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 910/1816] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:40.606088 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7a4af-cce3-4ae2-ab7b-9e8b285fb4f6 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:40.645718 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2903d03-dfd0-4cf9-a9a2-3c669e447f54 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:40.647319 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a2903d03-dfd0-4cf9-a9a2-3c669e447f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:40.720099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7a4af-cce3-4ae2-ab7b-9e8b285fb4f6 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:40.726752 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a52646-f875-4448-904d-b57edf7f1161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:40.727714 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a52646-f875-4448-904d-b57edf7f1161 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:40.728112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a52646-f875-4448-904d-b57edf7f1161 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:40.728498 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a52646-f875-4448-904d-b57edf7f1161 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:40.729464 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a52646-f875-4448-904d-b57edf7f1161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:40.731763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a52646-f875-4448-904d-b57edf7f1161 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:40.761583 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2903d03-dfd0-4cf9-a9a2-3c669e447f54 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:40.775430 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f4512-4b41-44f4-b9ac-50b5b706bdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:40.776134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f4512-4b41-44f4-b9ac-50b5b706bdfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:40.776433 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f4512-4b41-44f4-b9ac-50b5b706bdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:40.776753 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f4512-4b41-44f4-b9ac-50b5b706bdfe admin admin] PATH_INFO: `/v3/users/d36f5a4715f14523a5f66c27a851d50b` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:40.781720 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f4512-4b41-44f4-b9ac-50b5b706bdfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d36f5a4715f14523a5f66c27a851d50b)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:40.786861 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f4512-4b41-44f4-b9ac-50b5b706bdfe admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:40.911822 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 907/1817] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:40 2022] POST /identity/v3/projects => generated 387 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:40.923840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a52646-f875-4448-904d-b57edf7f1161 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:40.988127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:41.060802 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-174f4512-4b41-44f4-b9ac-50b5b706bdfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd36f5a4715f14523a5f66c27a851d50b'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:41.171161 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-174f4512-4b41-44f4-b9ac-50b5b706bdfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd36f5a4715f14523a5f66c27a851d50b'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:41.183322 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-174f4512-4b41-44f4-b9ac-50b5b706bdfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd36f5a4715f14523a5f66c27a851d50b'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:41.201818 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a52646-f875-4448-904d-b57edf7f1161 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:41.211392 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0cab0-2f44-43fb-80dd-999748d780d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:41.220752 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0cab0-2f44-43fb-80dd-999748d780d9 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:41.221362 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0cab0-2f44-43fb-80dd-999748d780d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:41.222568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0cab0-2f44-43fb-80dd-999748d780d9 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:41.225656 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0cab0-2f44-43fb-80dd-999748d780d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:41.229099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0cab0-2f44-43fb-80dd-999748d780d9 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:41.240133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-174f4512-4b41-44f4-b9ac-50b5b706bdfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd36f5a4715f14523a5f66c27a851d50b'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:41.241376 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-174f4512-4b41-44f4-b9ac-50b5b706bdfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd36f5a4715f14523a5f66c27a851d50b'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:41.263468 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 911/1818] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:54:40 2022] DELETE /identity/v3/users/d36f5a4715f14523a5f66c27a851d50b => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:41.264857 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490bfdf0-ec2a-4176-b027-ed206294397c None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:41.265495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490bfdf0-ec2a-4176-b027-ed206294397c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:41.266911 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490bfdf0-ec2a-4176-b027-ed206294397c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:41.408362 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 908/1819] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:40 2022] POST /identity/v3/users => generated 300 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:41.408362 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfa92e-2513-4cf8-a75f-c413d7724b9a None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:41.408362 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfa92e-2513-4cf8-a75f-c413d7724b9a None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:41.408362 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfa92e-2513-4cf8-a75f-c413d7724b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:41.425306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-b8bfa92e-2513-4cf8-a75f-c413d7724b9a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:41.426581 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b8bfa92e-2513-4cf8-a75f-c413d7724b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:41.448704 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-490bfdf0-ec2a-4176-b027-ed206294397c None None] MFA Rules not processed for user `6f01578bf21244a5ac357e54979ffc0d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:41.450946 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-490bfdf0-ec2a-4176-b027-ed206294397c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:41.518562 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 909/1820] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:41.519514 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfa92e-2513-4cf8-a75f-c413d7724b9a None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:41.520864 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b8bfa92e-2513-4cf8-a75f-c413d7724b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:41.533580 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfa92e-2513-4cf8-a75f-c413d7724b9a None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:41.539091 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387feaa8-5609-496e-8487-961cdfde7052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:41.539795 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387feaa8-5609-496e-8487-961cdfde7052 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:41.540063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387feaa8-5609-496e-8487-961cdfde7052 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:41.540342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387feaa8-5609-496e-8487-961cdfde7052 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:41.541003 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387feaa8-5609-496e-8487-961cdfde7052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:41.542822 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387feaa8-5609-496e-8487-961cdfde7052 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:41.554848 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 910/1821] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:41.555858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387feaa8-5609-496e-8487-961cdfde7052 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:41.559123 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-387feaa8-5609-496e-8487-961cdfde7052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:41.583097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 912/1822] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 1 13:54:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:41.604781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490bfdf0-ec2a-4176-b027-ed206294397c None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:41.624845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490bfdf0-ec2a-4176-b027-ed206294397c None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:41.631719 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820c867-7490-455b-a22d-21d2b38cc282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:41.632698 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820c867-7490-455b-a22d-21d2b38cc282 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:41.633220 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820c867-7490-455b-a22d-21d2b38cc282 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:41.633683 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820c867-7490-455b-a22d-21d2b38cc282 admin admin] PATH_INFO: `/v3/projects/a9e58201247c4e91bdab482ade41b0e2/users/49fe41da0b08454696f9d9e4db9c62d3/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:41.654879 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820c867-7490-455b-a22d-21d2b38cc282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e58201247c4e91bdab482ade41b0e2, user_id=49fe41da0b08454696f9d9e4db9c62d3, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:41.666607 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387feaa8-5609-496e-8487-961cdfde7052 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:41.667516 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820c867-7490-455b-a22d-21d2b38cc282 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:41.673509 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764a050-ea74-40c4-82e1-f0b4a37f454f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:41.674487 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764a050-ea74-40c4-82e1-f0b4a37f454f service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:41.675165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764a050-ea74-40c4-82e1-f0b4a37f454f service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:41.675770 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764a050-ea74-40c4-82e1-f0b4a37f454f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:41.690127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764a050-ea74-40c4-82e1-f0b4a37f454f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:41.691985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764a050-ea74-40c4-82e1-f0b4a37f454f service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:41.724365 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 911/1823] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:41.769693 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 913/1824] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:41 2022] PUT /identity/v3/projects/a9e58201247c4e91bdab482ade41b0e2/users/49fe41da0b08454696f9d9e4db9c62d3/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:41.773939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764a050-ea74-40c4-82e1-f0b4a37f454f service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:41.789803 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764a050-ea74-40c4-82e1-f0b4a37f454f service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:41.889164 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5548e-1633-40c2-b4f5-326ebfc82436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:41.889876 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5548e-1633-40c2-b4f5-326ebfc82436 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:41.891774 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5548e-1633-40c2-b4f5-326ebfc82436 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:41.892062 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5548e-1633-40c2-b4f5-326ebfc82436 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:41.892809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5548e-1633-40c2-b4f5-326ebfc82436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:41.894578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5548e-1633-40c2-b4f5-326ebfc82436 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:41.915998 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 912/1825] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:41.916741 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820c867-7490-455b-a22d-21d2b38cc282 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:41.927048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5548e-1633-40c2-b4f5-326ebfc82436 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:41.929633 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:41.936843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-2fd5548e-1633-40c2-b4f5-326ebfc82436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:41.941877 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820c867-7490-455b-a22d-21d2b38cc282 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:41.948484 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260007a-1c60-40a7-87d2-07da70be8763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:41.949194 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260007a-1c60-40a7-87d2-07da70be8763 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:41.949525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260007a-1c60-40a7-87d2-07da70be8763 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:41.949810 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260007a-1c60-40a7-87d2-07da70be8763 admin admin] PATH_INFO: `/v3/projects/a9e58201247c4e91bdab482ade41b0e2/users/49fe41da0b08454696f9d9e4db9c62d3/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:41.954946 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260007a-1c60-40a7-87d2-07da70be8763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e58201247c4e91bdab482ade41b0e2, user_id=49fe41da0b08454696f9d9e4db9c62d3, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:41.964397 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260007a-1c60-40a7-87d2-07da70be8763 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:41.988789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 914/1826] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:41 2022] PUT /identity/v3/projects/a9e58201247c4e91bdab482ade41b0e2/users/49fe41da0b08454696f9d9e4db9c62d3/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:42.013059 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd354daa-f570-4a9e-bdf0-d8dafefc0684 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:42.015191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd354daa-f570-4a9e-bdf0-d8dafefc0684 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:42.017116 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd354daa-f570-4a9e-bdf0-d8dafefc0684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:42.150599 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-bd354daa-f570-4a9e-bdf0-d8dafefc0684 None None] MFA Rules not processed for user `49fe41da0b08454696f9d9e4db9c62d3`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:42.158966 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-bd354daa-f570-4a9e-bdf0-d8dafefc0684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:42.182313 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5548e-1633-40c2-b4f5-326ebfc82436 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:42.315233 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca430ee3-8006-4a3c-9829-bb36a9da55bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bbede0f8674384bcc3028ea77eb724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:42.316447 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca430ee3-8006-4a3c-9829-bb36a9da55bb service swift] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:42.316583 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca430ee3-8006-4a3c-9829-bb36a9da55bb service swift] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:42.319167 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca430ee3-8006-4a3c-9829-bb36a9da55bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:42.389380 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:42.391907 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 915/1827] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:42.394986 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2935451-7560-4207-abd2-6b5f6e1964c1 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:42.395820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2935451-7560-4207-abd2-6b5f6e1964c1 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:42.397129 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2935451-7560-4207-abd2-6b5f6e1964c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:42.458379 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-e2935451-7560-4207-abd2-6b5f6e1964c1 None None] MFA Rules not processed for user `72f0d372f6c34d1a9a990222d6b98948`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:42.462453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-e2935451-7560-4207-abd2-6b5f6e1964c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:42.477962 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca430ee3-8006-4a3c-9829-bb36a9da55bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:42.482402 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca430ee3-8006-4a3c-9829-bb36a9da55bb service swift] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:42.521873 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 913/1828] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 1 13:54:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 13:54:42.523221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca430ee3-8006-4a3c-9829-bb36a9da55bb service swift] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:42.528014 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-ca430ee3-8006-4a3c-9829-bb36a9da55bb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:42.675625 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 916/1829] 10.222.0.27 () {58 vars in 1015 bytes} [Thu Sep 1 13:54:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:42.707815 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca430ee3-8006-4a3c-9829-bb36a9da55bb service swift] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:42.722225 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b477ef-7c67-43bc-8465-0bca3318986b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:42.724149 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b477ef-7c67-43bc-8465-0bca3318986b service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:42.724149 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b477ef-7c67-43bc-8465-0bca3318986b service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:42.727814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b477ef-7c67-43bc-8465-0bca3318986b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:42.753717 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b477ef-7c67-43bc-8465-0bca3318986b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:42.764045 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b477ef-7c67-43bc-8465-0bca3318986b service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:42.787749 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 914/1830] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:42.980980 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2935451-7560-4207-abd2-6b5f6e1964c1 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:42.984030 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-e2935451-7560-4207-abd2-6b5f6e1964c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:43.133248 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2935451-7560-4207-abd2-6b5f6e1964c1 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:43.141978 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7e3c8-5319-4902-911a-c5c47af2e846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:43.142956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7e3c8-5319-4902-911a-c5c47af2e846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:43.143232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7e3c8-5319-4902-911a-c5c47af2e846 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:43.143693 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7e3c8-5319-4902-911a-c5c47af2e846 admin admin] PATH_INFO: `/v3/projects/8acd0cfd4c7e4f06b101b1bc34d9fcea` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:43.144780 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd7e3c8-5319-4902-911a-c5c47af2e846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8acd0cfd4c7e4f06b101b1bc34d9fcea)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:43.146763 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd7e3c8-5319-4902-911a-c5c47af2e846 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:43.396161 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-bfd7e3c8-5319-4902-911a-c5c47af2e846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8acd0cfd4c7e4f06b101b1bc34d9fcea', 'request_id': 'req-bfd7e3c8-5319-4902-911a-c5c47af2e846'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:43.413495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-bfd7e3c8-5319-4902-911a-c5c47af2e846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8acd0cfd4c7e4f06b101b1bc34d9fcea', 'request_id': 'req-bfd7e3c8-5319-4902-911a-c5c47af2e846'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:43.493467 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:43.577658 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-bfd7e3c8-5319-4902-911a-c5c47af2e846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8acd0cfd4c7e4f06b101b1bc34d9fcea', 'request_id': 'req-bfd7e3c8-5319-4902-911a-c5c47af2e846'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:43.620756 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-bfd7e3c8-5319-4902-911a-c5c47af2e846 admin admin] The token cache is being invalidate because project 8acd0cfd4c7e4f06b101b1bc34d9fcea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:54:43.621066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-bfd7e3c8-5319-4902-911a-c5c47af2e846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:43.635764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-bfd7e3c8-5319-4902-911a-c5c47af2e846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:43.650591 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 917/1831] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:54:42 2022] DELETE /identity/v3/projects/8acd0cfd4c7e4f06b101b1bc34d9fcea => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:43.654707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b477ef-7c67-43bc-8465-0bca3318986b service cinder] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:43.686691 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b477ef-7c67-43bc-8465-0bca3318986b service cinder] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:43.872170 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0b1ca-ec94-4c50-82cd-6ab24adbf5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:43.873387 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0b1ca-ec94-4c50-82cd-6ab24adbf5dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:43.873679 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0b1ca-ec94-4c50-82cd-6ab24adbf5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:43.873962 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0b1ca-ec94-4c50-82cd-6ab24adbf5dd admin admin] PATH_INFO: `/v3/users/0afda676165c4983b07821574c467a6e` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:43.876327 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe0b1ca-ec94-4c50-82cd-6ab24adbf5dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0afda676165c4983b07821574c467a6e)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:43.878497 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe0b1ca-ec94-4c50-82cd-6ab24adbf5dd admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:43.948517 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:44.108200 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-9fe0b1ca-ec94-4c50-82cd-6ab24adbf5dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0afda676165c4983b07821574c467a6e'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:44.109068 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-9fe0b1ca-ec94-4c50-82cd-6ab24adbf5dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0afda676165c4983b07821574c467a6e'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:44.121825 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-9fe0b1ca-ec94-4c50-82cd-6ab24adbf5dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0afda676165c4983b07821574c467a6e'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:44.128736 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-9fe0b1ca-ec94-4c50-82cd-6ab24adbf5dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0afda676165c4983b07821574c467a6e'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:44.228185 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-9fe0b1ca-ec94-4c50-82cd-6ab24adbf5dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0afda676165c4983b07821574c467a6e'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:44.235747 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 915/1832] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:54:43 2022] DELETE /identity/v3/users/0afda676165c4983b07821574c467a6e => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:44.561715 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7e3c8-5319-4902-911a-c5c47af2e846 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:44.563893 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-bfd7e3c8-5319-4902-911a-c5c47af2e846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:44.577168 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7e3c8-5319-4902-911a-c5c47af2e846 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:44.635341 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24964f3e-a82b-43ea-bfdf-1315b7947be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:44.636018 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24964f3e-a82b-43ea-bfdf-1315b7947be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:44.636302 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24964f3e-a82b-43ea-bfdf-1315b7947be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:44.636574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24964f3e-a82b-43ea-bfdf-1315b7947be4 admin admin] PATH_INFO: `/v3/users/525140e74de645908b6aa2994a952154` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:44.637730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24964f3e-a82b-43ea-bfdf-1315b7947be4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=525140e74de645908b6aa2994a952154)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:44.639699 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24964f3e-a82b-43ea-bfdf-1315b7947be4 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:44.695712 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0b1ca-ec94-4c50-82cd-6ab24adbf5dd admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:44.697233 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-9fe0b1ca-ec94-4c50-82cd-6ab24adbf5dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:44.712671 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0b1ca-ec94-4c50-82cd-6ab24adbf5dd admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:44.717892 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa076d79-b0a2-440a-a332-3c1e9848e0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:44.718574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa076d79-b0a2-440a-a332-3c1e9848e0dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:44.718819 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa076d79-b0a2-440a-a332-3c1e9848e0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:44.719098 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa076d79-b0a2-440a-a332-3c1e9848e0dd admin admin] PATH_INFO: `/v3/projects/7ad86b7d27b74b8488f988b3081c314b` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:44.720596 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa076d79-b0a2-440a-a332-3c1e9848e0dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ad86b7d27b74b8488f988b3081c314b)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:44.722743 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa076d79-b0a2-440a-a332-3c1e9848e0dd admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:44.912405 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-fa076d79-b0a2-440a-a332-3c1e9848e0dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ad86b7d27b74b8488f988b3081c314b', 'request_id': 'req-fa076d79-b0a2-440a-a332-3c1e9848e0dd'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:44.912753 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-24964f3e-a82b-43ea-bfdf-1315b7947be4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '525140e74de645908b6aa2994a952154'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:44.918209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-fa076d79-b0a2-440a-a332-3c1e9848e0dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ad86b7d27b74b8488f988b3081c314b', 'request_id': 'req-fa076d79-b0a2-440a-a332-3c1e9848e0dd'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:44.925655 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-fa076d79-b0a2-440a-a332-3c1e9848e0dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ad86b7d27b74b8488f988b3081c314b', 'request_id': 'req-fa076d79-b0a2-440a-a332-3c1e9848e0dd'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:45.005732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-24964f3e-a82b-43ea-bfdf-1315b7947be4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '525140e74de645908b6aa2994a952154'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:45.014796 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-24964f3e-a82b-43ea-bfdf-1315b7947be4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '525140e74de645908b6aa2994a952154'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:45.029485 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-24964f3e-a82b-43ea-bfdf-1315b7947be4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '525140e74de645908b6aa2994a952154'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:45.031743 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-24964f3e-a82b-43ea-bfdf-1315b7947be4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '525140e74de645908b6aa2994a952154'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:45.034455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:45.040553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 918/1833] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:54:44 2022] DELETE /identity/v3/users/525140e74de645908b6aa2994a952154 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:45.057177 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c5aa1-5233-4c8b-b109-a281d9c9282a None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:45.057455 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c5aa1-5233-4c8b-b109-a281d9c9282a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:45.057731 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c5aa1-5233-4c8b-b109-a281d9c9282a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:45.077814 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-a45c5aa1-5233-4c8b-b109-a281d9c9282a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:45.080778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a45c5aa1-5233-4c8b-b109-a281d9c9282a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:45.132063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-fa076d79-b0a2-440a-a332-3c1e9848e0dd admin admin] The token cache is being invalidate because project 7ad86b7d27b74b8488f988b3081c314b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:54:45.132243 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-fa076d79-b0a2-440a-a332-3c1e9848e0dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:45.132904 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-fa076d79-b0a2-440a-a332-3c1e9848e0dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:45.139616 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 916/1834] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:54:44 2022] DELETE /identity/v3/projects/7ad86b7d27b74b8488f988b3081c314b => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:54:45.150045 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5b35a-234e-4a88-b599-e4eda1e63516 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:45.150342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5b35a-234e-4a88-b599-e4eda1e63516 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:45.150854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5b35a-234e-4a88-b599-e4eda1e63516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:45.183486 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 919/1835] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:54:45.186693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-1fb5b35a-234e-4a88-b599-e4eda1e63516 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:45.188566 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-1fb5b35a-234e-4a88-b599-e4eda1e63516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:45.193073 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c5aa1-5233-4c8b-b109-a281d9c9282a None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:45.196149 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a45c5aa1-5233-4c8b-b109-a281d9c9282a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:45.222928 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 917/1836] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:45.245372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e545ad3-72f8-4397-8a74-d60a3f9795b7 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:45.245870 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e545ad3-72f8-4397-8a74-d60a3f9795b7 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:45.246667 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e545ad3-72f8-4397-8a74-d60a3f9795b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:45.294811 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-5e545ad3-72f8-4397-8a74-d60a3f9795b7 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:45.296391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-5e545ad3-72f8-4397-8a74-d60a3f9795b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:45.306478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 918/1837] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:45.310951 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e545ad3-72f8-4397-8a74-d60a3f9795b7 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:45.322373 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c5aa1-5233-4c8b-b109-a281d9c9282a None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:45.328977 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd47ea-75ef-4b49-9ea6-b5c6a08ff305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:45.330628 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd47ea-75ef-4b49-9ea6-b5c6a08ff305 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:45.331170 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd47ea-75ef-4b49-9ea6-b5c6a08ff305 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:45.336302 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd47ea-75ef-4b49-9ea6-b5c6a08ff305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:45.336656 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e545ad3-72f8-4397-8a74-d60a3f9795b7 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:45.345624 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd47ea-75ef-4b49-9ea6-b5c6a08ff305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:45.348659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd47ea-75ef-4b49-9ea6-b5c6a08ff305 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:45.355581 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d07fb-d7d8-4094-97d9-b21016e02971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:45.356728 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d07fb-d7d8-4094-97d9-b21016e02971 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:45.357112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d07fb-d7d8-4094-97d9-b21016e02971 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:45.357611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d07fb-d7d8-4094-97d9-b21016e02971 admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:45.358367 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d07fb-d7d8-4094-97d9-b21016e02971 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:54:45.358679 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d07fb-d7d8-4094-97d9-b21016e02971 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:45.363039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d07fb-d7d8-4094-97d9-b21016e02971 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:45.379746 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 920/1838] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 13:54:45.391494 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 919/1839] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:54:45.393667 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd47ea-75ef-4b49-9ea6-b5c6a08ff305 service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:45.404730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd47ea-75ef-4b49-9ea6-b5c6a08ff305 service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:45.420245 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08f2b5-5515-4dee-b48f-910aa0c3a055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:45.420906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08f2b5-5515-4dee-b48f-910aa0c3a055 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:45.421223 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08f2b5-5515-4dee-b48f-910aa0c3a055 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:45.421460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08f2b5-5515-4dee-b48f-910aa0c3a055 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:45.422108 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08f2b5-5515-4dee-b48f-910aa0c3a055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:45.429870 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08f2b5-5515-4dee-b48f-910aa0c3a055 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:45.777327 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 921/1840] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:45 2022] POST /identity/v3/projects => generated 381 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:54:45.826675 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d07fb-d7d8-4094-97d9-b21016e02971 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:45.832428 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d07fb-d7d8-4094-97d9-b21016e02971 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:45.905828 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f68ec-92b5-4f1c-a7f2-6253c50f36e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:45.912737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f68ec-92b5-4f1c-a7f2-6253c50f36e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:45.912737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f68ec-92b5-4f1c-a7f2-6253c50f36e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:45.912737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f68ec-92b5-4f1c-a7f2-6253c50f36e7 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:45.912737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f68ec-92b5-4f1c-a7f2-6253c50f36e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:45.912737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f68ec-92b5-4f1c-a7f2-6253c50f36e7 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:46.117004 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:46.272345 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 920/1841] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:45 2022] POST /identity/v3/users => generated 291 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:46.275551 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08f2b5-5515-4dee-b48f-910aa0c3a055 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:46.286522 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08f2b5-5515-4dee-b48f-910aa0c3a055 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:46.294104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed9149-8698-4905-a58e-ae9ce0a6769e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:46.294989 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed9149-8698-4905-a58e-ae9ce0a6769e admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:46.295207 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed9149-8698-4905-a58e-ae9ce0a6769e admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:46.301127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed9149-8698-4905-a58e-ae9ce0a6769e admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:46.301127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed9149-8698-4905-a58e-ae9ce0a6769e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:46.301127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed9149-8698-4905-a58e-ae9ce0a6769e admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:46.304033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f68ec-92b5-4f1c-a7f2-6253c50f36e7 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:46.306145 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-fd3f68ec-92b5-4f1c-a7f2-6253c50f36e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:46.320679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 922/1842] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:46.323794 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f68ec-92b5-4f1c-a7f2-6253c50f36e7 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:46.334369 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed9149-8698-4905-a58e-ae9ce0a6769e admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:46.336032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2630b3-39ea-43c3-8288-4ee7e7cb864b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:46.336032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2630b3-39ea-43c3-8288-4ee7e7cb864b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:46.336032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2630b3-39ea-43c3-8288-4ee7e7cb864b admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:46.336032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2630b3-39ea-43c3-8288-4ee7e7cb864b admin admin] PATH_INFO: `/v3/projects/10942e2c9677484db8bfea8338970feb` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:46.337843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2630b3-39ea-43c3-8288-4ee7e7cb864b admin admin] RBAC: Authorizing `identity:delete_project(project_id=10942e2c9677484db8bfea8338970feb)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:46.339859 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2630b3-39ea-43c3-8288-4ee7e7cb864b admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:46.341690 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed9149-8698-4905-a58e-ae9ce0a6769e admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:46.349787 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82228832-62d0-405e-9a6f-12183d432097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:46.350823 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82228832-62d0-405e-9a6f-12183d432097 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:46.351176 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82228832-62d0-405e-9a6f-12183d432097 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:46.351586 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82228832-62d0-405e-9a6f-12183d432097 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:46.352273 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82228832-62d0-405e-9a6f-12183d432097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:46.355831 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82228832-62d0-405e-9a6f-12183d432097 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:46.371959 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 923/1843] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 13:54:46.377076 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82228832-62d0-405e-9a6f-12183d432097 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:46.410357 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82228832-62d0-405e-9a6f-12183d432097 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:46.426227 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891622c-ebdd-4cf7-a665-d923b99f773a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:46.427117 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891622c-ebdd-4cf7-a665-d923b99f773a admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:46.427511 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891622c-ebdd-4cf7-a665-d923b99f773a admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:46.427861 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891622c-ebdd-4cf7-a665-d923b99f773a admin admin] PATH_INFO: `/v3/projects/43ac2a567cfa4f09938217a6b2b43a23/users/06701b1e91394c8d87de9f0bbd6b047e/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:46.448294 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891622c-ebdd-4cf7-a665-d923b99f773a admin admin] RBAC: Authorizing `identity:create_grant(project_id=43ac2a567cfa4f09938217a6b2b43a23, user_id=06701b1e91394c8d87de9f0bbd6b047e, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:46.451421 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891622c-ebdd-4cf7-a665-d923b99f773a admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:46.574256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 924/1844] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:46 2022] PUT /identity/v3/projects/43ac2a567cfa4f09938217a6b2b43a23/users/06701b1e91394c8d87de9f0bbd6b047e/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:54:46.584637 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-aa2630b3-39ea-43c3-8288-4ee7e7cb864b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10942e2c9677484db8bfea8338970feb', 'request_id': 'req-aa2630b3-39ea-43c3-8288-4ee7e7cb864b'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:46.586324 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5077a8-d714-48c7-8ddb-ebac9dc881a8 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:46.586682 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5077a8-d714-48c7-8ddb-ebac9dc881a8 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:46.587037 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5077a8-d714-48c7-8ddb-ebac9dc881a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:46.591144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-aa2630b3-39ea-43c3-8288-4ee7e7cb864b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10942e2c9677484db8bfea8338970feb', 'request_id': 'req-aa2630b3-39ea-43c3-8288-4ee7e7cb864b'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:46.599790 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-aa2630b3-39ea-43c3-8288-4ee7e7cb864b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10942e2c9677484db8bfea8338970feb', 'request_id': 'req-aa2630b3-39ea-43c3-8288-4ee7e7cb864b'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:46.623617 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-9e5077a8-d714-48c7-8ddb-ebac9dc881a8 None None] MFA Rules not processed for user `06701b1e91394c8d87de9f0bbd6b047e`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:46.624888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-9e5077a8-d714-48c7-8ddb-ebac9dc881a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:46.708484 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 925/1845] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:46.716833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5077a8-d714-48c7-8ddb-ebac9dc881a8 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:46.768324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-aa2630b3-39ea-43c3-8288-4ee7e7cb864b admin admin] The token cache is being invalidate because project 10942e2c9677484db8bfea8338970feb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:54:46.768324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-aa2630b3-39ea-43c3-8288-4ee7e7cb864b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:46.768324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-aa2630b3-39ea-43c3-8288-4ee7e7cb864b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:46.768324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 921/1846] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:54:46 2022] DELETE /identity/v3/projects/10942e2c9677484db8bfea8338970feb => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:46.771237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2630b3-39ea-43c3-8288-4ee7e7cb864b admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:46.772870 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-aa2630b3-39ea-43c3-8288-4ee7e7cb864b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:46.795622 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5077a8-d714-48c7-8ddb-ebac9dc881a8 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:46.800625 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e4e84-84c7-4269-b293-335b1b677d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:46.801228 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e4e84-84c7-4269-b293-335b1b677d1c admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:46.801562 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e4e84-84c7-4269-b293-335b1b677d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:46.801843 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e4e84-84c7-4269-b293-335b1b677d1c admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:46.802623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e4e84-84c7-4269-b293-335b1b677d1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:46.804620 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e4e84-84c7-4269-b293-335b1b677d1c admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:46.869776 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2630b3-39ea-43c3-8288-4ee7e7cb864b admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:46.875066 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126691e5-526b-4908-9df4-079604a883a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:46.875750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126691e5-526b-4908-9df4-079604a883a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:46.876025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126691e5-526b-4908-9df4-079604a883a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:46.876440 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126691e5-526b-4908-9df4-079604a883a6 admin admin] PATH_INFO: `/v3/users/49fe41da0b08454696f9d9e4db9c62d3` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:46.885620 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126691e5-526b-4908-9df4-079604a883a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49fe41da0b08454696f9d9e4db9c62d3)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:46.885620 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126691e5-526b-4908-9df4-079604a883a6 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:46.924201 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 926/1847] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:46 2022] POST /identity/v3/projects => generated 381 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:46.931924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e4e84-84c7-4269-b293-335b1b677d1c admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:46.939500 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-1e5e4e84-84c7-4269-b293-335b1b677d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:47.023527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e4e84-84c7-4269-b293-335b1b677d1c admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:47.028563 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d68e4-503e-469b-adea-a515b2316135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:47.029294 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d68e4-503e-469b-adea-a515b2316135 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:47.029647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d68e4-503e-469b-adea-a515b2316135 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:47.030144 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d68e4-503e-469b-adea-a515b2316135 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:47.030905 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d68e4-503e-469b-adea-a515b2316135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:47.033520 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d68e4-503e-469b-adea-a515b2316135 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:47.151411 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 927/1848] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:46 2022] POST /identity/v3/users => generated 297 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:47.154978 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d68e4-503e-469b-adea-a515b2316135 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:47.178721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-126691e5-526b-4908-9df4-079604a883a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49fe41da0b08454696f9d9e4db9c62d3'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:47.178721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-126691e5-526b-4908-9df4-079604a883a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49fe41da0b08454696f9d9e4db9c62d3'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:47.178883 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d68e4-503e-469b-adea-a515b2316135 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:47.178883 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe0038-e17a-4ed2-a59a-f4c973212d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:47.178883 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe0038-e17a-4ed2-a59a-f4c973212d0c admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:47.178883 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe0038-e17a-4ed2-a59a-f4c973212d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:47.179168 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe0038-e17a-4ed2-a59a-f4c973212d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:47.179851 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe0038-e17a-4ed2-a59a-f4c973212d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:47.181456 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe0038-e17a-4ed2-a59a-f4c973212d0c admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:47.189026 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-126691e5-526b-4908-9df4-079604a883a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49fe41da0b08454696f9d9e4db9c62d3'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:47.194222 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 928/1849] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:47.198916 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe0038-e17a-4ed2-a59a-f4c973212d0c admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:47.206167 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-126691e5-526b-4908-9df4-079604a883a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49fe41da0b08454696f9d9e4db9c62d3'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:47.211084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe0038-e17a-4ed2-a59a-f4c973212d0c admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:47.220480 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0227c8d-66e0-41c1-93cc-e1292ed5c74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:47.222136 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0227c8d-66e0-41c1-93cc-e1292ed5c74a admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:47.222792 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0227c8d-66e0-41c1-93cc-e1292ed5c74a admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:47.223331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0227c8d-66e0-41c1-93cc-e1292ed5c74a admin admin] PATH_INFO: `/v3/projects/12b08389bdb549608d71db0fe390d094/users/3898d3e5ed5f4254910453f9c6b27129/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:47.244908 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0227c8d-66e0-41c1-93cc-e1292ed5c74a admin admin] RBAC: Authorizing `identity:create_grant(project_id=12b08389bdb549608d71db0fe390d094, user_id=3898d3e5ed5f4254910453f9c6b27129, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:47.247607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0227c8d-66e0-41c1-93cc-e1292ed5c74a admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:47.302939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-126691e5-526b-4908-9df4-079604a883a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49fe41da0b08454696f9d9e4db9c62d3'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:47.310707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 922/1850] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:54:46 2022] DELETE /identity/v3/users/49fe41da0b08454696f9d9e4db9c62d3 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:54:47.352815 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 929/1851] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:47 2022] PUT /identity/v3/projects/12b08389bdb549608d71db0fe390d094/users/3898d3e5ed5f4254910453f9c6b27129/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:54:47.356148 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126691e5-526b-4908-9df4-079604a883a6 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:47.357607 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-126691e5-526b-4908-9df4-079604a883a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:47.458873 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126691e5-526b-4908-9df4-079604a883a6 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:47.573563 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3c8fb-66bf-4c25-8dab-75278266b03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:47.574309 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3c8fb-66bf-4c25-8dab-75278266b03e admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:47.574623 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3c8fb-66bf-4c25-8dab-75278266b03e admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:47.574902 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3c8fb-66bf-4c25-8dab-75278266b03e admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:47.575681 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3c8fb-66bf-4c25-8dab-75278266b03e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:47.578728 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3c8fb-66bf-4c25-8dab-75278266b03e admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:47.597593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 923/1852] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:47.601887 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0227c8d-66e0-41c1-93cc-e1292ed5c74a admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:47.619397 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0227c8d-66e0-41c1-93cc-e1292ed5c74a admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:47.633935 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a0c6d-7c45-4f5d-bfdb-483e0bbaaa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:47.638483 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a0c6d-7c45-4f5d-bfdb-483e0bbaaa8f admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:47.638483 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a0c6d-7c45-4f5d-bfdb-483e0bbaaa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:47.638483 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a0c6d-7c45-4f5d-bfdb-483e0bbaaa8f admin admin] PATH_INFO: `/v3/projects/12b08389bdb549608d71db0fe390d094/users/3898d3e5ed5f4254910453f9c6b27129/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:47.638483 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a0c6d-7c45-4f5d-bfdb-483e0bbaaa8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=12b08389bdb549608d71db0fe390d094, user_id=3898d3e5ed5f4254910453f9c6b27129, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:47.641145 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a0c6d-7c45-4f5d-bfdb-483e0bbaaa8f admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:47.652526 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 930/1853] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:47 2022] PUT /identity/v3/projects/12b08389bdb549608d71db0fe390d094/users/3898d3e5ed5f4254910453f9c6b27129/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:47.670365 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c466df-7673-4bf0-b6aa-43ec92354a26 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:47.670661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c466df-7673-4bf0-b6aa-43ec92354a26 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:47.671055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c466df-7673-4bf0-b6aa-43ec92354a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:47.705893 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-00c466df-7673-4bf0-b6aa-43ec92354a26 None None] MFA Rules not processed for user `3898d3e5ed5f4254910453f9c6b27129`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:47.707748 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-00c466df-7673-4bf0-b6aa-43ec92354a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:47.743182 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:47.884647 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:47.895037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 924/1854] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:47.909822 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a0c6d-7c45-4f5d-bfdb-483e0bbaaa8f admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:47.912044 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-6a3a0c6d-7c45-4f5d-bfdb-483e0bbaaa8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:48.030130 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a0c6d-7c45-4f5d-bfdb-483e0bbaaa8f admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:48.034051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800a6ea-7b0c-4667-ac15-7fb1abb35139 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:48.034680 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800a6ea-7b0c-4667-ac15-7fb1abb35139 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:48.034957 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800a6ea-7b0c-4667-ac15-7fb1abb35139 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:48.035230 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800a6ea-7b0c-4667-ac15-7fb1abb35139 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:48.045791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800a6ea-7b0c-4667-ac15-7fb1abb35139 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:48.048607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800a6ea-7b0c-4667-ac15-7fb1abb35139 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:48.060724 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 931/1855] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:47 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:48.177344 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c466df-7673-4bf0-b6aa-43ec92354a26 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:48.186453 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-00c466df-7673-4bf0-b6aa-43ec92354a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:48.197650 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800a6ea-7b0c-4667-ac15-7fb1abb35139 service cinder] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:48.210531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800a6ea-7b0c-4667-ac15-7fb1abb35139 service cinder] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:48.219965 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca15c3-663b-4f57-a08e-0813fbd48028 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:48.220928 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca15c3-663b-4f57-a08e-0813fbd48028 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:48.221382 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca15c3-663b-4f57-a08e-0813fbd48028 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:48.221945 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca15c3-663b-4f57-a08e-0813fbd48028 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:48.227940 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-7aca15c3-663b-4f57-a08e-0813fbd48028 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:48.330058 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c466df-7673-4bf0-b6aa-43ec92354a26 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:48.347286 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ddd13-5601-498e-973f-92e85eee7084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:48.347987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ddd13-5601-498e-973f-92e85eee7084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:48.348267 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ddd13-5601-498e-973f-92e85eee7084 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:48.348543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ddd13-5601-498e-973f-92e85eee7084 admin admin] PATH_INFO: `/v3/projects/a9e58201247c4e91bdab482ade41b0e2` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:48.360358 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ddd13-5601-498e-973f-92e85eee7084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9e58201247c4e91bdab482ade41b0e2)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:48.363919 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ddd13-5601-498e-973f-92e85eee7084 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:48.380469 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca15c3-663b-4f57-a08e-0813fbd48028 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:48.382015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca15c3-663b-4f57-a08e-0813fbd48028 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:48.400241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 932/1856] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 13:54:48.497451 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-300ddd13-5601-498e-973f-92e85eee7084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9e58201247c4e91bdab482ade41b0e2', 'request_id': 'req-300ddd13-5601-498e-973f-92e85eee7084'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:48.509356 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-300ddd13-5601-498e-973f-92e85eee7084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9e58201247c4e91bdab482ade41b0e2', 'request_id': 'req-300ddd13-5601-498e-973f-92e85eee7084'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:48.522280 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-300ddd13-5601-498e-973f-92e85eee7084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9e58201247c4e91bdab482ade41b0e2', 'request_id': 'req-300ddd13-5601-498e-973f-92e85eee7084'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:48.664416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-300ddd13-5601-498e-973f-92e85eee7084 admin admin] The token cache is being invalidate because project a9e58201247c4e91bdab482ade41b0e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:54:48.664608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-300ddd13-5601-498e-973f-92e85eee7084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:48.665289 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-300ddd13-5601-498e-973f-92e85eee7084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:48.666864 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 925/1857] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:54:48 2022] DELETE /identity/v3/projects/a9e58201247c4e91bdab482ade41b0e2 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:48.673851 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefa032-155e-4437-8055-50318a7ffc82 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:48.674161 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefa032-155e-4437-8055-50318a7ffc82 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:48.674473 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefa032-155e-4437-8055-50318a7ffc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:48.700826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-bdefa032-155e-4437-8055-50318a7ffc82 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:48.703001 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-bdefa032-155e-4437-8055-50318a7ffc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:48.770164 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 933/1858] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:54:48.781572 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f9413-070d-4d86-859b-34f965095b01 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:48.782146 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f9413-070d-4d86-859b-34f965095b01 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:48.782868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f9413-070d-4d86-859b-34f965095b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:48.809912 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-f62f9413-070d-4d86-859b-34f965095b01 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:48.811150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-f62f9413-070d-4d86-859b-34f965095b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:48.820320 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 926/1859] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:48.824800 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefa032-155e-4437-8055-50318a7ffc82 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:48.836023 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefa032-155e-4437-8055-50318a7ffc82 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:48.843808 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7861e-ca73-487b-9768-c1b501748f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:48.845623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7861e-ca73-487b-9768-c1b501748f78 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:48.845623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7861e-ca73-487b-9768-c1b501748f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:48.845623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7861e-ca73-487b-9768-c1b501748f78 admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:48.846124 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7861e-ca73-487b-9768-c1b501748f78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:54:48.846449 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7861e-ca73-487b-9768-c1b501748f78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:48.848149 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7861e-ca73-487b-9768-c1b501748f78 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:48.864241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 934/1860] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:54:48.867989 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f9413-070d-4d86-859b-34f965095b01 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:48.882805 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f9413-070d-4d86-859b-34f965095b01 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:48.889507 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def91e85-0b31-42d2-af99-01bcc15c8d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:48.892071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def91e85-0b31-42d2-af99-01bcc15c8d96 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:48.892903 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def91e85-0b31-42d2-af99-01bcc15c8d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:48.893670 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def91e85-0b31-42d2-af99-01bcc15c8d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:48.895256 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def91e85-0b31-42d2-af99-01bcc15c8d96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:48.899351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def91e85-0b31-42d2-af99-01bcc15c8d96 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:49.036726 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 927/1861] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:48 2022] POST /identity/v3/projects => generated 371 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:49.042183 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7861e-ca73-487b-9768-c1b501748f78 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:49.076701 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7861e-ca73-487b-9768-c1b501748f78 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:49.180571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc041c-638a-4d97-b2dc-186d8e54da87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:49.181076 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc041c-638a-4d97-b2dc-186d8e54da87 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:49.181362 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc041c-638a-4d97-b2dc-186d8e54da87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:49.181732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc041c-638a-4d97-b2dc-186d8e54da87 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:49.183160 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc041c-638a-4d97-b2dc-186d8e54da87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:49.186128 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc041c-638a-4d97-b2dc-186d8e54da87 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:49.270920 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 935/1862] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:49 2022] POST /identity/v3/users => generated 286 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:49.276751 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def91e85-0b31-42d2-af99-01bcc15c8d96 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:49.296822 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def91e85-0b31-42d2-af99-01bcc15c8d96 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:49.303067 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c14b35-ed85-42e1-bb7f-2c9745ab11d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:49.303775 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c14b35-ed85-42e1-bb7f-2c9745ab11d9 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:49.304056 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c14b35-ed85-42e1-bb7f-2c9745ab11d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:49.304525 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c14b35-ed85-42e1-bb7f-2c9745ab11d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:49.305503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c14b35-ed85-42e1-bb7f-2c9745ab11d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:49.307698 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c14b35-ed85-42e1-bb7f-2c9745ab11d9 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:49.325194 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 928/1863] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 13:54:49.329731 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc041c-638a-4d97-b2dc-186d8e54da87 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:49.341809 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc041c-638a-4d97-b2dc-186d8e54da87 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:49.348746 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674d29b-e22c-4743-b73e-f6558352cd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:49.349401 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674d29b-e22c-4743-b73e-f6558352cd26 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:49.349792 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674d29b-e22c-4743-b73e-f6558352cd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:49.350074 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674d29b-e22c-4743-b73e-f6558352cd26 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:49.351064 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674d29b-e22c-4743-b73e-f6558352cd26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:49.352766 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674d29b-e22c-4743-b73e-f6558352cd26 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:49.371588 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 936/1864] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:49.373048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c14b35-ed85-42e1-bb7f-2c9745ab11d9 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:49.386301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c14b35-ed85-42e1-bb7f-2c9745ab11d9 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:49.392913 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9136cc-c8e4-4d86-80cf-3c417cacf55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:49.393972 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9136cc-c8e4-4d86-80cf-3c417cacf55a admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:49.394659 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9136cc-c8e4-4d86-80cf-3c417cacf55a admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:49.395127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9136cc-c8e4-4d86-80cf-3c417cacf55a admin admin] PATH_INFO: `/v3/projects/968f9a32cda845c08b651c84fc8fefa3/users/0ced8dd99ea44f788bb594c0bca908f0/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:49.419556 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9136cc-c8e4-4d86-80cf-3c417cacf55a admin admin] RBAC: Authorizing `identity:create_grant(project_id=968f9a32cda845c08b651c84fc8fefa3, user_id=0ced8dd99ea44f788bb594c0bca908f0, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:49.422288 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9136cc-c8e4-4d86-80cf-3c417cacf55a admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:49.502650 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 929/1865] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:49 2022] PUT /identity/v3/projects/968f9a32cda845c08b651c84fc8fefa3/users/0ced8dd99ea44f788bb594c0bca908f0/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:49.519299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f4349-9ab2-487e-8d79-d40da9290491 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:49.519299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f4349-9ab2-487e-8d79-d40da9290491 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:49.519299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f4349-9ab2-487e-8d79-d40da9290491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:49.547616 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-384f4349-9ab2-487e-8d79-d40da9290491 None None] MFA Rules not processed for user `0ced8dd99ea44f788bb594c0bca908f0`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:49.549239 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-384f4349-9ab2-487e-8d79-d40da9290491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:49.588973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:49.702108 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 937/1866] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:49.713521 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9136cc-c8e4-4d86-80cf-3c417cacf55a admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:49.715380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-2c9136cc-c8e4-4d86-80cf-3c417cacf55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:49.794374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9136cc-c8e4-4d86-80cf-3c417cacf55a admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:49.798980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df7d08-97b4-4731-915f-90358568aa6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:49.799644 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df7d08-97b4-4731-915f-90358568aa6f service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:49.799928 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df7d08-97b4-4731-915f-90358568aa6f service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:49.800324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df7d08-97b4-4731-915f-90358568aa6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:49.814608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df7d08-97b4-4731-915f-90358568aa6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:49.816113 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df7d08-97b4-4731-915f-90358568aa6f service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:49.842801 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 930/1867] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:49.883928 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f4349-9ab2-487e-8d79-d40da9290491 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:49.998539 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f4349-9ab2-487e-8d79-d40da9290491 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:50.006729 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af1977-a670-4754-9617-0fcb448362c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:50.008218 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af1977-a670-4754-9617-0fcb448362c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:50.008504 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af1977-a670-4754-9617-0fcb448362c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:50.008838 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af1977-a670-4754-9617-0fcb448362c9 admin admin] PATH_INFO: `/v3/users/0ced8dd99ea44f788bb594c0bca908f0` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:50.010114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af1977-a670-4754-9617-0fcb448362c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ced8dd99ea44f788bb594c0bca908f0)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:50.012521 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af1977-a670-4754-9617-0fcb448362c9 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:50.069726 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:50.296492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-55af1977-a670-4754-9617-0fcb448362c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ced8dd99ea44f788bb594c0bca908f0'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:50.428378 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-55af1977-a670-4754-9617-0fcb448362c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ced8dd99ea44f788bb594c0bca908f0'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:50.438842 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-55af1977-a670-4754-9617-0fcb448362c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ced8dd99ea44f788bb594c0bca908f0'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:50.470703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-55af1977-a670-4754-9617-0fcb448362c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ced8dd99ea44f788bb594c0bca908f0'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:50.470703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-55af1977-a670-4754-9617-0fcb448362c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ced8dd99ea44f788bb594c0bca908f0'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:50.508567 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 938/1868] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:54:49 2022] DELETE /identity/v3/users/0ced8dd99ea44f788bb594c0bca908f0 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:50.511500 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f650e-a40f-430e-860a-96d73a73db2d None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:50.511779 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f650e-a40f-430e-860a-96d73a73db2d None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:50.512305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f650e-a40f-430e-860a-96d73a73db2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:50.559004 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-754f650e-a40f-430e-860a-96d73a73db2d None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:50.560258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-754f650e-a40f-430e-860a-96d73a73db2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:50.668967 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 931/1869] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:50.689316 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af1977-a670-4754-9617-0fcb448362c9 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:50.690759 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-55af1977-a670-4754-9617-0fcb448362c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:50.776970 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af1977-a670-4754-9617-0fcb448362c9 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:50.781053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69939d-eb7a-4473-9a31-af68e12c10b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:50.781821 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69939d-eb7a-4473-9a31-af68e12c10b1 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:50.785646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69939d-eb7a-4473-9a31-af68e12c10b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:50.785646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69939d-eb7a-4473-9a31-af68e12c10b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:50.793823 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69939d-eb7a-4473-9a31-af68e12c10b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:50.795270 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69939d-eb7a-4473-9a31-af68e12c10b1 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:50.806680 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 939/1870] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:51.641071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f650e-a40f-430e-860a-96d73a73db2d None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:51.642468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-754f650e-a40f-430e-860a-96d73a73db2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:51.663403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f650e-a40f-430e-860a-96d73a73db2d None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:51.669297 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93551ed2-0f72-4c19-800e-072c254d21f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:51.670147 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93551ed2-0f72-4c19-800e-072c254d21f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:51.670495 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93551ed2-0f72-4c19-800e-072c254d21f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:51.670839 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93551ed2-0f72-4c19-800e-072c254d21f8 admin admin] PATH_INFO: `/v3/users/58e06922dcde4f3c9eddf05cc826abfc` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:51.672898 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93551ed2-0f72-4c19-800e-072c254d21f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58e06922dcde4f3c9eddf05cc826abfc)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:51.676020 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93551ed2-0f72-4c19-800e-072c254d21f8 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:52.663597 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69939d-eb7a-4473-9a31-af68e12c10b1 service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:52.669358 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ff69939d-eb7a-4473-9a31-af68e12c10b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:52.692766 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69939d-eb7a-4473-9a31-af68e12c10b1 service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:52.700716 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5330801-9b72-41ef-afb9-8cebecd4fe55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:52.700716 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5330801-9b72-41ef-afb9-8cebecd4fe55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:52.700716 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5330801-9b72-41ef-afb9-8cebecd4fe55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:52.700716 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5330801-9b72-41ef-afb9-8cebecd4fe55 admin admin] PATH_INFO: `/v3/projects/968f9a32cda845c08b651c84fc8fefa3` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:52.703618 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5330801-9b72-41ef-afb9-8cebecd4fe55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=968f9a32cda845c08b651c84fc8fefa3)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:52.705641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5330801-9b72-41ef-afb9-8cebecd4fe55 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:52.969805 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-93551ed2-0f72-4c19-800e-072c254d21f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58e06922dcde4f3c9eddf05cc826abfc'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:52.971325 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-93551ed2-0f72-4c19-800e-072c254d21f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58e06922dcde4f3c9eddf05cc826abfc'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:52.989341 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-93551ed2-0f72-4c19-800e-072c254d21f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58e06922dcde4f3c9eddf05cc826abfc'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:53.007338 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-93551ed2-0f72-4c19-800e-072c254d21f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58e06922dcde4f3c9eddf05cc826abfc'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:53.044240 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a5330801-9b72-41ef-afb9-8cebecd4fe55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '968f9a32cda845c08b651c84fc8fefa3', 'request_id': 'req-a5330801-9b72-41ef-afb9-8cebecd4fe55'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:53.051802 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a5330801-9b72-41ef-afb9-8cebecd4fe55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '968f9a32cda845c08b651c84fc8fefa3', 'request_id': 'req-a5330801-9b72-41ef-afb9-8cebecd4fe55'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:53.103948 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-93551ed2-0f72-4c19-800e-072c254d21f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58e06922dcde4f3c9eddf05cc826abfc'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:53.112380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 932/1871] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:54:51 2022] DELETE /identity/v3/users/58e06922dcde4f3c9eddf05cc826abfc => generated 0 bytes in 1473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:53.117603 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a189fd-b200-4e05-9fda-27ca08ecf2d5 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:53.118083 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a189fd-b200-4e05-9fda-27ca08ecf2d5 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:53.118560 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a189fd-b200-4e05-9fda-27ca08ecf2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:53.149024 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-e6a189fd-b200-4e05-9fda-27ca08ecf2d5 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:53.150248 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-e6a189fd-b200-4e05-9fda-27ca08ecf2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:53.216881 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a5330801-9b72-41ef-afb9-8cebecd4fe55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '968f9a32cda845c08b651c84fc8fefa3', 'request_id': 'req-a5330801-9b72-41ef-afb9-8cebecd4fe55'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:53.216881 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a5330801-9b72-41ef-afb9-8cebecd4fe55 admin admin] The token cache is being invalidate because project 968f9a32cda845c08b651c84fc8fefa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:54:53.216881 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a5330801-9b72-41ef-afb9-8cebecd4fe55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:53.216881 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a5330801-9b72-41ef-afb9-8cebecd4fe55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:53.218625 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 940/1872] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:54:52 2022] DELETE /identity/v3/projects/968f9a32cda845c08b651c84fc8fefa3 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:53.220116 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 933/1873] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:54:53.233128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a189fd-b200-4e05-9fda-27ca08ecf2d5 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:53.233325 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509fb70-60f8-47cb-b548-7573276c81af None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:53.233640 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509fb70-60f8-47cb-b548-7573276c81af None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:53.234659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509fb70-60f8-47cb-b548-7573276c81af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:53.237244 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-e6a189fd-b200-4e05-9fda-27ca08ecf2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:53.275794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-8509fb70-60f8-47cb-b548-7573276c81af None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:53.277632 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-8509fb70-60f8-47cb-b548-7573276c81af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:53.305139 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 941/1874] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:53.316479 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f335d83-1e5a-406d-9890-98d113497cb4 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:53.317195 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f335d83-1e5a-406d-9890-98d113497cb4 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:53.317697 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f335d83-1e5a-406d-9890-98d113497cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:53.346983 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-0f335d83-1e5a-406d-9890-98d113497cb4 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:53.348532 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-0f335d83-1e5a-406d-9890-98d113497cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:53.361425 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 942/1875] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:53.366933 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f335d83-1e5a-406d-9890-98d113497cb4 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:53.368738 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-0f335d83-1e5a-406d-9890-98d113497cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:53.382955 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a189fd-b200-4e05-9fda-27ca08ecf2d5 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:53.384812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f335d83-1e5a-406d-9890-98d113497cb4 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:53.389146 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc548cc6-1ad9-4ae6-b8b4-df7ae4512da4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:53.390238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc548cc6-1ad9-4ae6-b8b4-df7ae4512da4 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:53.390759 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc548cc6-1ad9-4ae6-b8b4-df7ae4512da4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:53.391236 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc548cc6-1ad9-4ae6-b8b4-df7ae4512da4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:53.392489 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ec6ca-c364-4b64-a5e2-86b3414e2d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:53.397981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ec6ca-c364-4b64-a5e2-86b3414e2d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:53.397981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ec6ca-c364-4b64-a5e2-86b3414e2d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:53.397981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ec6ca-c364-4b64-a5e2-86b3414e2d16 admin admin] PATH_INFO: `/v3/users/06701b1e91394c8d87de9f0bbd6b047e` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:53.398493 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-bc548cc6-1ad9-4ae6-b8b4-df7ae4512da4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:53.398662 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ec6ca-c364-4b64-a5e2-86b3414e2d16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06701b1e91394c8d87de9f0bbd6b047e)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:53.399068 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ec6ca-c364-4b64-a5e2-86b3414e2d16 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:53.425980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc548cc6-1ad9-4ae6-b8b4-df7ae4512da4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:53.433086 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc548cc6-1ad9-4ae6-b8b4-df7ae4512da4 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:53.447861 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 934/1876] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:53.448985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc548cc6-1ad9-4ae6-b8b4-df7ae4512da4 service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:53.463673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:53.468040 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc548cc6-1ad9-4ae6-b8b4-df7ae4512da4 service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:53.473117 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa18608-0de4-40da-947c-19a0c90586e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:53.473740 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa18608-0de4-40da-947c-19a0c90586e3 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:53.474028 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa18608-0de4-40da-947c-19a0c90586e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:53.474303 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa18608-0de4-40da-947c-19a0c90586e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:53.474972 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa18608-0de4-40da-947c-19a0c90586e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:54:53.475597 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa18608-0de4-40da-947c-19a0c90586e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:53.477288 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa18608-0de4-40da-947c-19a0c90586e3 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:53.491541 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 935/1877] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:54:53.496018 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa18608-0de4-40da-947c-19a0c90586e3 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:53.516079 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa18608-0de4-40da-947c-19a0c90586e3 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:53.524079 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb41c3-56d5-4ec2-9eb2-b5cf853dd069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:53.525033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb41c3-56d5-4ec2-9eb2-b5cf853dd069 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:53.525402 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb41c3-56d5-4ec2-9eb2-b5cf853dd069 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:53.525876 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb41c3-56d5-4ec2-9eb2-b5cf853dd069 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:53.526765 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb41c3-56d5-4ec2-9eb2-b5cf853dd069 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:53.528939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb41c3-56d5-4ec2-9eb2-b5cf853dd069 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:53.699498 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 936/1878] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:53 2022] POST /identity/v3/projects => generated 373 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:53.704287 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb41c3-56d5-4ec2-9eb2-b5cf853dd069 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:53.713747 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-7f0ec6ca-c364-4b64-a5e2-86b3414e2d16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06701b1e91394c8d87de9f0bbd6b047e'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:53.830541 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb41c3-56d5-4ec2-9eb2-b5cf853dd069 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:53.842812 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74df66-9f46-418a-bfac-52707c23ce64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:53.844243 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74df66-9f46-418a-bfac-52707c23ce64 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:53.844529 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74df66-9f46-418a-bfac-52707c23ce64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:53.844805 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74df66-9f46-418a-bfac-52707c23ce64 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:53.848647 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74df66-9f46-418a-bfac-52707c23ce64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:53.851199 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74df66-9f46-418a-bfac-52707c23ce64 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:53.926025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-7f0ec6ca-c364-4b64-a5e2-86b3414e2d16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06701b1e91394c8d87de9f0bbd6b047e'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:53.961537 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 937/1879] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:53 2022] POST /identity/v3/users => generated 287 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:54:53.965487 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74df66-9f46-418a-bfac-52707c23ce64 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:53.967387 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-7f0ec6ca-c364-4b64-a5e2-86b3414e2d16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06701b1e91394c8d87de9f0bbd6b047e'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:53.987078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74df66-9f46-418a-bfac-52707c23ce64 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:53.996009 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-7f0ec6ca-c364-4b64-a5e2-86b3414e2d16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06701b1e91394c8d87de9f0bbd6b047e'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:53.997457 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-7f0ec6ca-c364-4b64-a5e2-86b3414e2d16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06701b1e91394c8d87de9f0bbd6b047e'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:54.001819 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409345b-b123-4dce-9051-43df9e8d27fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:54.002454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409345b-b123-4dce-9051-43df9e8d27fe admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:54.002793 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409345b-b123-4dce-9051-43df9e8d27fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:54.003008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409345b-b123-4dce-9051-43df9e8d27fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:54.003684 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409345b-b123-4dce-9051-43df9e8d27fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:54.006136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409345b-b123-4dce-9051-43df9e8d27fe admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:54.018011 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 943/1880] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:54:53 2022] DELETE /identity/v3/users/06701b1e91394c8d87de9f0bbd6b047e => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:54.023405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dd5bd-faf3-4be3-9f72-5563d4768bc9 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:54.023771 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dd5bd-faf3-4be3-9f72-5563d4768bc9 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:54.024301 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dd5bd-faf3-4be3-9f72-5563d4768bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:54.028307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 938/1881] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:54.033034 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409345b-b123-4dce-9051-43df9e8d27fe admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:54.038456 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-8409345b-b123-4dce-9051-43df9e8d27fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:54.054397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409345b-b123-4dce-9051-43df9e8d27fe admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:54.076148 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-874dd5bd-faf3-4be3-9f72-5563d4768bc9 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:54.078561 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-874dd5bd-faf3-4be3-9f72-5563d4768bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:54.221395 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aef124-a627-4910-95a7-079b61b906fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:54.222173 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aef124-a627-4910-95a7-079b61b906fe admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:54.222537 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aef124-a627-4910-95a7-079b61b906fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:54.223023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aef124-a627-4910-95a7-079b61b906fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:54.223440 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 944/1882] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:54:54.223884 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aef124-a627-4910-95a7-079b61b906fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:54.225831 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aef124-a627-4910-95a7-079b61b906fe admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:54.238311 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 939/1883] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:54.241440 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874dd5bd-faf3-4be3-9f72-5563d4768bc9 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:54.244511 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aef124-a627-4910-95a7-079b61b906fe admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:54.251901 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-49aef124-a627-4910-95a7-079b61b906fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:54.269279 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874dd5bd-faf3-4be3-9f72-5563d4768bc9 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:54.277697 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e11a8-704b-4c8b-9739-aee087915592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:54.278751 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e11a8-704b-4c8b-9739-aee087915592 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:54.279103 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e11a8-704b-4c8b-9739-aee087915592 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:54.279499 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e11a8-704b-4c8b-9739-aee087915592 admin admin] PATH_INFO: `/v3/projects/872714a31bdf46ddad040f1bc4b659da/users/3043eb81894f4525ac2d153da8bd3e2d/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:54.312672 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e11a8-704b-4c8b-9739-aee087915592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=872714a31bdf46ddad040f1bc4b659da, user_id=3043eb81894f4525ac2d153da8bd3e2d, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:54.316490 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e11a8-704b-4c8b-9739-aee087915592 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:54.366044 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aef124-a627-4910-95a7-079b61b906fe admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:54.377210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd231d-fd4e-435e-887f-b2a3354857c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:54.377210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd231d-fd4e-435e-887f-b2a3354857c7 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:54.377210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd231d-fd4e-435e-887f-b2a3354857c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:54.377210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd231d-fd4e-435e-887f-b2a3354857c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:54.386298 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd231d-fd4e-435e-887f-b2a3354857c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:54.387787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd231d-fd4e-435e-887f-b2a3354857c7 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:54.399943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 940/1884] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:54.403125 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 945/1885] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:54 2022] PUT /identity/v3/projects/872714a31bdf46ddad040f1bc4b659da/users/3043eb81894f4525ac2d153da8bd3e2d/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:54.409585 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a556402-1e64-4997-97fd-e91d231cb79b None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:54.409872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a556402-1e64-4997-97fd-e91d231cb79b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:54.410276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a556402-1e64-4997-97fd-e91d231cb79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:54.430241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e11a8-704b-4c8b-9739-aee087915592 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:54.430468 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c18e11a8-704b-4c8b-9739-aee087915592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:54.443784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-2a556402-1e64-4997-97fd-e91d231cb79b None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:54.444953 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-2a556402-1e64-4997-97fd-e91d231cb79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:54.505078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e11a8-704b-4c8b-9739-aee087915592 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:54.509619 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835e8bd-6e53-47d7-92bd-f9ad2a38e2d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:54.510234 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835e8bd-6e53-47d7-92bd-f9ad2a38e2d1 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:54.510515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835e8bd-6e53-47d7-92bd-f9ad2a38e2d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:54.510784 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835e8bd-6e53-47d7-92bd-f9ad2a38e2d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:54.512903 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-4835e8bd-6e53-47d7-92bd-f9ad2a38e2d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:54.523164 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 941/1886] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:54.524137 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a556402-1e64-4997-97fd-e91d231cb79b None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:54.541017 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835e8bd-6e53-47d7-92bd-f9ad2a38e2d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:54.541017 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835e8bd-6e53-47d7-92bd-f9ad2a38e2d1 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:54.544991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a556402-1e64-4997-97fd-e91d231cb79b None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:54.553850 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819dec5-574b-487b-80f1-5612c803180f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:54.554473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819dec5-574b-487b-80f1-5612c803180f service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:54.554755 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819dec5-574b-487b-80f1-5612c803180f service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:54.555028 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819dec5-574b-487b-80f1-5612c803180f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:54.556657 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 946/1887] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 13:54:54.558562 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835e8bd-6e53-47d7-92bd-f9ad2a38e2d1 service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:54.585140 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819dec5-574b-487b-80f1-5612c803180f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:54.586672 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819dec5-574b-487b-80f1-5612c803180f service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:54.596317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835e8bd-6e53-47d7-92bd-f9ad2a38e2d1 service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:54.601057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c22ac-372f-4e83-996d-42af22405e31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:54.601675 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c22ac-372f-4e83-996d-42af22405e31 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:54.602043 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c22ac-372f-4e83-996d-42af22405e31 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:54.602307 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c22ac-372f-4e83-996d-42af22405e31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:54.606878 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 942/1888] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:54.607743 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819dec5-574b-487b-80f1-5612c803180f service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:54.612425 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c22ac-372f-4e83-996d-42af22405e31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:54.613918 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c22ac-372f-4e83-996d-42af22405e31 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:54.625820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 947/1889] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:54.629676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c22ac-372f-4e83-996d-42af22405e31 service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:54.629676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-496c22ac-372f-4e83-996d-42af22405e31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:54.631883 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819dec5-574b-487b-80f1-5612c803180f service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:54.637050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56767f8-bb3b-474f-abc2-ec9137ce7b61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:54.637594 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56767f8-bb3b-474f-abc2-ec9137ce7b61 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:54.637931 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56767f8-bb3b-474f-abc2-ec9137ce7b61 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:54.638208 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56767f8-bb3b-474f-abc2-ec9137ce7b61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:54.649825 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56767f8-bb3b-474f-abc2-ec9137ce7b61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:54.651665 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c22ac-372f-4e83-996d-42af22405e31 service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:54.656238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56767f8-bb3b-474f-abc2-ec9137ce7b61 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:54.658894 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cf385-2ead-43a9-bd8b-0d1a3683d44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:54.659643 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cf385-2ead-43a9-bd8b-0d1a3683d44a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:54.659927 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cf385-2ead-43a9-bd8b-0d1a3683d44a admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:54.660202 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cf385-2ead-43a9-bd8b-0d1a3683d44a admin admin] PATH_INFO: `/v3/projects/7cd226ed69604b8281bac05b3df45659` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:54.661467 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40cf385-2ead-43a9-bd8b-0d1a3683d44a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cd226ed69604b8281bac05b3df45659)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:54.662231 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 943/1890] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:54.663104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56767f8-bb3b-474f-abc2-ec9137ce7b61 service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:54.663599 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40cf385-2ead-43a9-bd8b-0d1a3683d44a admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:54.674403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56767f8-bb3b-474f-abc2-ec9137ce7b61 service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:54.679823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8da78f-84d3-4187-8ff5-6dd08e77fbbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:54.680441 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8da78f-84d3-4187-8ff5-6dd08e77fbbd service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:54.681025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8da78f-84d3-4187-8ff5-6dd08e77fbbd service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:54.681348 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8da78f-84d3-4187-8ff5-6dd08e77fbbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:54.695406 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8da78f-84d3-4187-8ff5-6dd08e77fbbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:54.696967 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8da78f-84d3-4187-8ff5-6dd08e77fbbd service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:54.713885 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 944/1891] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:54.714499 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8da78f-84d3-4187-8ff5-6dd08e77fbbd service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:54.716534 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-0a8da78f-84d3-4187-8ff5-6dd08e77fbbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:54.731981 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8da78f-84d3-4187-8ff5-6dd08e77fbbd service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:54.736974 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43579518-cea6-4642-bada-359b5a847b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:54.737674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43579518-cea6-4642-bada-359b5a847b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:54.738111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43579518-cea6-4642-bada-359b5a847b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:54.738386 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43579518-cea6-4642-bada-359b5a847b93 admin admin] PATH_INFO: `/v3/users/b4d1d4e0d2e5453c8c4be1b04da372a9` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:54.739881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43579518-cea6-4642-bada-359b5a847b93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4d1d4e0d2e5453c8c4be1b04da372a9)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:54.742397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43579518-cea6-4642-bada-359b5a847b93 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:54.811203 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a40cf385-2ead-43a9-bd8b-0d1a3683d44a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cd226ed69604b8281bac05b3df45659', 'request_id': 'req-a40cf385-2ead-43a9-bd8b-0d1a3683d44a'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:54.825453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a40cf385-2ead-43a9-bd8b-0d1a3683d44a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cd226ed69604b8281bac05b3df45659', 'request_id': 'req-a40cf385-2ead-43a9-bd8b-0d1a3683d44a'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:54.909210 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a40cf385-2ead-43a9-bd8b-0d1a3683d44a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cd226ed69604b8281bac05b3df45659', 'request_id': 'req-a40cf385-2ead-43a9-bd8b-0d1a3683d44a'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:54.910356 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:54.925106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a40cf385-2ead-43a9-bd8b-0d1a3683d44a admin admin] The token cache is being invalidate because project 7cd226ed69604b8281bac05b3df45659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:54:54.925454 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a40cf385-2ead-43a9-bd8b-0d1a3683d44a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:54.926122 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a40cf385-2ead-43a9-bd8b-0d1a3683d44a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:54.927948 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 948/1892] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:54:54 2022] DELETE /identity/v3/projects/7cd226ed69604b8281bac05b3df45659 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:54.932610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cf385-2ead-43a9-bd8b-0d1a3683d44a admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:54.937420 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a40cf385-2ead-43a9-bd8b-0d1a3683d44a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:55.035082 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cf385-2ead-43a9-bd8b-0d1a3683d44a admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:55.040991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-43579518-cea6-4642-bada-359b5a847b93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4d1d4e0d2e5453c8c4be1b04da372a9'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:55.042595 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36bce7c-2987-4e34-8295-a9f30bb5fd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:55.043157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bce7c-2987-4e34-8295-a9f30bb5fd91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:55.043486 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bce7c-2987-4e34-8295-a9f30bb5fd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:55.043764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bce7c-2987-4e34-8295-a9f30bb5fd91 admin admin] PATH_INFO: `/v3/users/8053b69b3d8045be8182d37eed6862f5` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:55.044148 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-43579518-cea6-4642-bada-359b5a847b93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4d1d4e0d2e5453c8c4be1b04da372a9'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:55.045590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36bce7c-2987-4e34-8295-a9f30bb5fd91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8053b69b3d8045be8182d37eed6862f5)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:55.047769 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36bce7c-2987-4e34-8295-a9f30bb5fd91 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:55.073006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-43579518-cea6-4642-bada-359b5a847b93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4d1d4e0d2e5453c8c4be1b04da372a9'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:55.096740 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-43579518-cea6-4642-bada-359b5a847b93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4d1d4e0d2e5453c8c4be1b04da372a9'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:55.201845 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-43579518-cea6-4642-bada-359b5a847b93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4d1d4e0d2e5453c8c4be1b04da372a9'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:55.210232 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 945/1893] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:54:54 2022] DELETE /identity/v3/users/b4d1d4e0d2e5453c8c4be1b04da372a9 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:55.215109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c74b1-42e1-46a6-9737-d2dc2f521661 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:55.215575 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c74b1-42e1-46a6-9737-d2dc2f521661 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:55.215950 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c74b1-42e1-46a6-9737-d2dc2f521661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:55.242391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-402c74b1-42e1-46a6-9737-d2dc2f521661 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:55.245726 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-402c74b1-42e1-46a6-9737-d2dc2f521661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:55.254615 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-e36bce7c-2987-4e34-8295-a9f30bb5fd91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8053b69b3d8045be8182d37eed6862f5'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:55.329494 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 946/1894] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:55.344796 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c74b1-42e1-46a6-9737-d2dc2f521661 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:55.347690 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-402c74b1-42e1-46a6-9737-d2dc2f521661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:55.366851 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-e36bce7c-2987-4e34-8295-a9f30bb5fd91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8053b69b3d8045be8182d37eed6862f5'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:55.377931 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-e36bce7c-2987-4e34-8295-a9f30bb5fd91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8053b69b3d8045be8182d37eed6862f5'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:55.390229 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-e36bce7c-2987-4e34-8295-a9f30bb5fd91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8053b69b3d8045be8182d37eed6862f5'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:55.391401 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-e36bce7c-2987-4e34-8295-a9f30bb5fd91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8053b69b3d8045be8182d37eed6862f5'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:55.403258 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 949/1895] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:54:54 2022] DELETE /identity/v3/users/8053b69b3d8045be8182d37eed6862f5 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:54:55.430095 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c74b1-42e1-46a6-9737-d2dc2f521661 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:55.523837 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed04d2c-8aaa-4743-92ce-088fbf1e96d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:55.525154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed04d2c-8aaa-4743-92ce-088fbf1e96d4 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:55.525809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed04d2c-8aaa-4743-92ce-088fbf1e96d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:55.527335 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed04d2c-8aaa-4743-92ce-088fbf1e96d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:55.530489 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-6ed04d2c-8aaa-4743-92ce-088fbf1e96d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:55.608020 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed04d2c-8aaa-4743-92ce-088fbf1e96d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:55.609567 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed04d2c-8aaa-4743-92ce-088fbf1e96d4 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:55.622737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 947/1896] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 13:54:55.848623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36bce7c-2987-4e34-8295-a9f30bb5fd91 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:55.853162 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-e36bce7c-2987-4e34-8295-a9f30bb5fd91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:55.876528 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36bce7c-2987-4e34-8295-a9f30bb5fd91 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:55.887557 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1836b28-135b-414a-b187-71ad54c061d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:55.888340 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1836b28-135b-414a-b187-71ad54c061d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:55.888977 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1836b28-135b-414a-b187-71ad54c061d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:55.892307 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1836b28-135b-414a-b187-71ad54c061d5 admin admin] PATH_INFO: `/v3/projects/43ac2a567cfa4f09938217a6b2b43a23` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:55.893893 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1836b28-135b-414a-b187-71ad54c061d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43ac2a567cfa4f09938217a6b2b43a23)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:55.896328 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1836b28-135b-414a-b187-71ad54c061d5 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:56.062825 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a1836b28-135b-414a-b187-71ad54c061d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43ac2a567cfa4f09938217a6b2b43a23', 'request_id': 'req-a1836b28-135b-414a-b187-71ad54c061d5'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:56.070780 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a1836b28-135b-414a-b187-71ad54c061d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43ac2a567cfa4f09938217a6b2b43a23', 'request_id': 'req-a1836b28-135b-414a-b187-71ad54c061d5'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:56.218590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a1836b28-135b-414a-b187-71ad54c061d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43ac2a567cfa4f09938217a6b2b43a23', 'request_id': 'req-a1836b28-135b-414a-b187-71ad54c061d5'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:56.235377 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a1836b28-135b-414a-b187-71ad54c061d5 admin admin] The token cache is being invalidate because project 43ac2a567cfa4f09938217a6b2b43a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:54:56.235902 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a1836b28-135b-414a-b187-71ad54c061d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:56.236672 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a1836b28-135b-414a-b187-71ad54c061d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:56.238924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 950/1897] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:54:55 2022] DELETE /identity/v3/projects/43ac2a567cfa4f09938217a6b2b43a23 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:56.243742 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed04d2c-8aaa-4743-92ce-088fbf1e96d4 service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:56.259994 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed04d2c-8aaa-4743-92ce-088fbf1e96d4 service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:56.294024 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc6728-4c3e-43c5-93e9-2c10d1f9a977 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:56.294695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc6728-4c3e-43c5-93e9-2c10d1f9a977 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:56.294695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc6728-4c3e-43c5-93e9-2c10d1f9a977 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:56.296758 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 951/1898] 10.222.0.50 () {54 vars in 921 bytes} [Thu Sep 1 13:54:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:54:56.341442 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e8300-8b8a-4300-9100-2318c4064ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:56.341936 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e8300-8b8a-4300-9100-2318c4064ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:56.342439 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e8300-8b8a-4300-9100-2318c4064ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:56.342850 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e8300-8b8a-4300-9100-2318c4064ea3 admin admin] PATH_INFO: `/v3/users/3898d3e5ed5f4254910453f9c6b27129` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:56.344390 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e8300-8b8a-4300-9100-2318c4064ea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3898d3e5ed5f4254910453f9c6b27129)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:56.346570 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e8300-8b8a-4300-9100-2318c4064ea3 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:56.488307 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdd010-2bfb-4327-b2a9-a82c2d682ac1 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:56.489095 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdd010-2bfb-4327-b2a9-a82c2d682ac1 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:56.489607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdd010-2bfb-4327-b2a9-a82c2d682ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:56.520134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-a5cdd010-2bfb-4327-b2a9-a82c2d682ac1 None None] MFA Rules not processed for user `2d231136bcd44d9a97efe6c257f936ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:56.522168 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a5cdd010-2bfb-4327-b2a9-a82c2d682ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:56.612090 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 952/1899] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Sep 1 13:54:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:56.657009 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f37e8300-8b8a-4300-9100-2318c4064ea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3898d3e5ed5f4254910453f9c6b27129'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:56.658452 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f37e8300-8b8a-4300-9100-2318c4064ea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3898d3e5ed5f4254910453f9c6b27129'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:56.660101 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdd010-2bfb-4327-b2a9-a82c2d682ac1 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:56.662642 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a5cdd010-2bfb-4327-b2a9-a82c2d682ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:56.697316 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdd010-2bfb-4327-b2a9-a82c2d682ac1 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:56.713364 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f37e8300-8b8a-4300-9100-2318c4064ea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3898d3e5ed5f4254910453f9c6b27129'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:56.716767 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699a71f-51fc-4be6-830c-0e6d52090876 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:56.718104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699a71f-51fc-4be6-830c-0e6d52090876 service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:56.718372 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699a71f-51fc-4be6-830c-0e6d52090876 service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:56.720138 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699a71f-51fc-4be6-830c-0e6d52090876 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:56.734460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:56.735294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f37e8300-8b8a-4300-9100-2318c4064ea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3898d3e5ed5f4254910453f9c6b27129'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:56.743261 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699a71f-51fc-4be6-830c-0e6d52090876 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:56.747493 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699a71f-51fc-4be6-830c-0e6d52090876 service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:56.761654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 953/1900] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:56.856975 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f37e8300-8b8a-4300-9100-2318c4064ea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3898d3e5ed5f4254910453f9c6b27129'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:56.868411 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 948/1901] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:54:56 2022] DELETE /identity/v3/users/3898d3e5ed5f4254910453f9c6b27129 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:56.887400 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:56.948409 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e29b93-b7e8-43cc-98d4-d6af17829f15 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:56.954560 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e29b93-b7e8-43cc-98d4-d6af17829f15 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:56.954560 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e29b93-b7e8-43cc-98d4-d6af17829f15 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:56.954560 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 954/1902] 10.222.0.50 () {54 vars in 921 bytes} [Thu Sep 1 13:54:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:54:56.963901 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7e35b-d6ff-4469-bfac-0de7d3f97ab8 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:56.964195 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7e35b-d6ff-4469-bfac-0de7d3f97ab8 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:56.964469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7e35b-d6ff-4469-bfac-0de7d3f97ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:57.019323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-72b7e35b-d6ff-4469-bfac-0de7d3f97ab8 None None] MFA Rules not processed for user `2d231136bcd44d9a97efe6c257f936ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:57.020612 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-72b7e35b-d6ff-4469-bfac-0de7d3f97ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:57.128193 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 949/1903] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Sep 1 13:54:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:57.190533 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e29b93-b7e8-43cc-98d4-d6af17829f15 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:57.190533 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b5e29b93-b7e8-43cc-98d4-d6af17829f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:57.199391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7e35b-d6ff-4469-bfac-0de7d3f97ab8 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:57.201931 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-72b7e35b-d6ff-4469-bfac-0de7d3f97ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:57.344090 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7e35b-d6ff-4469-bfac-0de7d3f97ab8 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:57.351806 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409b7bf-e9cd-4341-85a5-033d33cb4d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:57.353806 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409b7bf-e9cd-4341-85a5-033d33cb4d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:57.354200 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409b7bf-e9cd-4341-85a5-033d33cb4d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:57.354674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409b7bf-e9cd-4341-85a5-033d33cb4d13 admin admin] PATH_INFO: `/v3/projects/30d60d86e5ac4ef987bced2c88c86a3f` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:57.357318 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409b7bf-e9cd-4341-85a5-033d33cb4d13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30d60d86e5ac4ef987bced2c88c86a3f)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:57.360972 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409b7bf-e9cd-4341-85a5-033d33cb4d13 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:57.424643 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e29b93-b7e8-43cc-98d4-d6af17829f15 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:57.432539 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b40174-da7e-47c3-ad47-8708eff951a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:57.433339 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b40174-da7e-47c3-ad47-8708eff951a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:57.433698 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b40174-da7e-47c3-ad47-8708eff951a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:57.434072 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b40174-da7e-47c3-ad47-8708eff951a2 admin admin] PATH_INFO: `/v3/projects/6aea8f9877ff449fa3d298a131e52094` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:57.439304 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b40174-da7e-47c3-ad47-8708eff951a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aea8f9877ff449fa3d298a131e52094)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:57.448052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b40174-da7e-47c3-ad47-8708eff951a2 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:57.559017 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-7409b7bf-e9cd-4341-85a5-033d33cb4d13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30d60d86e5ac4ef987bced2c88c86a3f', 'request_id': 'req-7409b7bf-e9cd-4341-85a5-033d33cb4d13'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:57.573182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-7409b7bf-e9cd-4341-85a5-033d33cb4d13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30d60d86e5ac4ef987bced2c88c86a3f', 'request_id': 'req-7409b7bf-e9cd-4341-85a5-033d33cb4d13'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:57.595746 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-7409b7bf-e9cd-4341-85a5-033d33cb4d13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30d60d86e5ac4ef987bced2c88c86a3f', 'request_id': 'req-7409b7bf-e9cd-4341-85a5-033d33cb4d13'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:57.658051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-f3b40174-da7e-47c3-ad47-8708eff951a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aea8f9877ff449fa3d298a131e52094', 'request_id': 'req-f3b40174-da7e-47c3-ad47-8708eff951a2'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:57.674268 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-f3b40174-da7e-47c3-ad47-8708eff951a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aea8f9877ff449fa3d298a131e52094', 'request_id': 'req-f3b40174-da7e-47c3-ad47-8708eff951a2'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:57.738652 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-7409b7bf-e9cd-4341-85a5-033d33cb4d13 admin admin] The token cache is being invalidate because project 30d60d86e5ac4ef987bced2c88c86a3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:54:57.739161 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-7409b7bf-e9cd-4341-85a5-033d33cb4d13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:57.739847 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-7409b7bf-e9cd-4341-85a5-033d33cb4d13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:57.741736 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 950/1904] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:54:57 2022] DELETE /identity/v3/projects/30d60d86e5ac4ef987bced2c88c86a3f => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:57.745219 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409b7bf-e9cd-4341-85a5-033d33cb4d13 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:57.745219 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-7409b7bf-e9cd-4341-85a5-033d33cb4d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:57.762507 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:57.823749 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-f3b40174-da7e-47c3-ad47-8708eff951a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aea8f9877ff449fa3d298a131e52094', 'request_id': 'req-f3b40174-da7e-47c3-ad47-8708eff951a2'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:57.849087 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-f3b40174-da7e-47c3-ad47-8708eff951a2 admin admin] The token cache is being invalidate because project 6aea8f9877ff449fa3d298a131e52094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:54:57.849087 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-f3b40174-da7e-47c3-ad47-8708eff951a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:57.853048 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-f3b40174-da7e-47c3-ad47-8708eff951a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:57.855161 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 955/1905] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:54:57 2022] DELETE /identity/v3/projects/6aea8f9877ff449fa3d298a131e52094 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:57.860288 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a0665-9bbd-4293-a0f0-458b030f4505 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:57.860579 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a0665-9bbd-4293-a0f0-458b030f4505 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:57.860923 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a0665-9bbd-4293-a0f0-458b030f4505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:57.871069 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409b7bf-e9cd-4341-85a5-033d33cb4d13 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:57.911834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-278a0665-9bbd-4293-a0f0-458b030f4505 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:57.914991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-278a0665-9bbd-4293-a0f0-458b030f4505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:57.952907 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28344c69-2a4c-4810-a368-257e6fe10f0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:57.954109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28344c69-2a4c-4810-a368-257e6fe10f0b service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:57.955019 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28344c69-2a4c-4810-a368-257e6fe10f0b service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:57.955567 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28344c69-2a4c-4810-a368-257e6fe10f0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:57.957889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-28344c69-2a4c-4810-a368-257e6fe10f0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:57.982911 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28344c69-2a4c-4810-a368-257e6fe10f0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:57.985362 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28344c69-2a4c-4810-a368-257e6fe10f0b service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:58.000055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 951/1906] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:54:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:58.017569 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28344c69-2a4c-4810-a368-257e6fe10f0b service nova] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:58.019061 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-28344c69-2a4c-4810-a368-257e6fe10f0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:58.024464 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 956/1907] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:58.032629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2c50c-53f8-45b1-96c0-cbfc0155e180 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:58.033372 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2c50c-53f8-45b1-96c0-cbfc0155e180 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:58.033942 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2c50c-53f8-45b1-96c0-cbfc0155e180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:58.051461 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28344c69-2a4c-4810-a368-257e6fe10f0b service nova] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:58.063574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a02849-cf28-4cc0-8fe9-41271f0443d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:58.064696 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a02849-cf28-4cc0-8fe9-41271f0443d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:58.065165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a02849-cf28-4cc0-8fe9-41271f0443d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:58.065618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a02849-cf28-4cc0-8fe9-41271f0443d0 admin admin] PATH_INFO: `/v3/users/2a1b175677464b1a8dae0aacaa7ded7e` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:58.067006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a02849-cf28-4cc0-8fe9-41271f0443d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1b175677464b1a8dae0aacaa7ded7e)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:58.073294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a02849-cf28-4cc0-8fe9-41271f0443d0 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:58.081195 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-9ae2c50c-53f8-45b1-96c0-cbfc0155e180 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:58.082667 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-9ae2c50c-53f8-45b1-96c0-cbfc0155e180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:58.092805 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 957/1908] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:54:58.098395 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2c50c-53f8-45b1-96c0-cbfc0155e180 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:58.116289 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2c50c-53f8-45b1-96c0-cbfc0155e180 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:58.122660 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442e5bb-5063-4d78-8dab-076a09a3422e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:58.124817 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442e5bb-5063-4d78-8dab-076a09a3422e admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:58.124817 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442e5bb-5063-4d78-8dab-076a09a3422e admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:58.124817 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442e5bb-5063-4d78-8dab-076a09a3422e admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:58.125566 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442e5bb-5063-4d78-8dab-076a09a3422e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:54:58.126143 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442e5bb-5063-4d78-8dab-076a09a3422e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:58.128185 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442e5bb-5063-4d78-8dab-076a09a3422e admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:58.146085 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 958/1909] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:54:58.147110 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442e5bb-5063-4d78-8dab-076a09a3422e admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:58.158191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442e5bb-5063-4d78-8dab-076a09a3422e admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:58.163376 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4efd9-1bbe-47c1-b427-83bda70d4576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:58.164166 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4efd9-1bbe-47c1-b427-83bda70d4576 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:58.164549 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4efd9-1bbe-47c1-b427-83bda70d4576 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:58.164926 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4efd9-1bbe-47c1-b427-83bda70d4576 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:58.165677 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4efd9-1bbe-47c1-b427-83bda70d4576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:58.167793 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4efd9-1bbe-47c1-b427-83bda70d4576 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:58.288890 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:58.296362 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 959/1910] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:58 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:58.301849 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4efd9-1bbe-47c1-b427-83bda70d4576 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:58.368968 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4efd9-1bbe-47c1-b427-83bda70d4576 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:58.376753 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8247f-93c8-4bc1-8474-78caa80eb192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:58.377731 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8247f-93c8-4bc1-8474-78caa80eb192 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:58.379390 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8247f-93c8-4bc1-8474-78caa80eb192 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:58.379390 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8247f-93c8-4bc1-8474-78caa80eb192 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:58.379943 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8247f-93c8-4bc1-8474-78caa80eb192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:58.382816 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8247f-93c8-4bc1-8474-78caa80eb192 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:58.404363 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-85a02849-cf28-4cc0-8fe9-41271f0443d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1b175677464b1a8dae0aacaa7ded7e'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:58.407404 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-85a02849-cf28-4cc0-8fe9-41271f0443d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1b175677464b1a8dae0aacaa7ded7e'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:58.422750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-85a02849-cf28-4cc0-8fe9-41271f0443d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1b175677464b1a8dae0aacaa7ded7e'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:58.430269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-85a02849-cf28-4cc0-8fe9-41271f0443d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1b175677464b1a8dae0aacaa7ded7e'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:58.467844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:58.505070 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-85a02849-cf28-4cc0-8fe9-41271f0443d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1b175677464b1a8dae0aacaa7ded7e'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:58.506569 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 960/1911] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:58 2022] POST /identity/v3/users => generated 290 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:54:58.512212 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8247f-93c8-4bc1-8474-78caa80eb192 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:58.515836 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-cfb8247f-93c8-4bc1-8474-78caa80eb192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:58.523069 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 952/1912] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:54:58 2022] DELETE /identity/v3/users/2a1b175677464b1a8dae0aacaa7ded7e => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:58.525150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a02849-cf28-4cc0-8fe9-41271f0443d0 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:58.528793 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-85a02849-cf28-4cc0-8fe9-41271f0443d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:58.546217 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8247f-93c8-4bc1-8474-78caa80eb192 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:58.680549 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a02849-cf28-4cc0-8fe9-41271f0443d0 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:58.687503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd4147-a4c3-480d-b33a-f8b0dd08999b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:58.688251 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd4147-a4c3-480d-b33a-f8b0dd08999b admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:58.688606 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd4147-a4c3-480d-b33a-f8b0dd08999b admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:58.688949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd4147-a4c3-480d-b33a-f8b0dd08999b admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:58.689713 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd4147-a4c3-480d-b33a-f8b0dd08999b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:58.691579 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd4147-a4c3-480d-b33a-f8b0dd08999b admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:58.697981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c1c5e-1f59-444b-8a4f-107894f8fca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:58.699552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c1c5e-1f59-444b-8a4f-107894f8fca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:58.702834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c1c5e-1f59-444b-8a4f-107894f8fca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:58.703389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c1c5e-1f59-444b-8a4f-107894f8fca7 admin admin] PATH_INFO: `/v3/projects/12b08389bdb549608d71db0fe390d094` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:58.718919 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 953/1913] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:58.719091 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c1c5e-1f59-444b-8a4f-107894f8fca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12b08389bdb549608d71db0fe390d094)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:58.719182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd4147-a4c3-480d-b33a-f8b0dd08999b admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:58.719264 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c1c5e-1f59-444b-8a4f-107894f8fca7 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:58.726158 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd4147-a4c3-480d-b33a-f8b0dd08999b admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:58.734013 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965da74-1c60-4581-a15b-205da1cf6e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:58.735595 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965da74-1c60-4581-a15b-205da1cf6e3f admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:58.736029 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965da74-1c60-4581-a15b-205da1cf6e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:58.736385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965da74-1c60-4581-a15b-205da1cf6e3f admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:58.737426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965da74-1c60-4581-a15b-205da1cf6e3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:58.739662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965da74-1c60-4581-a15b-205da1cf6e3f admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:58.758581 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 954/1914] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:58.763785 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965da74-1c60-4581-a15b-205da1cf6e3f admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:58.775310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965da74-1c60-4581-a15b-205da1cf6e3f admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:58.781908 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e55e79-85c1-480c-acdc-a10eb5900f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:58.782584 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e55e79-85c1-480c-acdc-a10eb5900f40 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:58.782867 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e55e79-85c1-480c-acdc-a10eb5900f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:58.783262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e55e79-85c1-480c-acdc-a10eb5900f40 admin admin] PATH_INFO: `/v3/projects/e895e16f0b4d4486879e5ac2370081f1/users/fa694c3429dc4aa2a1fa65e3d917ee40/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:58.809591 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e55e79-85c1-480c-acdc-a10eb5900f40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e895e16f0b4d4486879e5ac2370081f1, user_id=fa694c3429dc4aa2a1fa65e3d917ee40, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:58.813138 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e55e79-85c1-480c-acdc-a10eb5900f40 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:58.926307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 955/1915] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:54:58 2022] PUT /identity/v3/projects/e895e16f0b4d4486879e5ac2370081f1/users/fa694c3429dc4aa2a1fa65e3d917ee40/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:58.936999 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe899cbf-e855-4f6a-88fa-0942c074a5dd None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:58.937412 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe899cbf-e855-4f6a-88fa-0942c074a5dd None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:58.937544 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe899cbf-e855-4f6a-88fa-0942c074a5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:58.961683 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-180c1c5e-1f59-444b-8a4f-107894f8fca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12b08389bdb549608d71db0fe390d094', 'request_id': 'req-180c1c5e-1f59-444b-8a4f-107894f8fca7'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:58.971003 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-180c1c5e-1f59-444b-8a4f-107894f8fca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12b08389bdb549608d71db0fe390d094', 'request_id': 'req-180c1c5e-1f59-444b-8a4f-107894f8fca7'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:58.998445 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-fe899cbf-e855-4f6a-88fa-0942c074a5dd None None] MFA Rules not processed for user `fa694c3429dc4aa2a1fa65e3d917ee40`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:59.001616 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-fe899cbf-e855-4f6a-88fa-0942c074a5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:59.059127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-180c1c5e-1f59-444b-8a4f-107894f8fca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12b08389bdb549608d71db0fe390d094', 'request_id': 'req-180c1c5e-1f59-444b-8a4f-107894f8fca7'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:59.084679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-180c1c5e-1f59-444b-8a4f-107894f8fca7 admin admin] The token cache is being invalidate because project 12b08389bdb549608d71db0fe390d094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:54:59.085205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-180c1c5e-1f59-444b-8a4f-107894f8fca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:59.086167 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-180c1c5e-1f59-444b-8a4f-107894f8fca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:54:59.090596 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 961/1916] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:54:58 2022] DELETE /identity/v3/projects/12b08389bdb549608d71db0fe390d094 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:54:59.101833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d15e8-43a3-4fe7-a8eb-70360102ff65 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:59.103217 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d15e8-43a3-4fe7-a8eb-70360102ff65 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:59.103807 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d15e8-43a3-4fe7-a8eb-70360102ff65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:59.156218 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-318d15e8-43a3-4fe7-a8eb-70360102ff65 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:59.157611 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-318d15e8-43a3-4fe7-a8eb-70360102ff65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:59.159498 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 956/1917] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:59.164103 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe899cbf-e855-4f6a-88fa-0942c074a5dd None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:59.166851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-fe899cbf-e855-4f6a-88fa-0942c074a5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:59.285667 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe899cbf-e855-4f6a-88fa-0942c074a5dd None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:59.293173 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c43cd-24c0-442f-a1ff-8bf6ec525021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:59.293853 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c43cd-24c0-442f-a1ff-8bf6ec525021 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:59.295035 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c43cd-24c0-442f-a1ff-8bf6ec525021 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:59.295035 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c43cd-24c0-442f-a1ff-8bf6ec525021 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:59.295772 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c43cd-24c0-442f-a1ff-8bf6ec525021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:59.299427 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c43cd-24c0-442f-a1ff-8bf6ec525021 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:59.315955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 962/1918] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:59.323635 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f32c2-ff65-4ab7-8352-ce8b4d44e51a None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:59.323931 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f32c2-ff65-4ab7-8352-ce8b4d44e51a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:59.324254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f32c2-ff65-4ab7-8352-ce8b4d44e51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:59.372705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-4d2f32c2-ff65-4ab7-8352-ce8b4d44e51a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:54:59.374639 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-4d2f32c2-ff65-4ab7-8352-ce8b4d44e51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:54:59.383997 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 963/1919] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:54:59.388085 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f32c2-ff65-4ab7-8352-ce8b4d44e51a None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:59.406184 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f32c2-ff65-4ab7-8352-ce8b4d44e51a None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:59.411576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff7e45-f724-4104-a49e-24527fbf5941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:59.419958 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff7e45-f724-4104-a49e-24527fbf5941 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:59.419958 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff7e45-f724-4104-a49e-24527fbf5941 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:59.419958 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff7e45-f724-4104-a49e-24527fbf5941 admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:59.419958 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff7e45-f724-4104-a49e-24527fbf5941 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:54:59.419958 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff7e45-f724-4104-a49e-24527fbf5941 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:59.419958 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff7e45-f724-4104-a49e-24527fbf5941 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:59.433315 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 964/1920] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:54:59.437852 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff7e45-f724-4104-a49e-24527fbf5941 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:59.455972 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 957/1921] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:59 2022] POST /identity/v3/projects => generated 377 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:59.466353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c43cd-24c0-442f-a1ff-8bf6ec525021 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:59.470286 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff7e45-f724-4104-a49e-24527fbf5941 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:59.545247 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be4374-8c01-448a-9973-2eafc40e77c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:59.546884 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be4374-8c01-448a-9973-2eafc40e77c6 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:59.547441 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be4374-8c01-448a-9973-2eafc40e77c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:59.547862 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be4374-8c01-448a-9973-2eafc40e77c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:59.548838 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be4374-8c01-448a-9973-2eafc40e77c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:59.552120 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be4374-8c01-448a-9973-2eafc40e77c6 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:59.601172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c43cd-24c0-442f-a1ff-8bf6ec525021 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:59.608764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c57acc-f505-4ac8-807c-2ed8810baff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:59.610225 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c57acc-f505-4ac8-807c-2ed8810baff6 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:59.610912 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c57acc-f505-4ac8-807c-2ed8810baff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:59.611387 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c57acc-f505-4ac8-807c-2ed8810baff6 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:59.612424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c57acc-f505-4ac8-807c-2ed8810baff6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:59.614969 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c57acc-f505-4ac8-807c-2ed8810baff6 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:59.667874 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 965/1922] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:54:59 2022] POST /identity/v3/projects => generated 371 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:54:59.669130 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be4374-8c01-448a-9973-2eafc40e77c6 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:59.711662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 958/1923] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:59 2022] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:54:59.715863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c57acc-f505-4ac8-807c-2ed8810baff6 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:59.736493 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c57acc-f505-4ac8-807c-2ed8810baff6 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:59.756868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be4374-8c01-448a-9973-2eafc40e77c6 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:59.763268 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fce953-5437-4ae4-a6ac-b7560022249b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:59.764354 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fce953-5437-4ae4-a6ac-b7560022249b admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:59.764641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fce953-5437-4ae4-a6ac-b7560022249b admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:59.764916 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fce953-5437-4ae4-a6ac-b7560022249b admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:59.771801 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fce953-5437-4ae4-a6ac-b7560022249b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:59.787644 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fce953-5437-4ae4-a6ac-b7560022249b admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:59.905939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 966/1924] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:54:59 2022] POST /identity/v3/users => generated 286 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:54:59.909969 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fce953-5437-4ae4-a6ac-b7560022249b admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:59.921402 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fce953-5437-4ae4-a6ac-b7560022249b admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:59.927591 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ee76c-009a-4f65-907d-f57eb40525af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:59.928457 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ee76c-009a-4f65-907d-f57eb40525af admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:59.929777 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ee76c-009a-4f65-907d-f57eb40525af admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:59.930565 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ee76c-009a-4f65-907d-f57eb40525af admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:59.931477 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ee76c-009a-4f65-907d-f57eb40525af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:59.934217 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ee76c-009a-4f65-907d-f57eb40525af admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:59.937151 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47336266-6806-4533-9bba-a372e2012a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:59.938024 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47336266-6806-4533-9bba-a372e2012a15 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:59.938204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47336266-6806-4533-9bba-a372e2012a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:59.938470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47336266-6806-4533-9bba-a372e2012a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:59.939128 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47336266-6806-4533-9bba-a372e2012a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:54:59.941378 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47336266-6806-4533-9bba-a372e2012a15 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:54:59.955416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 967/1925] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:54:59.959585 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47336266-6806-4533-9bba-a372e2012a15 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:59.960720 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 959/1926] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 13:54:59.964316 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ee76c-009a-4f65-907d-f57eb40525af admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:54:59.974037 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47336266-6806-4533-9bba-a372e2012a15 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:54:59.989287 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c89fd-83c7-44c7-97e9-4a52e76bb6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:54:59.990270 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c89fd-83c7-44c7-97e9-4a52e76bb6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:54:59.990953 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c89fd-83c7-44c7-97e9-4a52e76bb6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:54:59.991608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c89fd-83c7-44c7-97e9-4a52e76bb6f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:54:59.993046 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c89fd-83c7-44c7-97e9-4a52e76bb6f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:00.012583 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ee76c-009a-4f65-907d-f57eb40525af admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:00.013133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c89fd-83c7-44c7-97e9-4a52e76bb6f0 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:00.026413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e37d0-78df-4405-856b-1dc8674a8acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:00.028691 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e37d0-78df-4405-856b-1dc8674a8acc admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:00.028981 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e37d0-78df-4405-856b-1dc8674a8acc admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:00.031521 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e37d0-78df-4405-856b-1dc8674a8acc admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:00.032430 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e37d0-78df-4405-856b-1dc8674a8acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:00.037380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e37d0-78df-4405-856b-1dc8674a8acc admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:00.058235 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 968/1927] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 13:55:00.063142 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c89fd-83c7-44c7-97e9-4a52e76bb6f0 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:00.066398 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 960/1928] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:55:00.072354 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e37d0-78df-4405-856b-1dc8674a8acc admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:00.096121 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e37d0-78df-4405-856b-1dc8674a8acc admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:00.109934 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c89fd-83c7-44c7-97e9-4a52e76bb6f0 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:00.118388 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168c480-f4f2-48e5-929f-e85f2f2591e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:00.119057 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168c480-f4f2-48e5-929f-e85f2f2591e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:00.119346 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168c480-f4f2-48e5-929f-e85f2f2591e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:00.119650 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168c480-f4f2-48e5-929f-e85f2f2591e8 admin admin] PATH_INFO: `/v3/projects/fcc4033703f74ef3ab13e6cd65db6372/users/5527150c61474dd088487fa54582a2e4/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:00.123933 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aabb69-8eba-4ecc-848d-b782c5aedf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:00.123933 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aabb69-8eba-4ecc-848d-b782c5aedf9c admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:00.123933 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aabb69-8eba-4ecc-848d-b782c5aedf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:00.123933 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aabb69-8eba-4ecc-848d-b782c5aedf9c admin admin] PATH_INFO: `/v3/projects/ffce8c4cc79c422f917ed235b0e6a5e7/users/172c535f0f7e4cc9abf2997d984fe82d/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:00.136511 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168c480-f4f2-48e5-929f-e85f2f2591e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcc4033703f74ef3ab13e6cd65db6372, user_id=5527150c61474dd088487fa54582a2e4, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:00.139223 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168c480-f4f2-48e5-929f-e85f2f2591e8 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:00.145009 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aabb69-8eba-4ecc-848d-b782c5aedf9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffce8c4cc79c422f917ed235b0e6a5e7, user_id=172c535f0f7e4cc9abf2997d984fe82d, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:00.148869 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aabb69-8eba-4ecc-848d-b782c5aedf9c admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:00.182531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:00.224878 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 961/1929] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:55:00 2022] PUT /identity/v3/projects/fcc4033703f74ef3ab13e6cd65db6372/users/5527150c61474dd088487fa54582a2e4/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:55:00.232158 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1553d64-1ab7-451e-bafe-1adcc015b43b None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:00.232438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1553d64-1ab7-451e-bafe-1adcc015b43b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:00.232876 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1553d64-1ab7-451e-bafe-1adcc015b43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:00.248744 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 969/1930] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:55:00 2022] PUT /identity/v3/projects/ffce8c4cc79c422f917ed235b0e6a5e7/users/172c535f0f7e4cc9abf2997d984fe82d/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:00.259586 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b862749-5759-4a84-b18a-17b59ff6cac9 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:00.260371 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b862749-5759-4a84-b18a-17b59ff6cac9 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:00.260654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b862749-5759-4a84-b18a-17b59ff6cac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:00.307127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-7b862749-5759-4a84-b18a-17b59ff6cac9 None None] MFA Rules not processed for user `172c535f0f7e4cc9abf2997d984fe82d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:00.308917 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-7b862749-5759-4a84-b18a-17b59ff6cac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:00.309042 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-f1553d64-1ab7-451e-bafe-1adcc015b43b None None] MFA Rules not processed for user `5527150c61474dd088487fa54582a2e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:00.310204 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-f1553d64-1ab7-451e-bafe-1adcc015b43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:00.391108 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=82,keystone:INSERT=4,keystone:DELETE=14 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:00.433743 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 962/1931] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:00.433743 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1553d64-1ab7-451e-bafe-1adcc015b43b None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:00.433743 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-f1553d64-1ab7-451e-bafe-1adcc015b43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:00.450092 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 970/1932] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:55:00.451150 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b862749-5759-4a84-b18a-17b59ff6cac9 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:00.522491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1553d64-1ab7-451e-bafe-1adcc015b43b None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:00.527771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ad474-1922-4c1b-949d-6eb9088e2663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:00.528298 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ad474-1922-4c1b-949d-6eb9088e2663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:00.528580 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ad474-1922-4c1b-949d-6eb9088e2663 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:00.528849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ad474-1922-4c1b-949d-6eb9088e2663 admin admin] PATH_INFO: `/v3/projects/7ce4871c67d2425ab973e66fa31d78a9` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:00.530050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ad474-1922-4c1b-949d-6eb9088e2663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ce4871c67d2425ab973e66fa31d78a9)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:00.532642 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ad474-1922-4c1b-949d-6eb9088e2663 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:00.571905 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b862749-5759-4a84-b18a-17b59ff6cac9 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:00.578585 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34e4a0-92b8-437f-90b7-71d11d568153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:00.579218 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34e4a0-92b8-437f-90b7-71d11d568153 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:00.579531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34e4a0-92b8-437f-90b7-71d11d568153 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:00.579806 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34e4a0-92b8-437f-90b7-71d11d568153 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:00.581000 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34e4a0-92b8-437f-90b7-71d11d568153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:00.583738 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34e4a0-92b8-437f-90b7-71d11d568153 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:00.697787 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 971/1933] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:55:00 2022] POST /identity/v3/projects => generated 379 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:55:00.698646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34e4a0-92b8-437f-90b7-71d11d568153 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:00.703562 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-bb34e4a0-92b8-437f-90b7-71d11d568153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:00.722377 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c52ad474-1922-4c1b-949d-6eb9088e2663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ce4871c67d2425ab973e66fa31d78a9', 'request_id': 'req-c52ad474-1922-4c1b-949d-6eb9088e2663'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:00.739312 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c52ad474-1922-4c1b-949d-6eb9088e2663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ce4871c67d2425ab973e66fa31d78a9', 'request_id': 'req-c52ad474-1922-4c1b-949d-6eb9088e2663'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:00.752438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c52ad474-1922-4c1b-949d-6eb9088e2663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ce4871c67d2425ab973e66fa31d78a9', 'request_id': 'req-c52ad474-1922-4c1b-949d-6eb9088e2663'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:00.791349 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34e4a0-92b8-437f-90b7-71d11d568153 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:00.796747 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f4a38-02a6-4862-ac73-99934cb2bd22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:00.797556 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f4a38-02a6-4862-ac73-99934cb2bd22 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:00.797908 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f4a38-02a6-4862-ac73-99934cb2bd22 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:00.798282 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f4a38-02a6-4862-ac73-99934cb2bd22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:00.852150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c52ad474-1922-4c1b-949d-6eb9088e2663 admin admin] The token cache is being invalidate because project 7ce4871c67d2425ab973e66fa31d78a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:55:00.853340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c52ad474-1922-4c1b-949d-6eb9088e2663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:00.856382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c52ad474-1922-4c1b-949d-6eb9088e2663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:00.861420 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 963/1934] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:55:00 2022] DELETE /identity/v3/projects/7ce4871c67d2425ab973e66fa31d78a9 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:00.861420 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ad474-1922-4c1b-949d-6eb9088e2663 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:00.864625 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c52ad474-1922-4c1b-949d-6eb9088e2663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:00.869007 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f4a38-02a6-4862-ac73-99934cb2bd22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:00.870450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f4a38-02a6-4862-ac73-99934cb2bd22 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:00.894043 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 972/1935] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:55:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:55:00.920835 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0460b2-06ef-40d3-ad13-c5bf7be19d93 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:00.926642 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0460b2-06ef-40d3-ad13-c5bf7be19d93 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:00.926642 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0460b2-06ef-40d3-ad13-c5bf7be19d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:00.954490 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-bd0460b2-06ef-40d3-ad13-c5bf7be19d93 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:00.955773 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-bd0460b2-06ef-40d3-ad13-c5bf7be19d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:00.992716 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ad474-1922-4c1b-949d-6eb9088e2663 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:01.133423 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 973/1936] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:01.133423 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0460b2-06ef-40d3-ad13-c5bf7be19d93 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:01.133423 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-bd0460b2-06ef-40d3-ad13-c5bf7be19d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:01.157197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1de6b9-1830-4327-aa2d-70e6d62e6746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:01.157839 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1de6b9-1830-4327-aa2d-70e6d62e6746 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:01.158120 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1de6b9-1830-4327-aa2d-70e6d62e6746 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:01.161196 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1de6b9-1830-4327-aa2d-70e6d62e6746 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:01.161955 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1de6b9-1830-4327-aa2d-70e6d62e6746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:01.166756 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1de6b9-1830-4327-aa2d-70e6d62e6746 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:01.176554 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0460b2-06ef-40d3-ad13-c5bf7be19d93 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:01.210491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbd6a0-188e-4c51-909e-79a0c67bdbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:01.211669 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbd6a0-188e-4c51-909e-79a0c67bdbc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:01.212255 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbd6a0-188e-4c51-909e-79a0c67bdbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:01.212677 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbd6a0-188e-4c51-909e-79a0c67bdbc1 admin admin] PATH_INFO: `/v3/users/172c535f0f7e4cc9abf2997d984fe82d` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:01.214947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbd6a0-188e-4c51-909e-79a0c67bdbc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=172c535f0f7e4cc9abf2997d984fe82d)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:01.220540 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbd6a0-188e-4c51-909e-79a0c67bdbc1 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:01.316659 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 964/1937] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:55:00 2022] POST /identity/v3/users => generated 296 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:55:01.321312 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b7082-3342-4a2c-a896-f11fef27891b None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:01.321545 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b7082-3342-4a2c-a896-f11fef27891b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:01.321804 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b7082-3342-4a2c-a896-f11fef27891b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:01.368559 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-ee2b7082-3342-4a2c-a896-f11fef27891b None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:01.370970 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-ee2b7082-3342-4a2c-a896-f11fef27891b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:01.392452 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 965/1938] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:01.396611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b7082-3342-4a2c-a896-f11fef27891b None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:01.431216 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b7082-3342-4a2c-a896-f11fef27891b None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:01.462092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7f7ba-3ca2-4fd5-83c6-0c0c365856e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:01.463106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7f7ba-3ca2-4fd5-83c6-0c0c365856e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:01.464286 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7f7ba-3ca2-4fd5-83c6-0c0c365856e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:01.465898 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7f7ba-3ca2-4fd5-83c6-0c0c365856e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:01.467025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7f7ba-3ca2-4fd5-83c6-0c0c365856e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:01.485085 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7f7ba-3ca2-4fd5-83c6-0c0c365856e8 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:01.511665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 966/1939] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:55:01.515518 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7f7ba-3ca2-4fd5-83c6-0c0c365856e8 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:01.538489 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dcfbd6a0-188e-4c51-909e-79a0c67bdbc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '172c535f0f7e4cc9abf2997d984fe82d'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:01.539532 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7f7ba-3ca2-4fd5-83c6-0c0c365856e8 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:01.554210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a61ed8-5f01-4354-a07f-83a6426400e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:01.555107 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a61ed8-5f01-4354-a07f-83a6426400e3 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:01.555483 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a61ed8-5f01-4354-a07f-83a6426400e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:01.555834 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a61ed8-5f01-4354-a07f-83a6426400e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:01.556583 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a61ed8-5f01-4354-a07f-83a6426400e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:55:01.556985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a61ed8-5f01-4354-a07f-83a6426400e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:01.562045 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a61ed8-5f01-4354-a07f-83a6426400e3 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:01.596021 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 967/1940] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:55:01.602460 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a61ed8-5f01-4354-a07f-83a6426400e3 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:01.629152 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a61ed8-5f01-4354-a07f-83a6426400e3 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:01.638726 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f9fb3-4693-4b00-9412-e29b3fca3401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:01.640375 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f9fb3-4693-4b00-9412-e29b3fca3401 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:01.640775 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f9fb3-4693-4b00-9412-e29b3fca3401 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:01.641242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f9fb3-4693-4b00-9412-e29b3fca3401 admin admin] PATH_INFO: `/v3/projects/d7ee2a66c52346daa9e97202146c1445/users/f4e0fe36fe3f4d1d8718a6c470a7f378/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:01.675301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f9fb3-4693-4b00-9412-e29b3fca3401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7ee2a66c52346daa9e97202146c1445, user_id=f4e0fe36fe3f4d1d8718a6c470a7f378, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:01.678971 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f9fb3-4693-4b00-9412-e29b3fca3401 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:01.684997 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dcfbd6a0-188e-4c51-909e-79a0c67bdbc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '172c535f0f7e4cc9abf2997d984fe82d'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:01.695295 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dcfbd6a0-188e-4c51-909e-79a0c67bdbc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '172c535f0f7e4cc9abf2997d984fe82d'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:01.730982 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dcfbd6a0-188e-4c51-909e-79a0c67bdbc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '172c535f0f7e4cc9abf2997d984fe82d'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:01.733859 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dcfbd6a0-188e-4c51-909e-79a0c67bdbc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '172c535f0f7e4cc9abf2997d984fe82d'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:01.749438 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 974/1941] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:55:01 2022] DELETE /identity/v3/users/172c535f0f7e4cc9abf2997d984fe82d => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:01.751736 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbd6a0-188e-4c51-909e-79a0c67bdbc1 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:01.754850 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-dcfbd6a0-188e-4c51-909e-79a0c67bdbc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:01.793560 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 968/1942] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:55:01 2022] PUT /identity/v3/projects/d7ee2a66c52346daa9e97202146c1445/users/f4e0fe36fe3f4d1d8718a6c470a7f378/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:01.795315 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f03df-427a-41b5-8048-9091d651c6e9 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:01.796450 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f03df-427a-41b5-8048-9091d651c6e9 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:01.806171 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f03df-427a-41b5-8048-9091d651c6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:01.882092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-494f03df-427a-41b5-8048-9091d651c6e9 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:01.883523 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-494f03df-427a-41b5-8048-9091d651c6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:01.941451 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbd6a0-188e-4c51-909e-79a0c67bdbc1 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:01.978195 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:02.063396 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 969/1943] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:02.073676 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f03df-427a-41b5-8048-9091d651c6e9 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:02.075015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbb6ae-ad0c-4913-87a9-788779df5955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:02.075706 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbb6ae-ad0c-4913-87a9-788779df5955 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:02.076077 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbb6ae-ad0c-4913-87a9-788779df5955 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:02.080515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbb6ae-ad0c-4913-87a9-788779df5955 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:02.080515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cbb6ae-ad0c-4913-87a9-788779df5955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:02.081053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-494f03df-427a-41b5-8048-9091d651c6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:02.081135 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cbb6ae-ad0c-4913-87a9-788779df5955 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:02.109223 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f03df-427a-41b5-8048-9091d651c6e9 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:02.121908 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1ba25-4cad-4de4-bb8e-f1798d5ad798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:02.125310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1ba25-4cad-4de4-bb8e-f1798d5ad798 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:02.125601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1ba25-4cad-4de4-bb8e-f1798d5ad798 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:02.125892 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1ba25-4cad-4de4-bb8e-f1798d5ad798 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:02.126569 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1ba25-4cad-4de4-bb8e-f1798d5ad798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:02.132582 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1ba25-4cad-4de4-bb8e-f1798d5ad798 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:02.170026 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 970/1944] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:55:02.173795 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 975/1945] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:55:01 2022] POST /identity/v3/projects => generated 375 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:55:02.173795 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbb6ae-ad0c-4913-87a9-788779df5955 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:02.174461 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1ba25-4cad-4de4-bb8e-f1798d5ad798 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:02.183535 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-39a1ba25-4cad-4de4-bb8e-f1798d5ad798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:02.185645 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:02.275900 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbb6ae-ad0c-4913-87a9-788779df5955 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:02.283217 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c957498-ed9f-4932-876d-9e270ba2b059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:02.284260 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c957498-ed9f-4932-876d-9e270ba2b059 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:02.284547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c957498-ed9f-4932-876d-9e270ba2b059 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:02.284824 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c957498-ed9f-4932-876d-9e270ba2b059 admin admin] PATH_INFO: `/v3/projects/d7ee2a66c52346daa9e97202146c1445/users/f4e0fe36fe3f4d1d8718a6c470a7f378/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:02.286983 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c957498-ed9f-4932-876d-9e270ba2b059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7ee2a66c52346daa9e97202146c1445, user_id=f4e0fe36fe3f4d1d8718a6c470a7f378, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:02.288047 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1ba25-4cad-4de4-bb8e-f1798d5ad798 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:02.291812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c957498-ed9f-4932-876d-9e270ba2b059 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:02.307602 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 976/1946] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:55:02 2022] PUT /identity/v3/projects/d7ee2a66c52346daa9e97202146c1445/users/f4e0fe36fe3f4d1d8718a6c470a7f378/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:02.309182 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c957498-ed9f-4932-876d-9e270ba2b059 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:02.384503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080f138-443a-40ec-bf5d-4bcd974ed2a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:02.385135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080f138-443a-40ec-bf5d-4bcd974ed2a0 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:02.385573 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080f138-443a-40ec-bf5d-4bcd974ed2a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:02.385849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080f138-443a-40ec-bf5d-4bcd974ed2a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:02.398560 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c957498-ed9f-4932-876d-9e270ba2b059 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:02.408555 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677768f-e8d5-4f51-a70d-a613e186bb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:02.410194 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677768f-e8d5-4f51-a70d-a613e186bb8b admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:02.410194 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677768f-e8d5-4f51-a70d-a613e186bb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:02.411181 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677768f-e8d5-4f51-a70d-a613e186bb8b admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:02.412836 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677768f-e8d5-4f51-a70d-a613e186bb8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:02.414498 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080f138-443a-40ec-bf5d-4bcd974ed2a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:02.415189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677768f-e8d5-4f51-a70d-a613e186bb8b admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:02.416305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080f138-443a-40ec-bf5d-4bcd974ed2a0 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:02.429330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 971/1947] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:55:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:55:02.432018 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ef658-132f-40c4-ab1e-5d71b934f02c None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:02.442554 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ef658-132f-40c4-ab1e-5d71b934f02c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:02.442554 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ef658-132f-40c4-ab1e-5d71b934f02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:02.470851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-9c9ef658-132f-40c4-ab1e-5d71b934f02c None None] MFA Rules not processed for user `f4e0fe36fe3f4d1d8718a6c470a7f378`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:02.472662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-9c9ef658-132f-40c4-ab1e-5d71b934f02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:02.543177 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 977/1948] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:55:02 2022] POST /identity/v3/users => generated 288 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:55:02.548090 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677768f-e8d5-4f51-a70d-a613e186bb8b admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:02.570100 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 972/1949] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:02 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:02.574480 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677768f-e8d5-4f51-a70d-a613e186bb8b admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:02.582236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce596406-1dc6-44a9-a287-b60e9ab5f167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:02.583404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce596406-1dc6-44a9-a287-b60e9ab5f167 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:02.584126 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce596406-1dc6-44a9-a287-b60e9ab5f167 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:02.585502 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ef658-132f-40c4-ab1e-5d71b934f02c None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:02.587940 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-9c9ef658-132f-40c4-ab1e-5d71b934f02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:02.590249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce596406-1dc6-44a9-a287-b60e9ab5f167 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:02.591552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce596406-1dc6-44a9-a287-b60e9ab5f167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:02.602642 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce596406-1dc6-44a9-a287-b60e9ab5f167 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:02.641142 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 978/1950] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:55:02.646047 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce596406-1dc6-44a9-a287-b60e9ab5f167 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:02.677696 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce596406-1dc6-44a9-a287-b60e9ab5f167 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:02.694728 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce6830-f67c-4452-84d8-f4a71b55fa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:02.695572 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce6830-f67c-4452-84d8-f4a71b55fa4d admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:02.695968 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce6830-f67c-4452-84d8-f4a71b55fa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:02.696486 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce6830-f67c-4452-84d8-f4a71b55fa4d admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:02.697258 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce6830-f67c-4452-84d8-f4a71b55fa4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:02.700698 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce6830-f67c-4452-84d8-f4a71b55fa4d admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:02.729730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 979/1951] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:55:02.734451 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce6830-f67c-4452-84d8-f4a71b55fa4d admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:02.754548 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce6830-f67c-4452-84d8-f4a71b55fa4d admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:02.756089 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ef658-132f-40c4-ab1e-5d71b934f02c None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:02.763047 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12def875-87bf-429b-9484-c205884fed61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:02.764284 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12def875-87bf-429b-9484-c205884fed61 service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:02.765302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12def875-87bf-429b-9484-c205884fed61 service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:02.766153 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e868f-f8c4-4955-86e5-393a8f445cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:02.766547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12def875-87bf-429b-9484-c205884fed61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:02.767251 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e868f-f8c4-4955-86e5-393a8f445cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:02.768373 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e868f-f8c4-4955-86e5-393a8f445cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:02.773732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e868f-f8c4-4955-86e5-393a8f445cd1 admin admin] PATH_INFO: `/v3/projects/4f615e56dc6d48df8ce7835ee867e500/users/06a3d99dfb3241cfa3c0b1fe975a9630/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:02.799023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12def875-87bf-429b-9484-c205884fed61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:02.802169 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12def875-87bf-429b-9484-c205884fed61 service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:02.828479 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e868f-f8c4-4955-86e5-393a8f445cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f615e56dc6d48df8ce7835ee867e500, user_id=06a3d99dfb3241cfa3c0b1fe975a9630, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:02.831573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e868f-f8c4-4955-86e5-393a8f445cd1 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:02.833857 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 973/1952] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:55:02 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:55:02.849104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bb181-73fe-44b8-b99b-67ccc5ccd61d None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:02.849356 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bb181-73fe-44b8-b99b-67ccc5ccd61d None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:02.850167 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bb181-73fe-44b8-b99b-67ccc5ccd61d None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:02.856861 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 974/1953] 10.222.0.50 () {54 vars in 921 bytes} [Thu Sep 1 13:55:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:55:02.862386 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03633f86-6f80-4bc8-9794-8359ee5192cd None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:02.862684 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03633f86-6f80-4bc8-9794-8359ee5192cd None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:02.862963 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03633f86-6f80-4bc8-9794-8359ee5192cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:02.891549 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-03633f86-6f80-4bc8-9794-8359ee5192cd None None] MFA Rules not processed for user `2d231136bcd44d9a97efe6c257f936ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:02.892799 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-03633f86-6f80-4bc8-9794-8359ee5192cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:02.986529 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 975/1954] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Sep 1 13:55:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:55:02.988064 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 980/1955] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:55:02 2022] PUT /identity/v3/projects/4f615e56dc6d48df8ce7835ee867e500/users/06a3d99dfb3241cfa3c0b1fe975a9630/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:02.999442 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4ccef-0389-46eb-a828-2b7cd7801ce0 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:03.000029 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4ccef-0389-46eb-a828-2b7cd7801ce0 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:03.000855 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4ccef-0389-46eb-a828-2b7cd7801ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:03.005711 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e868f-f8c4-4955-86e5-393a8f445cd1 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:03.008382 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-1d5e868f-f8c4-4955-86e5-393a8f445cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:03.041778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-26e4ccef-0389-46eb-a828-2b7cd7801ce0 None None] MFA Rules not processed for user `06a3d99dfb3241cfa3c0b1fe975a9630`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:03.043830 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-26e4ccef-0389-46eb-a828-2b7cd7801ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:03.128894 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e868f-f8c4-4955-86e5-393a8f445cd1 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:03.137438 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a94b14-067c-49b8-a90d-dbc3bf42aeac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:03.138167 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a94b14-067c-49b8-a90d-dbc3bf42aeac service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:03.138521 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a94b14-067c-49b8-a90d-dbc3bf42aeac service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:03.138957 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a94b14-067c-49b8-a90d-dbc3bf42aeac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:03.150276 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a94b14-067c-49b8-a90d-dbc3bf42aeac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:03.154634 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a94b14-067c-49b8-a90d-dbc3bf42aeac service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:03.192755 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 976/1956] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:03.192755 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4ccef-0389-46eb-a828-2b7cd7801ce0 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:03.192755 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-26e4ccef-0389-46eb-a828-2b7cd7801ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:03.201734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 981/1957] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:55:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:55:03.204028 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a94b14-067c-49b8-a90d-dbc3bf42aeac service nova] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:03.285039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4ccef-0389-46eb-a828-2b7cd7801ce0 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:03.297743 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92333560-bf92-4e7a-bb1e-7b45d2a0b1de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:03.298588 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92333560-bf92-4e7a-bb1e-7b45d2a0b1de service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:03.298873 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92333560-bf92-4e7a-bb1e-7b45d2a0b1de service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:03.299147 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92333560-bf92-4e7a-bb1e-7b45d2a0b1de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:03.307031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-92333560-bf92-4e7a-bb1e-7b45d2a0b1de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:03.329884 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a94b14-067c-49b8-a90d-dbc3bf42aeac service nova] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:03.334182 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ff71a-0116-499b-b6b3-7a33ee13bcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:03.335065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ff71a-0116-499b-b6b3-7a33ee13bcfe admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:03.335613 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ff71a-0116-499b-b6b3-7a33ee13bcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:03.336079 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ff71a-0116-499b-b6b3-7a33ee13bcfe admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:03.336918 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ff71a-0116-499b-b6b3-7a33ee13bcfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:03.339438 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ff71a-0116-499b-b6b3-7a33ee13bcfe admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:03.415612 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92333560-bf92-4e7a-bb1e-7b45d2a0b1de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:03.417591 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92333560-bf92-4e7a-bb1e-7b45d2a0b1de service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:03.433725 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 977/1958] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:55:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:55:03.469166 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 982/1959] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:55:03 2022] POST /identity/v3/projects => generated 375 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:55:03.474565 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92333560-bf92-4e7a-bb1e-7b45d2a0b1de service cinder] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:03.482185 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:03.509279 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92333560-bf92-4e7a-bb1e-7b45d2a0b1de service cinder] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:03.551926 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ff71a-0116-499b-b6b3-7a33ee13bcfe admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:03.554035 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-e41ff71a-0116-499b-b6b3-7a33ee13bcfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:03.719417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221ad3d-abff-4cf6-9a75-ac13642c3aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:03.720654 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221ad3d-abff-4cf6-9a75-ac13642c3aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:03.721078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221ad3d-abff-4cf6-9a75-ac13642c3aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:03.723086 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221ad3d-abff-4cf6-9a75-ac13642c3aa8 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:03.724176 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221ad3d-abff-4cf6-9a75-ac13642c3aa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:03.728918 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221ad3d-abff-4cf6-9a75-ac13642c3aa8 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:03.743076 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ff71a-0116-499b-b6b3-7a33ee13bcfe admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:03.779258 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb2761-badd-4a79-a32b-d50c1636b18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:03.781305 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb2761-badd-4a79-a32b-d50c1636b18d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:03.781305 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb2761-badd-4a79-a32b-d50c1636b18d admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:03.782254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb2761-badd-4a79-a32b-d50c1636b18d admin admin] PATH_INFO: `/v3/projects/ffce8c4cc79c422f917ed235b0e6a5e7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:03.786132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb2761-badd-4a79-a32b-d50c1636b18d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffce8c4cc79c422f917ed235b0e6a5e7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:03.790615 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb2761-badd-4a79-a32b-d50c1636b18d admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:03.870742 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 978/1960] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:55:03 2022] POST /identity/v3/users => generated 294 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:55:03.875049 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221ad3d-abff-4cf6-9a75-ac13642c3aa8 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:03.899322 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221ad3d-abff-4cf6-9a75-ac13642c3aa8 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:03.917472 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb91d5-4dce-4213-829d-9760459415a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:03.921345 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb91d5-4dce-4213-829d-9760459415a8 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:03.921795 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb91d5-4dce-4213-829d-9760459415a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:03.925468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb91d5-4dce-4213-829d-9760459415a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:03.926272 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fb91d5-4dce-4213-829d-9760459415a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:03.930557 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fb91d5-4dce-4213-829d-9760459415a8 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:03.956829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 979/1961] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 13:55:03.961520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb91d5-4dce-4213-829d-9760459415a8 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:03.981972 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb91d5-4dce-4213-829d-9760459415a8 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:03.999039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8d4af-83f1-4659-9b63-c77280cefab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:03.999940 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8d4af-83f1-4659-9b63-c77280cefab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:04.000265 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8d4af-83f1-4659-9b63-c77280cefab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:04.000689 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8d4af-83f1-4659-9b63-c77280cefab3 admin admin] PATH_INFO: `/v3/projects/043b487d8eaf4b1cb5177c20467e9b55/users/d80b8c0622704f199185acf49ffad8e8/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:04.035185 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8d4af-83f1-4659-9b63-c77280cefab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=043b487d8eaf4b1cb5177c20467e9b55, user_id=d80b8c0622704f199185acf49ffad8e8, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:04.040277 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8d4af-83f1-4659-9b63-c77280cefab3 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:04.067648 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-f5cb2761-badd-4a79-a32b-d50c1636b18d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffce8c4cc79c422f917ed235b0e6a5e7', 'request_id': 'req-f5cb2761-badd-4a79-a32b-d50c1636b18d'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:04.097158 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-f5cb2761-badd-4a79-a32b-d50c1636b18d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffce8c4cc79c422f917ed235b0e6a5e7', 'request_id': 'req-f5cb2761-badd-4a79-a32b-d50c1636b18d'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:04.149665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 980/1962] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:55:03 2022] PUT /identity/v3/projects/043b487d8eaf4b1cb5177c20467e9b55/users/d80b8c0622704f199185acf49ffad8e8/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:04.150188 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8d4af-83f1-4659-9b63-c77280cefab3 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:04.205603 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-f5cb2761-badd-4a79-a32b-d50c1636b18d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffce8c4cc79c422f917ed235b0e6a5e7', 'request_id': 'req-f5cb2761-badd-4a79-a32b-d50c1636b18d'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:04.228778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-f5cb2761-badd-4a79-a32b-d50c1636b18d admin admin] The token cache is being invalidate because project ffce8c4cc79c422f917ed235b0e6a5e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:55:04.229586 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-f5cb2761-badd-4a79-a32b-d50c1636b18d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:04.231263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-f5cb2761-badd-4a79-a32b-d50c1636b18d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:04.240291 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 983/1963] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:55:03 2022] DELETE /identity/v3/projects/ffce8c4cc79c422f917ed235b0e6a5e7 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:04.245036 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480c888-4327-488a-bfd4-c58f37f74f90 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:04.245331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480c888-4327-488a-bfd4-c58f37f74f90 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:04.245610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480c888-4327-488a-bfd4-c58f37f74f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:04.282256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-f480c888-4327-488a-bfd4-c58f37f74f90 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:04.283600 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-f480c888-4327-488a-bfd4-c58f37f74f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:04.293585 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 984/1964] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:04.304008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8d4af-83f1-4659-9b63-c77280cefab3 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:04.309000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a6dac-80a1-46ef-8216-98005e404860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:04.309621 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a6dac-80a1-46ef-8216-98005e404860 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:04.312431 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a6dac-80a1-46ef-8216-98005e404860 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:04.312431 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a6dac-80a1-46ef-8216-98005e404860 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:04.312431 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a6dac-80a1-46ef-8216-98005e404860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:04.313212 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a6dac-80a1-46ef-8216-98005e404860 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:04.317173 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93efac-5785-487c-ae28-b5e285bb2dd8 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:04.317544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93efac-5785-487c-ae28-b5e285bb2dd8 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:04.318497 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93efac-5785-487c-ae28-b5e285bb2dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:04.337047 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 981/1965] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 13:55:04.343684 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a6dac-80a1-46ef-8216-98005e404860 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:04.351336 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-aa4a6dac-80a1-46ef-8216-98005e404860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:04.356750 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-6b93efac-5785-487c-ae28-b5e285bb2dd8 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:04.359302 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-6b93efac-5785-487c-ae28-b5e285bb2dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:04.372494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 985/1966] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:04.376769 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a6dac-80a1-46ef-8216-98005e404860 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:04.379043 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93efac-5785-487c-ae28-b5e285bb2dd8 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:04.382236 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e53ac47-7871-45b4-af3a-c97730638ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:04.383257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53ac47-7871-45b4-af3a-c97730638ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:04.383772 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53ac47-7871-45b4-af3a-c97730638ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:04.384250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53ac47-7871-45b4-af3a-c97730638ab8 admin admin] PATH_INFO: `/v3/projects/043b487d8eaf4b1cb5177c20467e9b55/users/d80b8c0622704f199185acf49ffad8e8/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:04.386845 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e53ac47-7871-45b4-af3a-c97730638ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=043b487d8eaf4b1cb5177c20467e9b55, user_id=d80b8c0622704f199185acf49ffad8e8, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:04.390315 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e53ac47-7871-45b4-af3a-c97730638ab8 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:04.411772 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 982/1967] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:55:04 2022] PUT /identity/v3/projects/043b487d8eaf4b1cb5177c20467e9b55/users/d80b8c0622704f199185acf49ffad8e8/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:04.419141 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93efac-5785-487c-ae28-b5e285bb2dd8 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:04.425657 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caab353-48c8-468d-b7c3-65d78f653a6f None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:04.425921 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caab353-48c8-468d-b7c3-65d78f653a6f None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:04.426196 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caab353-48c8-468d-b7c3-65d78f653a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:04.506138 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-8caab353-48c8-468d-b7c3-65d78f653a6f None None] MFA Rules not processed for user `d80b8c0622704f199185acf49ffad8e8`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:04.508373 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-8caab353-48c8-468d-b7c3-65d78f653a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:04.553424 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb97e5-8ace-487c-bd13-f1d0247a9d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:04.565684 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb97e5-8ace-487c-bd13-f1d0247a9d47 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:04.565864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb97e5-8ace-487c-bd13-f1d0247a9d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:04.566017 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb97e5-8ace-487c-bd13-f1d0247a9d47 admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:04.566764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb97e5-8ace-487c-bd13-f1d0247a9d47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:55:04.567072 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb97e5-8ace-487c-bd13-f1d0247a9d47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:04.572809 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb97e5-8ace-487c-bd13-f1d0247a9d47 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:04.593373 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:04.619508 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 986/1968] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:55:04.639547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb97e5-8ace-487c-bd13-f1d0247a9d47 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:04.654576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb97e5-8ace-487c-bd13-f1d0247a9d47 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:04.671221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a26697-addc-48e4-9962-c3191cb2e540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:04.671221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a26697-addc-48e4-9962-c3191cb2e540 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:04.673564 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a26697-addc-48e4-9962-c3191cb2e540 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:04.673959 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a26697-addc-48e4-9962-c3191cb2e540 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:04.675063 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a26697-addc-48e4-9962-c3191cb2e540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:04.678160 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a26697-addc-48e4-9962-c3191cb2e540 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:04.704199 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 983/1969] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:55:04.725793 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caab353-48c8-468d-b7c3-65d78f653a6f None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:04.733444 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-8caab353-48c8-468d-b7c3-65d78f653a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:04.821253 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caab353-48c8-468d-b7c3-65d78f653a6f None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:04.835907 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 987/1970] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:55:04 2022] POST /identity/v3/projects => generated 385 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:55:04.836100 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a88e9-19fe-42f2-8288-97aec0227c49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:04.836100 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a88e9-19fe-42f2-8288-97aec0227c49 service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:04.836100 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a88e9-19fe-42f2-8288-97aec0227c49 service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:04.836100 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a88e9-19fe-42f2-8288-97aec0227c49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:04.837827 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a26697-addc-48e4-9962-c3191cb2e540 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:04.861859 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-9d5a88e9-19fe-42f2-8288-97aec0227c49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:04.998525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a26697-addc-48e4-9962-c3191cb2e540 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:05.000246 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a88e9-19fe-42f2-8288-97aec0227c49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:05.001951 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a88e9-19fe-42f2-8288-97aec0227c49 service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:05.004370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fff40-5b71-4004-84e4-0e4e13648558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:05.005063 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fff40-5b71-4004-84e4-0e4e13648558 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:05.005352 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fff40-5b71-4004-84e4-0e4e13648558 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:05.005630 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fff40-5b71-4004-84e4-0e4e13648558 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:05.006691 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fff40-5b71-4004-84e4-0e4e13648558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:05.009504 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fff40-5b71-4004-84e4-0e4e13648558 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:05.016628 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 984/1971] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:55:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 13:55:05.117282 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 988/1972] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:55:04 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:55:05.118948 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a88e9-19fe-42f2-8288-97aec0227c49 service cinder] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:05.132759 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a88e9-19fe-42f2-8288-97aec0227c49 service cinder] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:05.140135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17ee34-f4af-4e77-9f22-fefd15b846c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:05.141332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17ee34-f4af-4e77-9f22-fefd15b846c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:05.141629 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17ee34-f4af-4e77-9f22-fefd15b846c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:05.141966 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17ee34-f4af-4e77-9f22-fefd15b846c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:05.142638 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17ee34-f4af-4e77-9f22-fefd15b846c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:05.144382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17ee34-f4af-4e77-9f22-fefd15b846c1 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:05.164310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 985/1973] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:55:05.166583 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fff40-5b71-4004-84e4-0e4e13648558 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:05.197355 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fff40-5b71-4004-84e4-0e4e13648558 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:05.204051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c458c7-16c3-4459-af4b-b3ec1e297c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:05.204051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c458c7-16c3-4459-af4b-b3ec1e297c05 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:05.204370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c458c7-16c3-4459-af4b-b3ec1e297c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:05.204544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c458c7-16c3-4459-af4b-b3ec1e297c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:05.205847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c458c7-16c3-4459-af4b-b3ec1e297c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:05.207870 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c458c7-16c3-4459-af4b-b3ec1e297c05 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:05.223468 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 989/1974] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:55:05.225053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17ee34-f4af-4e77-9f22-fefd15b846c1 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:05.237525 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17ee34-f4af-4e77-9f22-fefd15b846c1 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:05.242800 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698fafc-a38a-4448-bc1f-0fb9525896bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:05.243533 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698fafc-a38a-4448-bc1f-0fb9525896bf admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:05.243825 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698fafc-a38a-4448-bc1f-0fb9525896bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:05.244142 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698fafc-a38a-4448-bc1f-0fb9525896bf admin admin] PATH_INFO: `/v3/projects/f95e3af141e9456883c9cb1c61f5a952/users/3790823e78764315a63ec66ff8b0a22e/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:05.263054 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698fafc-a38a-4448-bc1f-0fb9525896bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95e3af141e9456883c9cb1c61f5a952, user_id=3790823e78764315a63ec66ff8b0a22e, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:05.266472 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698fafc-a38a-4448-bc1f-0fb9525896bf admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:05.283926 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:05.344651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 986/1975] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:55:05 2022] PUT /identity/v3/projects/f95e3af141e9456883c9cb1c61f5a952/users/3790823e78764315a63ec66ff8b0a22e/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:05.355516 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96bd55-2e82-450a-a18e-8fc1240d0fd2 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:05.356048 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96bd55-2e82-450a-a18e-8fc1240d0fd2 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:05.356508 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96bd55-2e82-450a-a18e-8fc1240d0fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:05.400584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-8e96bd55-2e82-450a-a18e-8fc1240d0fd2 None None] MFA Rules not processed for user `3790823e78764315a63ec66ff8b0a22e`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:05.402367 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-8e96bd55-2e82-450a-a18e-8fc1240d0fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:05.511929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 990/1976] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:05.517288 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698fafc-a38a-4448-bc1f-0fb9525896bf admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:05.602322 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698fafc-a38a-4448-bc1f-0fb9525896bf admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:05.608826 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d404b-1cc4-4f08-82f2-2bd59620c160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:05.609610 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d404b-1cc4-4f08-82f2-2bd59620c160 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:05.609899 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d404b-1cc4-4f08-82f2-2bd59620c160 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:05.610278 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d404b-1cc4-4f08-82f2-2bd59620c160 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:05.610986 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d404b-1cc4-4f08-82f2-2bd59620c160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:05.613947 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d404b-1cc4-4f08-82f2-2bd59620c160 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:05.775177 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 987/1977] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:55:05 2022] POST /identity/v3/projects => generated 383 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:55:05.789354 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96bd55-2e82-450a-a18e-8fc1240d0fd2 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:05.816058 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96bd55-2e82-450a-a18e-8fc1240d0fd2 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:05.953807 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3e42c-0740-4057-922b-f051c7baeaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:05.954449 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3e42c-0740-4057-922b-f051c7baeaf2 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:05.954731 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3e42c-0740-4057-922b-f051c7baeaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:05.955010 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3e42c-0740-4057-922b-f051c7baeaf2 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:05.955748 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3e42c-0740-4057-922b-f051c7baeaf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:05.960477 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3e42c-0740-4057-922b-f051c7baeaf2 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:06.126909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 991/1978] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:55:05 2022] POST /identity/v3/users => generated 292 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:55:06.144562 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d404b-1cc4-4f08-82f2-2bd59620c160 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:06.170605 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d404b-1cc4-4f08-82f2-2bd59620c160 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:06.190074 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca224fc-33c1-4d8c-97bf-63ccd55a0889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:06.191045 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca224fc-33c1-4d8c-97bf-63ccd55a0889 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:06.191819 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca224fc-33c1-4d8c-97bf-63ccd55a0889 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:06.199524 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca224fc-33c1-4d8c-97bf-63ccd55a0889 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:06.199524 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca224fc-33c1-4d8c-97bf-63ccd55a0889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:06.199524 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca224fc-33c1-4d8c-97bf-63ccd55a0889 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:06.209860 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 988/1979] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:55:06.215701 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3e42c-0740-4057-922b-f051c7baeaf2 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:06.227875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3e42c-0740-4057-922b-f051c7baeaf2 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:06.234254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ac168-d1cb-4b1a-ae96-7ca50dc74799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:06.235414 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ac168-d1cb-4b1a-ae96-7ca50dc74799 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:06.235713 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ac168-d1cb-4b1a-ae96-7ca50dc74799 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:06.236014 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ac168-d1cb-4b1a-ae96-7ca50dc74799 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:06.236686 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ac168-d1cb-4b1a-ae96-7ca50dc74799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:06.238758 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ac168-d1cb-4b1a-ae96-7ca50dc74799 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:06.272183 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 992/1980] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:55:06.273187 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca224fc-33c1-4d8c-97bf-63ccd55a0889 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:06.293263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca224fc-33c1-4d8c-97bf-63ccd55a0889 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:06.307269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52dabfb-3591-49ed-bf18-79abc7165d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:06.308121 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52dabfb-3591-49ed-bf18-79abc7165d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:06.308509 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52dabfb-3591-49ed-bf18-79abc7165d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:06.308906 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52dabfb-3591-49ed-bf18-79abc7165d34 admin admin] PATH_INFO: `/v3/projects/8acf3d7d33244b0da000a5803e574549/users/67531341c60b4de191a07f63f20d871c/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:06.327405 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52dabfb-3591-49ed-bf18-79abc7165d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8acf3d7d33244b0da000a5803e574549, user_id=67531341c60b4de191a07f63f20d871c, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:06.330225 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52dabfb-3591-49ed-bf18-79abc7165d34 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:06.442243 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 989/1981] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:55:06 2022] PUT /identity/v3/projects/8acf3d7d33244b0da000a5803e574549/users/67531341c60b4de191a07f63f20d871c/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:06.453845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4829b-613b-48d9-a13b-4ad6b2867e91 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:06.454133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4829b-613b-48d9-a13b-4ad6b2867e91 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:06.454422 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4829b-613b-48d9-a13b-4ad6b2867e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:06.495333 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-d1b4829b-613b-48d9-a13b-4ad6b2867e91 None None] MFA Rules not processed for user `67531341c60b4de191a07f63f20d871c`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:06.496873 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-d1b4829b-613b-48d9-a13b-4ad6b2867e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:06.585262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 993/1982] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:06.589653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52dabfb-3591-49ed-bf18-79abc7165d34 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:06.766560 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52dabfb-3591-49ed-bf18-79abc7165d34 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:06.785840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263b1b4-b6f6-43b1-b56b-1b7b219896fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:06.787089 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263b1b4-b6f6-43b1-b56b-1b7b219896fd admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:06.787559 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263b1b4-b6f6-43b1-b56b-1b7b219896fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:06.799854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263b1b4-b6f6-43b1-b56b-1b7b219896fd admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:06.802826 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263b1b4-b6f6-43b1-b56b-1b7b219896fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:06.809665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263b1b4-b6f6-43b1-b56b-1b7b219896fd admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:06.942402 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 990/1983] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:55:06 2022] POST /identity/v3/projects => generated 385 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:55:06.946787 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4829b-613b-48d9-a13b-4ad6b2867e91 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:06.969652 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4829b-613b-48d9-a13b-4ad6b2867e91 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:07.113175 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ed991-d7a2-4867-8d3f-529b9b5c86be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:07.114417 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ed991-d7a2-4867-8d3f-529b9b5c86be admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:07.114417 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ed991-d7a2-4867-8d3f-529b9b5c86be admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:07.114699 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ed991-d7a2-4867-8d3f-529b9b5c86be admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:07.117704 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ed991-d7a2-4867-8d3f-529b9b5c86be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:07.122428 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ed991-d7a2-4867-8d3f-529b9b5c86be admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:07.318036 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:07.331402 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 994/1984] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:55:06 2022] POST /identity/v3/users => generated 299 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:55:07.333850 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263b1b4-b6f6-43b1-b56b-1b7b219896fd admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:07.347240 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263b1b4-b6f6-43b1-b56b-1b7b219896fd admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:07.356392 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2dc01b-d09a-4410-a691-c4a2c8c5790b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:07.357025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dc01b-d09a-4410-a691-c4a2c8c5790b admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:07.357307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dc01b-d09a-4410-a691-c4a2c8c5790b admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:07.357657 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dc01b-d09a-4410-a691-c4a2c8c5790b admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:07.358323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2dc01b-d09a-4410-a691-c4a2c8c5790b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:07.359982 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2dc01b-d09a-4410-a691-c4a2c8c5790b admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:07.372095 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 991/1985] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:55:07.376326 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ed991-d7a2-4867-8d3f-529b9b5c86be admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:07.389608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ed991-d7a2-4867-8d3f-529b9b5c86be admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:07.403385 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f13eb4-8cfc-4657-a2ef-2abf615ed845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:07.403385 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f13eb4-8cfc-4657-a2ef-2abf615ed845 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:07.403385 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f13eb4-8cfc-4657-a2ef-2abf615ed845 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:07.403385 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f13eb4-8cfc-4657-a2ef-2abf615ed845 admin admin] PATH_INFO: `/v3/projects/d5e7a8c1173840d4a66690ac6c230408/users/936f031a2bdb414abf229d462f223075/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:07.415942 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f13eb4-8cfc-4657-a2ef-2abf615ed845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e7a8c1173840d4a66690ac6c230408, user_id=936f031a2bdb414abf229d462f223075, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:07.421017 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f13eb4-8cfc-4657-a2ef-2abf615ed845 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:07.547214 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 995/1986] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:55:07 2022] PUT /identity/v3/projects/d5e7a8c1173840d4a66690ac6c230408/users/936f031a2bdb414abf229d462f223075/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:55:07.553130 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2dc01b-d09a-4410-a691-c4a2c8c5790b admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:07.569921 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2dc01b-d09a-4410-a691-c4a2c8c5790b admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:07.667237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07c3ff-ef54-48ca-97b9-5aa18585db4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:07.668118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07c3ff-ef54-48ca-97b9-5aa18585db4c admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:07.668956 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07c3ff-ef54-48ca-97b9-5aa18585db4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:07.669418 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07c3ff-ef54-48ca-97b9-5aa18585db4c admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:07.672174 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07c3ff-ef54-48ca-97b9-5aa18585db4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:07.675091 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07c3ff-ef54-48ca-97b9-5aa18585db4c admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:07.688983 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:07.700457 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 992/1987] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:55:07.703661 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f13eb4-8cfc-4657-a2ef-2abf615ed845 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:07.735031 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f13eb4-8cfc-4657-a2ef-2abf615ed845 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:07.743681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1209ba-41e1-4391-affe-2f55b288aa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:07.744484 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1209ba-41e1-4391-affe-2f55b288aa2f admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:07.744897 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1209ba-41e1-4391-affe-2f55b288aa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:07.746033 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1209ba-41e1-4391-affe-2f55b288aa2f admin admin] PATH_INFO: `/v3/projects/d5e7a8c1173840d4a66690ac6c230408/users/936f031a2bdb414abf229d462f223075/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:07.750463 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1209ba-41e1-4391-affe-2f55b288aa2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e7a8c1173840d4a66690ac6c230408, user_id=936f031a2bdb414abf229d462f223075, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:07.753928 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1209ba-41e1-4391-affe-2f55b288aa2f admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:07.775624 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 996/1988] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:55:07 2022] PUT /identity/v3/projects/d5e7a8c1173840d4a66690ac6c230408/users/936f031a2bdb414abf229d462f223075/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:07.792604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547f5f1-1edc-44c5-8df4-2bc07e455e03 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:07.793747 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547f5f1-1edc-44c5-8df4-2bc07e455e03 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:07.794270 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547f5f1-1edc-44c5-8df4-2bc07e455e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:07.876285 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-0547f5f1-1edc-44c5-8df4-2bc07e455e03 None None] MFA Rules not processed for user `936f031a2bdb414abf229d462f223075`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:07.876285 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-0547f5f1-1edc-44c5-8df4-2bc07e455e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:07.981967 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 993/1989] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:07.995582 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1209ba-41e1-4391-affe-2f55b288aa2f admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:07.997860 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-fe1209ba-41e1-4391-affe-2f55b288aa2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:08.084518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1209ba-41e1-4391-affe-2f55b288aa2f admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:08.090358 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c2f97-ba72-41c2-803d-de8ad8f3dabf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:08.090358 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c2f97-ba72-41c2-803d-de8ad8f3dabf service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:08.091961 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c2f97-ba72-41c2-803d-de8ad8f3dabf service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:08.091961 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c2f97-ba72-41c2-803d-de8ad8f3dabf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:08.184924 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e3126-10b9-4b7d-b214-9e528a0708e8 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:08.185211 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e3126-10b9-4b7d-b214-9e528a0708e8 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:08.185501 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e3126-10b9-4b7d-b214-9e528a0708e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:08.188116 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c2f97-ba72-41c2-803d-de8ad8f3dabf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:08.189581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c2f97-ba72-41c2-803d-de8ad8f3dabf service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:08.200913 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 997/1990] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:55:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:55:08.246172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-098e3126-10b9-4b7d-b214-9e528a0708e8 None None] MFA Rules not processed for user `3043eb81894f4525ac2d153da8bd3e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:08.247560 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-098e3126-10b9-4b7d-b214-9e528a0708e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:08.342168 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 994/1991] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:55:08.346607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c2f97-ba72-41c2-803d-de8ad8f3dabf service cinder] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:08.348191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ae9c2f97-ba72-41c2-803d-de8ad8f3dabf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:08.439496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c2f97-ba72-41c2-803d-de8ad8f3dabf service cinder] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:08.450977 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b1547-c5a3-491c-8d01-0693d0286360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:08.450977 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b1547-c5a3-491c-8d01-0693d0286360 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:08.451202 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b1547-c5a3-491c-8d01-0693d0286360 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:08.451515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b1547-c5a3-491c-8d01-0693d0286360 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:08.452756 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b1547-c5a3-491c-8d01-0693d0286360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:08.454666 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b1547-c5a3-491c-8d01-0693d0286360 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:08.621700 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 998/1992] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:55:08 2022] POST /identity/v3/projects => generated 371 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:55:08.626326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e3126-10b9-4b7d-b214-9e528a0708e8 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:08.640698 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e3126-10b9-4b7d-b214-9e528a0708e8 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:08.702984 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177e148-23a6-4d64-980a-7545344bcbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:08.703641 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177e148-23a6-4d64-980a-7545344bcbff admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:08.703933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177e148-23a6-4d64-980a-7545344bcbff admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:08.704212 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177e148-23a6-4d64-980a-7545344bcbff admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:08.704868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177e148-23a6-4d64-980a-7545344bcbff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:08.707054 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177e148-23a6-4d64-980a-7545344bcbff admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:08.856750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 995/1993] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:55:08 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:55:08.858595 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b1547-c5a3-491c-8d01-0693d0286360 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:08.871491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b1547-c5a3-491c-8d01-0693d0286360 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:08.900027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5f0b6-5d06-4bbd-ba7a-48fad11c51df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:08.900667 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5f0b6-5d06-4bbd-ba7a-48fad11c51df admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:08.900980 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5f0b6-5d06-4bbd-ba7a-48fad11c51df admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:08.901231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5f0b6-5d06-4bbd-ba7a-48fad11c51df admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:08.906308 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5f0b6-5d06-4bbd-ba7a-48fad11c51df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:08.911864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5f0b6-5d06-4bbd-ba7a-48fad11c51df admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:08.937128 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 999/1994] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:55:08.938729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177e148-23a6-4d64-980a-7545344bcbff admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:08.958251 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177e148-23a6-4d64-980a-7545344bcbff admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:08.963353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40222cf2-a0a2-4429-8794-f4121285c5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:08.964065 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40222cf2-a0a2-4429-8794-f4121285c5b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:08.964522 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40222cf2-a0a2-4429-8794-f4121285c5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:08.964806 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40222cf2-a0a2-4429-8794-f4121285c5b5 admin admin] PATH_INFO: `/v3/projects/6c80f23011f04608902d314b8d462128/users/1a69b859cc0c41e0aaae8bbce7d58d89/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:08.983278 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40222cf2-a0a2-4429-8794-f4121285c5b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c80f23011f04608902d314b8d462128, user_id=1a69b859cc0c41e0aaae8bbce7d58d89, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:08.990552 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40222cf2-a0a2-4429-8794-f4121285c5b5 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:09.109969 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 996/1995] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:55:08 2022] PUT /identity/v3/projects/6c80f23011f04608902d314b8d462128/users/1a69b859cc0c41e0aaae8bbce7d58d89/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:55:09.114665 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5f0b6-5d06-4bbd-ba7a-48fad11c51df admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:09.125023 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5f0b6-5d06-4bbd-ba7a-48fad11c51df admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:09.189853 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e0a8b-5db8-4c83-8b67-84dc5d9a4703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:09.190820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e0a8b-5db8-4c83-8b67-84dc5d9a4703 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:09.191181 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e0a8b-5db8-4c83-8b67-84dc5d9a4703 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:09.191967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e0a8b-5db8-4c83-8b67-84dc5d9a4703 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:09.192716 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e0a8b-5db8-4c83-8b67-84dc5d9a4703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:09.194909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e0a8b-5db8-4c83-8b67-84dc5d9a4703 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:09.206535 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1000/1996] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:55:09.210889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40222cf2-a0a2-4429-8794-f4121285c5b5 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:09.229123 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40222cf2-a0a2-4429-8794-f4121285c5b5 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:09.236594 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e345bc2-654a-4950-b231-4ac0fdb549ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:09.237388 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e345bc2-654a-4950-b231-4ac0fdb549ba admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:09.237955 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e345bc2-654a-4950-b231-4ac0fdb549ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:09.238405 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e345bc2-654a-4950-b231-4ac0fdb549ba admin admin] PATH_INFO: `/v3/projects/6c80f23011f04608902d314b8d462128/users/1a69b859cc0c41e0aaae8bbce7d58d89/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:09.241008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e345bc2-654a-4950-b231-4ac0fdb549ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c80f23011f04608902d314b8d462128, user_id=1a69b859cc0c41e0aaae8bbce7d58d89, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:09.243824 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e345bc2-654a-4950-b231-4ac0fdb549ba admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:09.255893 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 997/1997] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:55:09 2022] PUT /identity/v3/projects/6c80f23011f04608902d314b8d462128/users/1a69b859cc0c41e0aaae8bbce7d58d89/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:10.038722 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:10.224268 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:11.650907 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:12.186955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e0a8b-5db8-4c83-8b67-84dc5d9a4703 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:12.341423 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e0a8b-5db8-4c83-8b67-84dc5d9a4703 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:12.495900 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22146bd8-243e-489f-969b-1a2c8589cb2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:12.496543 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22146bd8-243e-489f-969b-1a2c8589cb2a service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:12.496829 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22146bd8-243e-489f-969b-1a2c8589cb2a service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:12.497105 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22146bd8-243e-489f-969b-1a2c8589cb2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:12.515401 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:12.574458 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22146bd8-243e-489f-969b-1a2c8589cb2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:12.576128 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22146bd8-243e-489f-969b-1a2c8589cb2a service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:12.587134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1001/1998] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:55:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:55:13.038306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e345bc2-654a-4950-b231-4ac0fdb549ba admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:13.040535 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-2e345bc2-654a-4950-b231-4ac0fdb549ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:13.149545 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e345bc2-654a-4950-b231-4ac0fdb549ba admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:13.164313 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323bf63-a69f-46e6-b485-02a31d993295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:13.164313 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323bf63-a69f-46e6-b485-02a31d993295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:13.169382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323bf63-a69f-46e6-b485-02a31d993295 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:13.173463 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323bf63-a69f-46e6-b485-02a31d993295 admin admin] PATH_INFO: `/v3/users/fa694c3429dc4aa2a1fa65e3d917ee40` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:13.177959 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323bf63-a69f-46e6-b485-02a31d993295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa694c3429dc4aa2a1fa65e3d917ee40)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:13.181514 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323bf63-a69f-46e6-b485-02a31d993295 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:13.217543 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22146bd8-243e-489f-969b-1a2c8589cb2a service cinder] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:13.237532 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22146bd8-243e-489f-969b-1a2c8589cb2a service cinder] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:13.243139 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:13.243683 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e61919-a138-486e-a424-6753926c000e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:13.244089 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e61919-a138-486e-a424-6753926c000e service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:13.244817 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e61919-a138-486e-a424-6753926c000e service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:13.245701 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e61919-a138-486e-a424-6753926c000e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:13.353877 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e61919-a138-486e-a424-6753926c000e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:13.355347 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e61919-a138-486e-a424-6753926c000e service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:13.369656 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1002/1999] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:55:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:55:13.476790 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c323bf63-a69f-46e6-b485-02a31d993295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa694c3429dc4aa2a1fa65e3d917ee40'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:13.477771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c323bf63-a69f-46e6-b485-02a31d993295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa694c3429dc4aa2a1fa65e3d917ee40'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:13.510668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c323bf63-a69f-46e6-b485-02a31d993295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa694c3429dc4aa2a1fa65e3d917ee40'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:13.525620 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c323bf63-a69f-46e6-b485-02a31d993295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa694c3429dc4aa2a1fa65e3d917ee40'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:13.621183 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c323bf63-a69f-46e6-b485-02a31d993295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa694c3429dc4aa2a1fa65e3d917ee40'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:13.632473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 998/2000] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:55:13 2022] DELETE /identity/v3/users/fa694c3429dc4aa2a1fa65e3d917ee40 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:13.637004 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0afbd-8578-4d19-a913-df057cc16298 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:13.637297 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0afbd-8578-4d19-a913-df057cc16298 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:13.637594 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0afbd-8578-4d19-a913-df057cc16298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:13.659481 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-bbc0afbd-8578-4d19-a913-df057cc16298 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:13.660883 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-bbc0afbd-8578-4d19-a913-df057cc16298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:13.757257 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1003/2001] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:13.774917 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323bf63-a69f-46e6-b485-02a31d993295 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:13.776623 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c323bf63-a69f-46e6-b485-02a31d993295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:13.874055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323bf63-a69f-46e6-b485-02a31d993295 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:13.879173 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444a875-25ff-4597-8757-b541f530e667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:13.880637 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444a875-25ff-4597-8757-b541f530e667 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:13.881307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444a875-25ff-4597-8757-b541f530e667 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:13.881791 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444a875-25ff-4597-8757-b541f530e667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:13.901843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444a875-25ff-4597-8757-b541f530e667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:13.904236 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444a875-25ff-4597-8757-b541f530e667 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:13.940168 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 999/2002] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:55:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:55:14.789901 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0afbd-8578-4d19-a913-df057cc16298 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:14.791455 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-bbc0afbd-8578-4d19-a913-df057cc16298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:14.818100 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0afbd-8578-4d19-a913-df057cc16298 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:14.826925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370f560-1b66-4980-baf9-6be66283dd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:14.826925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370f560-1b66-4980-baf9-6be66283dd18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:14.826925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370f560-1b66-4980-baf9-6be66283dd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:14.826925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370f560-1b66-4980-baf9-6be66283dd18 admin admin] PATH_INFO: `/v3/projects/e895e16f0b4d4486879e5ac2370081f1` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:14.827441 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370f560-1b66-4980-baf9-6be66283dd18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e895e16f0b4d4486879e5ac2370081f1)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:14.829463 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370f560-1b66-4980-baf9-6be66283dd18 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:15.024093 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-0370f560-1b66-4980-baf9-6be66283dd18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e895e16f0b4d4486879e5ac2370081f1', 'request_id': 'req-0370f560-1b66-4980-baf9-6be66283dd18'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:15.036307 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-0370f560-1b66-4980-baf9-6be66283dd18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e895e16f0b4d4486879e5ac2370081f1', 'request_id': 'req-0370f560-1b66-4980-baf9-6be66283dd18'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:15.073814 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:15.131635 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-0370f560-1b66-4980-baf9-6be66283dd18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e895e16f0b4d4486879e5ac2370081f1', 'request_id': 'req-0370f560-1b66-4980-baf9-6be66283dd18'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:15.159116 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-0370f560-1b66-4980-baf9-6be66283dd18 admin admin] The token cache is being invalidate because project e895e16f0b4d4486879e5ac2370081f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:55:15.159792 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-0370f560-1b66-4980-baf9-6be66283dd18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:15.160735 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-0370f560-1b66-4980-baf9-6be66283dd18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:15.162496 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1004/2003] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:55:14 2022] DELETE /identity/v3/projects/e895e16f0b4d4486879e5ac2370081f1 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:15.166741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444a875-25ff-4597-8757-b541f530e667 service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:15.181732 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444a875-25ff-4597-8757-b541f530e667 service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:15.254076 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497a806-1a86-4bef-a1ee-1dfe583b6786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:15.254879 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497a806-1a86-4bef-a1ee-1dfe583b6786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:15.254994 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497a806-1a86-4bef-a1ee-1dfe583b6786 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:15.255260 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497a806-1a86-4bef-a1ee-1dfe583b6786 admin admin] PATH_INFO: `/v3/users/5527150c61474dd088487fa54582a2e4` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:15.256468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497a806-1a86-4bef-a1ee-1dfe583b6786 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5527150c61474dd088487fa54582a2e4)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:15.258584 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497a806-1a86-4bef-a1ee-1dfe583b6786 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:15.508616 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f497a806-1a86-4bef-a1ee-1dfe583b6786 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5527150c61474dd088487fa54582a2e4'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:15.510798 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f497a806-1a86-4bef-a1ee-1dfe583b6786 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5527150c61474dd088487fa54582a2e4'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:15.530034 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f497a806-1a86-4bef-a1ee-1dfe583b6786 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5527150c61474dd088487fa54582a2e4'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:15.539805 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f497a806-1a86-4bef-a1ee-1dfe583b6786 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5527150c61474dd088487fa54582a2e4'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:15.634609 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f497a806-1a86-4bef-a1ee-1dfe583b6786 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5527150c61474dd088487fa54582a2e4'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:15.643041 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1000/2004] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:55:15 2022] DELETE /identity/v3/users/5527150c61474dd088487fa54582a2e4 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:15.747583 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370f560-1b66-4980-baf9-6be66283dd18 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:15.749567 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-0370f560-1b66-4980-baf9-6be66283dd18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:15.815763 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370f560-1b66-4980-baf9-6be66283dd18 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:15.884724 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fb2f4-ecc4-4ec7-b49c-1445ae89645a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:15.885065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fb2f4-ecc4-4ec7-b49c-1445ae89645a service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:15.885437 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fb2f4-ecc4-4ec7-b49c-1445ae89645a service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:15.885800 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fb2f4-ecc4-4ec7-b49c-1445ae89645a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:15.887759 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-969fb2f4-ecc4-4ec7-b49c-1445ae89645a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:15.978609 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969fb2f4-ecc4-4ec7-b49c-1445ae89645a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:15.980888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969fb2f4-ecc4-4ec7-b49c-1445ae89645a service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:15.994567 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1005/2005] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:55:15 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:55:16.046306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:16.512184 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497a806-1a86-4bef-a1ee-1dfe583b6786 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:16.518099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-f497a806-1a86-4bef-a1ee-1dfe583b6786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:16.608543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497a806-1a86-4bef-a1ee-1dfe583b6786 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:16.615491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28173318-4837-4ee9-a4d9-d340c50e4fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:16.619220 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28173318-4837-4ee9-a4d9-d340c50e4fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:16.619220 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28173318-4837-4ee9-a4d9-d340c50e4fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:16.619220 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28173318-4837-4ee9-a4d9-d340c50e4fe0 admin admin] PATH_INFO: `/v3/projects/fcc4033703f74ef3ab13e6cd65db6372` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:16.619220 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28173318-4837-4ee9-a4d9-d340c50e4fe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcc4033703f74ef3ab13e6cd65db6372)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:16.629215 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28173318-4837-4ee9-a4d9-d340c50e4fe0 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:16.835595 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-28173318-4837-4ee9-a4d9-d340c50e4fe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcc4033703f74ef3ab13e6cd65db6372', 'request_id': 'req-28173318-4837-4ee9-a4d9-d340c50e4fe0'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:16.841849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-28173318-4837-4ee9-a4d9-d340c50e4fe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcc4033703f74ef3ab13e6cd65db6372', 'request_id': 'req-28173318-4837-4ee9-a4d9-d340c50e4fe0'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:16.850259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-28173318-4837-4ee9-a4d9-d340c50e4fe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcc4033703f74ef3ab13e6cd65db6372', 'request_id': 'req-28173318-4837-4ee9-a4d9-d340c50e4fe0'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:16.946783 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-28173318-4837-4ee9-a4d9-d340c50e4fe0 admin admin] The token cache is being invalidate because project fcc4033703f74ef3ab13e6cd65db6372 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:55:16.947081 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-28173318-4837-4ee9-a4d9-d340c50e4fe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:16.947822 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-28173318-4837-4ee9-a4d9-d340c50e4fe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:16.949392 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1001/2006] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:55:16 2022] DELETE /identity/v3/projects/fcc4033703f74ef3ab13e6cd65db6372 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:16.953696 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fb2f4-ecc4-4ec7-b49c-1445ae89645a service cinder] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:16.967790 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fb2f4-ecc4-4ec7-b49c-1445ae89645a service cinder] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:17.048483 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8c308-4cb6-40dd-8f35-e31c1e27070c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:17.049467 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8c308-4cb6-40dd-8f35-e31c1e27070c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:17.049926 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8c308-4cb6-40dd-8f35-e31c1e27070c admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:17.050359 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8c308-4cb6-40dd-8f35-e31c1e27070c admin admin] PATH_INFO: `/v3/users/f4e0fe36fe3f4d1d8718a6c470a7f378` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:17.054765 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8c308-4cb6-40dd-8f35-e31c1e27070c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4e0fe36fe3f4d1d8718a6c470a7f378)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:17.057456 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8c308-4cb6-40dd-8f35-e31c1e27070c admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:17.256286 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-45a8c308-4cb6-40dd-8f35-e31c1e27070c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4e0fe36fe3f4d1d8718a6c470a7f378'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:17.349802 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-45a8c308-4cb6-40dd-8f35-e31c1e27070c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4e0fe36fe3f4d1d8718a6c470a7f378'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:17.361229 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-45a8c308-4cb6-40dd-8f35-e31c1e27070c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4e0fe36fe3f4d1d8718a6c470a7f378'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:17.381298 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-45a8c308-4cb6-40dd-8f35-e31c1e27070c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4e0fe36fe3f4d1d8718a6c470a7f378'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:17.382124 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-45a8c308-4cb6-40dd-8f35-e31c1e27070c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4e0fe36fe3f4d1d8718a6c470a7f378'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:17.389478 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1006/2007] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:55:16 2022] DELETE /identity/v3/users/f4e0fe36fe3f4d1d8718a6c470a7f378 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:17.554573 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44bee5-f392-4a22-b5a7-86db218c537f None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:17.555099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44bee5-f392-4a22-b5a7-86db218c537f None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:17.555099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44bee5-f392-4a22-b5a7-86db218c537f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:17.594516 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-eb44bee5-f392-4a22-b5a7-86db218c537f None None] MFA Rules not processed for user `1a69b859cc0c41e0aaae8bbce7d58d89`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:17.595844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-eb44bee5-f392-4a22-b5a7-86db218c537f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:17.657509 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:17.691847 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1002/2008] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:17.706301 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8c308-4cb6-40dd-8f35-e31c1e27070c admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:17.708597 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-45a8c308-4cb6-40dd-8f35-e31c1e27070c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:17.813777 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8c308-4cb6-40dd-8f35-e31c1e27070c admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:17.837692 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394cfea0-6263-42b2-8f8f-05234efd8744 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:17.837692 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cfea0-6263-42b2-8f8f-05234efd8744 service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:17.837692 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cfea0-6263-42b2-8f8f-05234efd8744 service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:17.837692 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cfea0-6263-42b2-8f8f-05234efd8744 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:17.837984 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-394cfea0-6263-42b2-8f8f-05234efd8744 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:17.909738 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394cfea0-6263-42b2-8f8f-05234efd8744 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:17.912044 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394cfea0-6263-42b2-8f8f-05234efd8744 service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:17.922551 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1007/2009] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:55:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:55:17.963857 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44bee5-f392-4a22-b5a7-86db218c537f None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:17.966314 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-eb44bee5-f392-4a22-b5a7-86db218c537f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:18.076461 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44bee5-f392-4a22-b5a7-86db218c537f None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:18.081265 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71209a1-f1ad-4a6b-8e11-85f23b463b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:18.081903 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71209a1-f1ad-4a6b-8e11-85f23b463b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:18.082185 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71209a1-f1ad-4a6b-8e11-85f23b463b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:18.082456 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71209a1-f1ad-4a6b-8e11-85f23b463b68 admin admin] PATH_INFO: `/v3/projects/d7ee2a66c52346daa9e97202146c1445` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:18.083643 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71209a1-f1ad-4a6b-8e11-85f23b463b68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7ee2a66c52346daa9e97202146c1445)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:18.085782 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71209a1-f1ad-4a6b-8e11-85f23b463b68 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:18.217005 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-b71209a1-f1ad-4a6b-8e11-85f23b463b68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7ee2a66c52346daa9e97202146c1445', 'request_id': 'req-b71209a1-f1ad-4a6b-8e11-85f23b463b68'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:18.230622 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-b71209a1-f1ad-4a6b-8e11-85f23b463b68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7ee2a66c52346daa9e97202146c1445', 'request_id': 'req-b71209a1-f1ad-4a6b-8e11-85f23b463b68'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:18.245345 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-b71209a1-f1ad-4a6b-8e11-85f23b463b68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7ee2a66c52346daa9e97202146c1445', 'request_id': 'req-b71209a1-f1ad-4a6b-8e11-85f23b463b68'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:18.331162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-b71209a1-f1ad-4a6b-8e11-85f23b463b68 admin admin] The token cache is being invalidate because project d7ee2a66c52346daa9e97202146c1445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:55:18.331494 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-b71209a1-f1ad-4a6b-8e11-85f23b463b68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:18.332147 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-b71209a1-f1ad-4a6b-8e11-85f23b463b68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:18.335393 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1003/2010] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:55:17 2022] DELETE /identity/v3/projects/d7ee2a66c52346daa9e97202146c1445 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:18.340423 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dd169-5ef1-44dd-8f83-9933951ef1a2 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:18.340954 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dd169-5ef1-44dd-8f83-9933951ef1a2 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:18.341167 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dd169-5ef1-44dd-8f83-9933951ef1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:18.365080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-ae4dd169-5ef1-44dd-8f83-9933951ef1a2 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:18.365080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ae4dd169-5ef1-44dd-8f83-9933951ef1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:18.433294 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1008/2011] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:18.442370 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c136426-2990-4df5-b31b-0b2431760365 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:18.442694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c136426-2990-4df5-b31b-0b2431760365 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:18.442968 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c136426-2990-4df5-b31b-0b2431760365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:18.472811 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-3c136426-2990-4df5-b31b-0b2431760365 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:18.474381 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-3c136426-2990-4df5-b31b-0b2431760365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:18.494424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1004/2012] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:18.500579 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4dd169-5ef1-44dd-8f83-9933951ef1a2 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:18.509547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:18.511634 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4dd169-5ef1-44dd-8f83-9933951ef1a2 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:18.517122 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04830d-5f41-449f-99d3-8cb06457de4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:18.517736 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04830d-5f41-449f-99d3-8cb06457de4b admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:18.518017 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04830d-5f41-449f-99d3-8cb06457de4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:18.518292 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04830d-5f41-449f-99d3-8cb06457de4b admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:18.518928 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04830d-5f41-449f-99d3-8cb06457de4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:55:18.519248 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04830d-5f41-449f-99d3-8cb06457de4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:18.520891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04830d-5f41-449f-99d3-8cb06457de4b admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:18.536652 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1009/2013] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:55:18.538008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c136426-2990-4df5-b31b-0b2431760365 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:18.547523 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c136426-2990-4df5-b31b-0b2431760365 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:18.552630 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322ce09-5541-4ac9-a983-2ef66d859aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:18.553421 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322ce09-5541-4ac9-a983-2ef66d859aba admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:18.553697 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322ce09-5541-4ac9-a983-2ef66d859aba admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:18.555598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322ce09-5541-4ac9-a983-2ef66d859aba admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:18.555598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322ce09-5541-4ac9-a983-2ef66d859aba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:18.556831 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322ce09-5541-4ac9-a983-2ef66d859aba admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:18.672457 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1005/2014] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:55:18 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:55:18.673727 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04830d-5f41-449f-99d3-8cb06457de4b admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:18.686000 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04830d-5f41-449f-99d3-8cb06457de4b admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:18.751196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb77da-95bc-4cc7-b095-fa2bc880389b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:18.751860 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb77da-95bc-4cc7-b095-fa2bc880389b admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:18.752145 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb77da-95bc-4cc7-b095-fa2bc880389b admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:18.752421 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb77da-95bc-4cc7-b095-fa2bc880389b admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:18.753076 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb77da-95bc-4cc7-b095-fa2bc880389b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:18.755011 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb77da-95bc-4cc7-b095-fa2bc880389b admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:18.856257 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1010/2015] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:55:18 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:55:18.861276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322ce09-5541-4ac9-a983-2ef66d859aba admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:18.874137 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322ce09-5541-4ac9-a983-2ef66d859aba admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:18.879320 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749595ce-7ab6-42a7-a34d-3b759bc8680c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:18.879982 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749595ce-7ab6-42a7-a34d-3b759bc8680c admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:18.880332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749595ce-7ab6-42a7-a34d-3b759bc8680c admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:18.880992 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749595ce-7ab6-42a7-a34d-3b759bc8680c admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:18.881827 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749595ce-7ab6-42a7-a34d-3b759bc8680c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:18.883550 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749595ce-7ab6-42a7-a34d-3b759bc8680c admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:18.897500 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1006/2016] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:55:18.898891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb77da-95bc-4cc7-b095-fa2bc880389b admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:18.910784 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb77da-95bc-4cc7-b095-fa2bc880389b admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:18.917129 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18ab49-3672-4bb7-a9d2-7052ed1676fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:18.918096 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18ab49-3672-4bb7-a9d2-7052ed1676fe admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:18.918096 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18ab49-3672-4bb7-a9d2-7052ed1676fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:18.918358 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18ab49-3672-4bb7-a9d2-7052ed1676fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:18.920388 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18ab49-3672-4bb7-a9d2-7052ed1676fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:18.921350 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18ab49-3672-4bb7-a9d2-7052ed1676fe admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:18.933207 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1011/2017] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:55:18.937145 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749595ce-7ab6-42a7-a34d-3b759bc8680c admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:18.960110 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749595ce-7ab6-42a7-a34d-3b759bc8680c admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:18.960110 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb914444-9e3d-4f93-b3cf-67329ec610da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:18.960110 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914444-9e3d-4f93-b3cf-67329ec610da admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:18.960110 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914444-9e3d-4f93-b3cf-67329ec610da admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:18.960884 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914444-9e3d-4f93-b3cf-67329ec610da admin admin] PATH_INFO: `/v3/projects/746e3f51f14a43ff8464d2e1983e46c0/users/23570a46e7e74e52a81293dbea868360/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:18.972722 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb914444-9e3d-4f93-b3cf-67329ec610da admin admin] RBAC: Authorizing `identity:create_grant(project_id=746e3f51f14a43ff8464d2e1983e46c0, user_id=23570a46e7e74e52a81293dbea868360, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:18.975780 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb914444-9e3d-4f93-b3cf-67329ec610da admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:19.068867 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1007/2018] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:55:18 2022] PUT /identity/v3/projects/746e3f51f14a43ff8464d2e1983e46c0/users/23570a46e7e74e52a81293dbea868360/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:19.073435 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88df07-efb5-40cc-bb1c-340e58120c7f None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:19.073720 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88df07-efb5-40cc-bb1c-340e58120c7f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:19.073992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88df07-efb5-40cc-bb1c-340e58120c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:19.107494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-6c88df07-efb5-40cc-bb1c-340e58120c7f None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:19.108805 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-6c88df07-efb5-40cc-bb1c-340e58120c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:19.236441 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1012/2019] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:19.254769 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb914444-9e3d-4f93-b3cf-67329ec610da admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:19.256961 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-bb914444-9e3d-4f93-b3cf-67329ec610da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:19.324368 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb914444-9e3d-4f93-b3cf-67329ec610da admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:19.328124 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f7923-7399-4f8b-9049-742130cd46f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:19.328746 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f7923-7399-4f8b-9049-742130cd46f4 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:19.329054 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f7923-7399-4f8b-9049-742130cd46f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:19.329325 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f7923-7399-4f8b-9049-742130cd46f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:19.339837 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f7923-7399-4f8b-9049-742130cd46f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:19.341029 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f7923-7399-4f8b-9049-742130cd46f4 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:19.352527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1008/2020] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:55:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:55:20.069407 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:20.926635 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:21.275427 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc95c3-4dec-4444-8fd4-83bc668c951b None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:21.275427 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc95c3-4dec-4444-8fd4-83bc668c951b None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:21.275427 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc95c3-4dec-4444-8fd4-83bc668c951b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:21.315922 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-dfbc95c3-4dec-4444-8fd4-83bc668c951b None None] MFA Rules not processed for user `23570a46e7e74e52a81293dbea868360`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:21.317528 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-dfbc95c3-4dec-4444-8fd4-83bc668c951b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:21.408586 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1013/2021] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:21.413297 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f7923-7399-4f8b-9049-742130cd46f4 service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:21.434301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f7923-7399-4f8b-9049-742130cd46f4 service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:21.443642 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d7d6e-ce9f-4124-8afa-74f86e07f772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:21.449516 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d7d6e-ce9f-4124-8afa-74f86e07f772 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:21.449516 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d7d6e-ce9f-4124-8afa-74f86e07f772 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:21.449516 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d7d6e-ce9f-4124-8afa-74f86e07f772 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:21.449516 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d7d6e-ce9f-4124-8afa-74f86e07f772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:21.451728 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d7d6e-ce9f-4124-8afa-74f86e07f772 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:21.576229 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1009/2022] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:55:21 2022] POST /identity/v3/projects => generated 371 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:55:21.579944 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc95c3-4dec-4444-8fd4-83bc668c951b None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:21.591481 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc95c3-4dec-4444-8fd4-83bc668c951b None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:21.670671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f3b91-e5d3-43c9-aa0c-07cd20222815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:21.671327 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f3b91-e5d3-43c9-aa0c-07cd20222815 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:21.671654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f3b91-e5d3-43c9-aa0c-07cd20222815 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:21.671930 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f3b91-e5d3-43c9-aa0c-07cd20222815 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:21.673411 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f3b91-e5d3-43c9-aa0c-07cd20222815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:21.683515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f3b91-e5d3-43c9-aa0c-07cd20222815 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:21.791348 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323de68d-9cd6-4af3-a6a0-43f2774475cf None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:21.791749 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323de68d-9cd6-4af3-a6a0-43f2774475cf None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:21.792116 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323de68d-9cd6-4af3-a6a0-43f2774475cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:21.793920 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1014/2023] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:55:21 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:55:21.799339 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f3b91-e5d3-43c9-aa0c-07cd20222815 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:21.810143 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f3b91-e5d3-43c9-aa0c-07cd20222815 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:21.815492 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-323de68d-9cd6-4af3-a6a0-43f2774475cf None None] MFA Rules not processed for user `3043eb81894f4525ac2d153da8bd3e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:21.816029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c856f-4255-41a8-b104-1c1076e42066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:21.816592 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c856f-4255-41a8-b104-1c1076e42066 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:21.816777 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c856f-4255-41a8-b104-1c1076e42066 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:21.817062 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c856f-4255-41a8-b104-1c1076e42066 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:21.817734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c856f-4255-41a8-b104-1c1076e42066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:21.819321 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c856f-4255-41a8-b104-1c1076e42066 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:21.819776 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-323de68d-9cd6-4af3-a6a0-43f2774475cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:21.838001 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1015/2024] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:55:21.843841 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c856f-4255-41a8-b104-1c1076e42066 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:21.858718 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c856f-4255-41a8-b104-1c1076e42066 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:21.865227 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf2955-7cfe-4295-b3d3-6ec7a8b961ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:21.868405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf2955-7cfe-4295-b3d3-6ec7a8b961ca admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:21.868405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf2955-7cfe-4295-b3d3-6ec7a8b961ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:21.868405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf2955-7cfe-4295-b3d3-6ec7a8b961ca admin admin] PATH_INFO: `/v3/projects/883e5c89758d4bbd8a4f90064a4f7fcd/users/a434fb6f41f349f3b26aa894de60ecf5/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:21.888069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf2955-7cfe-4295-b3d3-6ec7a8b961ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=883e5c89758d4bbd8a4f90064a4f7fcd, user_id=a434fb6f41f349f3b26aa894de60ecf5, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:21.889350 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1010/2025] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:55:21.892030 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf2955-7cfe-4295-b3d3-6ec7a8b961ca admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:21.912585 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:21.979398 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1016/2026] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:55:21 2022] PUT /identity/v3/projects/883e5c89758d4bbd8a4f90064a4f7fcd/users/a434fb6f41f349f3b26aa894de60ecf5/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:21.982996 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323de68d-9cd6-4af3-a6a0-43f2774475cf None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:21.994610 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323de68d-9cd6-4af3-a6a0-43f2774475cf None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:22.067950 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a1c0b-8bde-42d3-85b4-572d8bf33e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:22.068579 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a1c0b-8bde-42d3-85b4-572d8bf33e99 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:22.068860 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a1c0b-8bde-42d3-85b4-572d8bf33e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:22.069130 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a1c0b-8bde-42d3-85b4-572d8bf33e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:22.069785 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a1c0b-8bde-42d3-85b4-572d8bf33e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:22.071436 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a1c0b-8bde-42d3-85b4-572d8bf33e99 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:22.088599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1011/2027] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:55:22.090506 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf2955-7cfe-4295-b3d3-6ec7a8b961ca admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:22.104578 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf2955-7cfe-4295-b3d3-6ec7a8b961ca admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:22.114492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cbcec-db06-4caa-9d64-521299e5046a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:22.115573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cbcec-db06-4caa-9d64-521299e5046a admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:22.116295 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cbcec-db06-4caa-9d64-521299e5046a admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:22.116720 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cbcec-db06-4caa-9d64-521299e5046a admin admin] PATH_INFO: `/v3/projects/883e5c89758d4bbd8a4f90064a4f7fcd/users/a434fb6f41f349f3b26aa894de60ecf5/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:22.120240 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5cbcec-db06-4caa-9d64-521299e5046a admin admin] RBAC: Authorizing `identity:create_grant(project_id=883e5c89758d4bbd8a4f90064a4f7fcd, user_id=a434fb6f41f349f3b26aa894de60ecf5, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:22.123838 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5cbcec-db06-4caa-9d64-521299e5046a admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:22.155416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1017/2028] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:55:22 2022] PUT /identity/v3/projects/883e5c89758d4bbd8a4f90064a4f7fcd/users/a434fb6f41f349f3b26aa894de60ecf5/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:22.694963 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:23.238882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:24.907035 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:24.920431 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125dc8e-cd03-4864-899a-334daa978684 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:24.920721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125dc8e-cd03-4864-899a-334daa978684 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:24.921002 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125dc8e-cd03-4864-899a-334daa978684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:24.966617 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-c125dc8e-cd03-4864-899a-334daa978684 None None] MFA Rules not processed for user `a434fb6f41f349f3b26aa894de60ecf5`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:24.968167 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c125dc8e-cd03-4864-899a-334daa978684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:25.070592 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1012/2029] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:24 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:25.386578 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:25.425298 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cbcec-db06-4caa-9d64-521299e5046a admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:25.429255 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-8c5cbcec-db06-4caa-9d64-521299e5046a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:25.499152 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cbcec-db06-4caa-9d64-521299e5046a admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:25.499152 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4113db-0d18-4774-b7a4-ffd2a4b12998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:25.499152 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4113db-0d18-4774-b7a4-ffd2a4b12998 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:25.499152 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4113db-0d18-4774-b7a4-ffd2a4b12998 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:25.499610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4113db-0d18-4774-b7a4-ffd2a4b12998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:25.595217 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4113db-0d18-4774-b7a4-ffd2a4b12998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:25.595217 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4113db-0d18-4774-b7a4-ffd2a4b12998 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:25.605296 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1018/2030] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:55:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:55:26.312561 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:26.969355 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:27.275925 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:27.417132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:27.757939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:27.920629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:28.018964 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:28.131113 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:28.274109 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:28.309996 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:28.451739 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:28.479708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:28.662890 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:28.723241 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:28.891143 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:28.952347 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:29.039546 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:29.237828 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:29.260859 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:29.409340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:29.437758 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:29.529319 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:29.643068 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:31.751599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125dc8e-cd03-4864-899a-334daa978684 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:31.757250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c125dc8e-cd03-4864-899a-334daa978684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:31.773004 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125dc8e-cd03-4864-899a-334daa978684 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:31.775255 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d658f1-68ae-4d73-a136-686e14642b29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:31.776133 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d658f1-68ae-4d73-a136-686e14642b29 service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:31.776414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d658f1-68ae-4d73-a136-686e14642b29 service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:31.776697 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d658f1-68ae-4d73-a136-686e14642b29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:31.788144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d658f1-68ae-4d73-a136-686e14642b29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:31.789896 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d658f1-68ae-4d73-a136-686e14642b29 service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:31.809756 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1013/2031] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:55:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:55:33.527679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4113db-0d18-4774-b7a4-ffd2a4b12998 service cinder] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:33.529231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-8b4113db-0d18-4774-b7a4-ffd2a4b12998 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:33.587728 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:33.617232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4113db-0d18-4774-b7a4-ffd2a4b12998 service cinder] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:33.623269 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298a27b-b048-46f2-94e7-0f65e111ac51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:33.623994 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298a27b-b048-46f2-94e7-0f65e111ac51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:33.624359 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298a27b-b048-46f2-94e7-0f65e111ac51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:33.624702 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298a27b-b048-46f2-94e7-0f65e111ac51 admin admin] PATH_INFO: `/v3/users/3790823e78764315a63ec66ff8b0a22e` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:33.626051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298a27b-b048-46f2-94e7-0f65e111ac51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3790823e78764315a63ec66ff8b0a22e)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:33.628283 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298a27b-b048-46f2-94e7-0f65e111ac51 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:33.994568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-6298a27b-b048-46f2-94e7-0f65e111ac51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3790823e78764315a63ec66ff8b0a22e'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:34.108476 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-6298a27b-b048-46f2-94e7-0f65e111ac51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3790823e78764315a63ec66ff8b0a22e'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:34.119028 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-6298a27b-b048-46f2-94e7-0f65e111ac51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3790823e78764315a63ec66ff8b0a22e'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:34.151798 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-6298a27b-b048-46f2-94e7-0f65e111ac51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3790823e78764315a63ec66ff8b0a22e'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:34.151798 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-6298a27b-b048-46f2-94e7-0f65e111ac51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3790823e78764315a63ec66ff8b0a22e'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:34.159392 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1019/2032] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:55:33 2022] DELETE /identity/v3/users/3790823e78764315a63ec66ff8b0a22e => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:55:34.164486 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d875aa9-f652-48a5-8cae-44ca26118954 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:34.164987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d875aa9-f652-48a5-8cae-44ca26118954 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:34.165246 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d875aa9-f652-48a5-8cae-44ca26118954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:34.187558 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-0d875aa9-f652-48a5-8cae-44ca26118954 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:34.189097 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-0d875aa9-f652-48a5-8cae-44ca26118954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:34.260854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1014/2033] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:34.274583 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298a27b-b048-46f2-94e7-0f65e111ac51 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:34.280218 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-6298a27b-b048-46f2-94e7-0f65e111ac51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:34.395538 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298a27b-b048-46f2-94e7-0f65e111ac51 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:34.422837 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5600cb5-6807-4d5b-9c1b-b03c012a81cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:34.422837 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5600cb5-6807-4d5b-9c1b-b03c012a81cc service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:34.422837 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5600cb5-6807-4d5b-9c1b-b03c012a81cc service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:34.422837 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5600cb5-6807-4d5b-9c1b-b03c012a81cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:34.431520 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5600cb5-6807-4d5b-9c1b-b03c012a81cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:34.439700 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5600cb5-6807-4d5b-9c1b-b03c012a81cc service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:34.450666 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1020/2034] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:55:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:55:34.917921 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d875aa9-f652-48a5-8cae-44ca26118954 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:34.919520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-0d875aa9-f652-48a5-8cae-44ca26118954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:34.927862 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:34.934237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d875aa9-f652-48a5-8cae-44ca26118954 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:34.939329 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4471f5c-c224-4f45-8ed0-dfc070f51220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:34.940023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4471f5c-c224-4f45-8ed0-dfc070f51220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:34.942825 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4471f5c-c224-4f45-8ed0-dfc070f51220 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:34.942825 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4471f5c-c224-4f45-8ed0-dfc070f51220 admin admin] PATH_INFO: `/v3/projects/f95e3af141e9456883c9cb1c61f5a952` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:34.942825 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4471f5c-c224-4f45-8ed0-dfc070f51220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f95e3af141e9456883c9cb1c61f5a952)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:34.943872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4471f5c-c224-4f45-8ed0-dfc070f51220 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:35.084495 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-d4471f5c-c224-4f45-8ed0-dfc070f51220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f95e3af141e9456883c9cb1c61f5a952', 'request_id': 'req-d4471f5c-c224-4f45-8ed0-dfc070f51220'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:35.090951 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-d4471f5c-c224-4f45-8ed0-dfc070f51220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f95e3af141e9456883c9cb1c61f5a952', 'request_id': 'req-d4471f5c-c224-4f45-8ed0-dfc070f51220'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:35.097331 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-d4471f5c-c224-4f45-8ed0-dfc070f51220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f95e3af141e9456883c9cb1c61f5a952', 'request_id': 'req-d4471f5c-c224-4f45-8ed0-dfc070f51220'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:35.222540 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-d4471f5c-c224-4f45-8ed0-dfc070f51220 admin admin] The token cache is being invalidate because project f95e3af141e9456883c9cb1c61f5a952 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:55:35.223101 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-d4471f5c-c224-4f45-8ed0-dfc070f51220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:35.223660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-d4471f5c-c224-4f45-8ed0-dfc070f51220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:35.225444 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1015/2035] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:55:34 2022] DELETE /identity/v3/projects/f95e3af141e9456883c9cb1c61f5a952 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:35.229513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5600cb5-6807-4d5b-9c1b-b03c012a81cc service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:35.239513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5600cb5-6807-4d5b-9c1b-b03c012a81cc service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:35.304554 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b2fb5-4603-4d7d-8395-1e692bbfd902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:35.305188 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b2fb5-4603-4d7d-8395-1e692bbfd902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:35.305469 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b2fb5-4603-4d7d-8395-1e692bbfd902 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:35.305743 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b2fb5-4603-4d7d-8395-1e692bbfd902 admin admin] PATH_INFO: `/v3/users/67531341c60b4de191a07f63f20d871c` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:35.306866 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b2fb5-4603-4d7d-8395-1e692bbfd902 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67531341c60b4de191a07f63f20d871c)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:35.309323 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b2fb5-4603-4d7d-8395-1e692bbfd902 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:35.311987 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:35.529065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-2f5b2fb5-4603-4d7d-8395-1e692bbfd902 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67531341c60b4de191a07f63f20d871c'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:35.610745 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-2f5b2fb5-4603-4d7d-8395-1e692bbfd902 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67531341c60b4de191a07f63f20d871c'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:35.619274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-2f5b2fb5-4603-4d7d-8395-1e692bbfd902 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67531341c60b4de191a07f63f20d871c'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:35.632382 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-2f5b2fb5-4603-4d7d-8395-1e692bbfd902 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67531341c60b4de191a07f63f20d871c'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:35.633165 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-2f5b2fb5-4603-4d7d-8395-1e692bbfd902 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67531341c60b4de191a07f63f20d871c'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:35.639287 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1021/2036] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:55:35 2022] DELETE /identity/v3/users/67531341c60b4de191a07f63f20d871c => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:36.090587 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4471f5c-c224-4f45-8ed0-dfc070f51220 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:36.092142 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-d4471f5c-c224-4f45-8ed0-dfc070f51220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:36.107285 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4471f5c-c224-4f45-8ed0-dfc070f51220 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:36.166634 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bf589-65db-43fa-8ad2-1b5ebd0dac03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:36.167268 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bf589-65db-43fa-8ad2-1b5ebd0dac03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:36.167588 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bf589-65db-43fa-8ad2-1b5ebd0dac03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:36.167868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bf589-65db-43fa-8ad2-1b5ebd0dac03 admin admin] PATH_INFO: `/v3/projects/8acf3d7d33244b0da000a5803e574549` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:36.168999 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bf589-65db-43fa-8ad2-1b5ebd0dac03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8acf3d7d33244b0da000a5803e574549)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:36.170961 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bf589-65db-43fa-8ad2-1b5ebd0dac03 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:36.272543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-203bf589-65db-43fa-8ad2-1b5ebd0dac03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8acf3d7d33244b0da000a5803e574549', 'request_id': 'req-203bf589-65db-43fa-8ad2-1b5ebd0dac03'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:36.278083 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-203bf589-65db-43fa-8ad2-1b5ebd0dac03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8acf3d7d33244b0da000a5803e574549', 'request_id': 'req-203bf589-65db-43fa-8ad2-1b5ebd0dac03'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:36.284484 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-203bf589-65db-43fa-8ad2-1b5ebd0dac03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8acf3d7d33244b0da000a5803e574549', 'request_id': 'req-203bf589-65db-43fa-8ad2-1b5ebd0dac03'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:36.388263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-203bf589-65db-43fa-8ad2-1b5ebd0dac03 admin admin] The token cache is being invalidate because project 8acf3d7d33244b0da000a5803e574549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:55:36.390816 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-203bf589-65db-43fa-8ad2-1b5ebd0dac03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:36.390816 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-203bf589-65db-43fa-8ad2-1b5ebd0dac03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:36.393978 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1016/2037] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:55:36 2022] DELETE /identity/v3/projects/8acf3d7d33244b0da000a5803e574549 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:36.394936 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b2fb5-4603-4d7d-8395-1e692bbfd902 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:36.398057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-2f5b2fb5-4603-4d7d-8395-1e692bbfd902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:36.411718 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b2fb5-4603-4d7d-8395-1e692bbfd902 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:36.471861 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04659f74-ee81-4875-b54c-1f2a7ba9cc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:36.472494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04659f74-ee81-4875-b54c-1f2a7ba9cc5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:36.473040 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04659f74-ee81-4875-b54c-1f2a7ba9cc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:36.473161 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04659f74-ee81-4875-b54c-1f2a7ba9cc5d admin admin] PATH_INFO: `/v3/users/936f031a2bdb414abf229d462f223075` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:36.474457 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04659f74-ee81-4875-b54c-1f2a7ba9cc5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=936f031a2bdb414abf229d462f223075)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:36.476427 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04659f74-ee81-4875-b54c-1f2a7ba9cc5d admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:36.653334 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-04659f74-ee81-4875-b54c-1f2a7ba9cc5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '936f031a2bdb414abf229d462f223075'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:36.739773 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-04659f74-ee81-4875-b54c-1f2a7ba9cc5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '936f031a2bdb414abf229d462f223075'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:36.749077 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-04659f74-ee81-4875-b54c-1f2a7ba9cc5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '936f031a2bdb414abf229d462f223075'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:36.763229 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-04659f74-ee81-4875-b54c-1f2a7ba9cc5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '936f031a2bdb414abf229d462f223075'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:36.763995 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-04659f74-ee81-4875-b54c-1f2a7ba9cc5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '936f031a2bdb414abf229d462f223075'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:36.766244 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:36.770867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1022/2038] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:55:36 2022] DELETE /identity/v3/users/936f031a2bdb414abf229d462f223075 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:55:37.284421 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bf589-65db-43fa-8ad2-1b5ebd0dac03 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:37.285884 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-203bf589-65db-43fa-8ad2-1b5ebd0dac03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:37.302974 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bf589-65db-43fa-8ad2-1b5ebd0dac03 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:37.317173 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:37.363903 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c05c3f-a843-447b-8490-779b690a00ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:37.364543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c05c3f-a843-447b-8490-779b690a00ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:37.364822 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c05c3f-a843-447b-8490-779b690a00ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:37.365095 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c05c3f-a843-447b-8490-779b690a00ac admin admin] PATH_INFO: `/v3/projects/d5e7a8c1173840d4a66690ac6c230408` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:37.366210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c05c3f-a843-447b-8490-779b690a00ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5e7a8c1173840d4a66690ac6c230408)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:37.368218 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c05c3f-a843-447b-8490-779b690a00ac admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:37.485641 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f1c05c3f-a843-447b-8490-779b690a00ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5e7a8c1173840d4a66690ac6c230408', 'request_id': 'req-f1c05c3f-a843-447b-8490-779b690a00ac'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:37.491825 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f1c05c3f-a843-447b-8490-779b690a00ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5e7a8c1173840d4a66690ac6c230408', 'request_id': 'req-f1c05c3f-a843-447b-8490-779b690a00ac'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:37.499292 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f1c05c3f-a843-447b-8490-779b690a00ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5e7a8c1173840d4a66690ac6c230408', 'request_id': 'req-f1c05c3f-a843-447b-8490-779b690a00ac'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:37.593006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f1c05c3f-a843-447b-8490-779b690a00ac admin admin] The token cache is being invalidate because project d5e7a8c1173840d4a66690ac6c230408 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:55:37.593302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f1c05c3f-a843-447b-8490-779b690a00ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:37.594145 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f1c05c3f-a843-447b-8490-779b690a00ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:37.595665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1017/2039] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:55:37 2022] DELETE /identity/v3/projects/d5e7a8c1173840d4a66690ac6c230408 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:37.601565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ca7df-1fa7-4161-80a2-1a6f7a138370 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:37.602049 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ca7df-1fa7-4161-80a2-1a6f7a138370 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:37.602136 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ca7df-1fa7-4161-80a2-1a6f7a138370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:37.623158 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-8b8ca7df-1fa7-4161-80a2-1a6f7a138370 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:37.624404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-8b8ca7df-1fa7-4161-80a2-1a6f7a138370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:37.691631 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1023/2040] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:37.701391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8f854-60fd-4b34-bef3-c518740ba72c None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:37.703953 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8f854-60fd-4b34-bef3-c518740ba72c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:37.703953 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8f854-60fd-4b34-bef3-c518740ba72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:37.724762 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-acd8f854-60fd-4b34-bef3-c518740ba72c None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:37.725918 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-acd8f854-60fd-4b34-bef3-c518740ba72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:37.734946 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1018/2041] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:37.739414 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ca7df-1fa7-4161-80a2-1a6f7a138370 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:37.749172 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ca7df-1fa7-4161-80a2-1a6f7a138370 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:37.753818 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd215704-eb62-4cd3-b7ec-30728b27f2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:37.754433 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd215704-eb62-4cd3-b7ec-30728b27f2af admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:37.754715 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd215704-eb62-4cd3-b7ec-30728b27f2af admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:37.754986 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd215704-eb62-4cd3-b7ec-30728b27f2af admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:37.755671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd215704-eb62-4cd3-b7ec-30728b27f2af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:55:37.755973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd215704-eb62-4cd3-b7ec-30728b27f2af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:37.757593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd215704-eb62-4cd3-b7ec-30728b27f2af admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:37.770303 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1024/2042] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:55:37.774682 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8f854-60fd-4b34-bef3-c518740ba72c None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:37.785216 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8f854-60fd-4b34-bef3-c518740ba72c None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:37.791015 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443b963-3cdd-4a93-9ff8-4a586f4fa167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:37.791654 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443b963-3cdd-4a93-9ff8-4a586f4fa167 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:37.791938 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443b963-3cdd-4a93-9ff8-4a586f4fa167 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:37.792214 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443b963-3cdd-4a93-9ff8-4a586f4fa167 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:37.796161 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443b963-3cdd-4a93-9ff8-4a586f4fa167 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:37.796161 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443b963-3cdd-4a93-9ff8-4a586f4fa167 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:37.920715 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1019/2043] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:55:37 2022] POST /identity/v3/projects => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:55:37.925581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd215704-eb62-4cd3-b7ec-30728b27f2af admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:37.937831 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd215704-eb62-4cd3-b7ec-30728b27f2af admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:38.007393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0aa32e-c5fb-49ef-9656-d6b1a4442969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:38.008059 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aa32e-c5fb-49ef-9656-d6b1a4442969 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:38.008335 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aa32e-c5fb-49ef-9656-d6b1a4442969 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:38.008610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aa32e-c5fb-49ef-9656-d6b1a4442969 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:38.009260 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0aa32e-c5fb-49ef-9656-d6b1a4442969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:38.011192 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0aa32e-c5fb-49ef-9656-d6b1a4442969 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:38.171641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1025/2044] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:55:37 2022] POST /identity/v3/users => generated 284 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:55:38.176359 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443b963-3cdd-4a93-9ff8-4a586f4fa167 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:38.187032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443b963-3cdd-4a93-9ff8-4a586f4fa167 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:38.191651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de89b82-2451-4feb-ac37-372154012e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:38.192258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de89b82-2451-4feb-ac37-372154012e07 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:38.192538 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de89b82-2451-4feb-ac37-372154012e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:38.192815 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de89b82-2451-4feb-ac37-372154012e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:38.193458 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de89b82-2451-4feb-ac37-372154012e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:38.195102 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de89b82-2451-4feb-ac37-372154012e07 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:38.205889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1020/2045] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:55:38.209983 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0aa32e-c5fb-49ef-9656-d6b1a4442969 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:38.221113 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0aa32e-c5fb-49ef-9656-d6b1a4442969 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:38.226125 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e3d79-e36c-4572-9941-39b872c1706d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:38.226731 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e3d79-e36c-4572-9941-39b872c1706d admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:38.227011 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e3d79-e36c-4572-9941-39b872c1706d admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:38.227292 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e3d79-e36c-4572-9941-39b872c1706d admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:38.227994 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e3d79-e36c-4572-9941-39b872c1706d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:38.230249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e3d79-e36c-4572-9941-39b872c1706d admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:38.243738 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1026/2046] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:55:38.248053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de89b82-2451-4feb-ac37-372154012e07 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:38.258422 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de89b82-2451-4feb-ac37-372154012e07 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:38.262995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65f6fb-977f-414b-b3f0-990691ab6a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:38.263686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65f6fb-977f-414b-b3f0-990691ab6a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:38.263967 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65f6fb-977f-414b-b3f0-990691ab6a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:38.264244 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65f6fb-977f-414b-b3f0-990691ab6a45 admin admin] PATH_INFO: `/v3/projects/219cd6bbbbf942debec88577d7f18646/users/32e93bb245c6446195bc35569a90d9b2/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:38.280025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65f6fb-977f-414b-b3f0-990691ab6a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=219cd6bbbbf942debec88577d7f18646, user_id=32e93bb245c6446195bc35569a90d9b2, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:38.282700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65f6fb-977f-414b-b3f0-990691ab6a45 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:38.381027 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1021/2047] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:55:38 2022] PUT /identity/v3/projects/219cd6bbbbf942debec88577d7f18646/users/32e93bb245c6446195bc35569a90d9b2/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:38.391944 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eeacd9-b742-432b-8aef-b99787c91324 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:38.392519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eeacd9-b742-432b-8aef-b99787c91324 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:38.392519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eeacd9-b742-432b-8aef-b99787c91324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:38.424292 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-27eeacd9-b742-432b-8aef-b99787c91324 None None] MFA Rules not processed for user `32e93bb245c6446195bc35569a90d9b2`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:38.425629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-27eeacd9-b742-432b-8aef-b99787c91324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:38.492689 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:38.502911 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1027/2048] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:55:38.524309 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65f6fb-977f-414b-b3f0-990691ab6a45 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:38.524468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-9e65f6fb-977f-414b-b3f0-990691ab6a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:38.597025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:38.649133 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65f6fb-977f-414b-b3f0-990691ab6a45 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:38.653677 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdec13a-b191-4272-96c9-e2faff925c8c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc11fe25135d4bf1b1a06b8619e4a2e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:38.654298 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdec13a-b191-4272-96c9-e2faff925c8c service glance] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:38.654688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdec13a-b191-4272-96c9-e2faff925c8c service glance] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:38.654964 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdec13a-b191-4272-96c9-e2faff925c8c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:38.663744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdec13a-b191-4272-96c9-e2faff925c8c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:38.665188 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdec13a-b191-4272-96c9-e2faff925c8c service glance] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:38.676150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1022/2049] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:55:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:55:48.725360 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:49.370513 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=16 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:52.488094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eeacd9-b742-432b-8aef-b99787c91324 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:52.489625 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-27eeacd9-b742-432b-8aef-b99787c91324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:52.554891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eeacd9-b742-432b-8aef-b99787c91324 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:52.559389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeafe46-bc55-48a9-bf67-d4a2a75e0252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:52.560012 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeafe46-bc55-48a9-bf67-d4a2a75e0252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:52.560291 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeafe46-bc55-48a9-bf67-d4a2a75e0252 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:52.560564 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeafe46-bc55-48a9-bf67-d4a2a75e0252 admin admin] PATH_INFO: `/v3/users/eeb6e1ba61124ec89df43363d6ac5a60` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:52.561706 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeafe46-bc55-48a9-bf67-d4a2a75e0252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeb6e1ba61124ec89df43363d6ac5a60)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:52.563671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeafe46-bc55-48a9-bf67-d4a2a75e0252 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:52.806133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-adeafe46-bc55-48a9-bf67-d4a2a75e0252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeb6e1ba61124ec89df43363d6ac5a60'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:52.870127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-adeafe46-bc55-48a9-bf67-d4a2a75e0252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeb6e1ba61124ec89df43363d6ac5a60'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:52.878336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-adeafe46-bc55-48a9-bf67-d4a2a75e0252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeb6e1ba61124ec89df43363d6ac5a60'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:52.890932 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-adeafe46-bc55-48a9-bf67-d4a2a75e0252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeb6e1ba61124ec89df43363d6ac5a60'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:52.891683 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-adeafe46-bc55-48a9-bf67-d4a2a75e0252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeb6e1ba61124ec89df43363d6ac5a60'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:52.897876 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1028/2050] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:55:52 2022] DELETE /identity/v3/users/eeb6e1ba61124ec89df43363d6ac5a60 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:52.902377 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76671a9-832c-436e-9d89-9cff355214ba None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:52.902803 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76671a9-832c-436e-9d89-9cff355214ba None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:52.902935 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76671a9-832c-436e-9d89-9cff355214ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:52.924155 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeafe46-bc55-48a9-bf67-d4a2a75e0252 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:52.927395 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-adeafe46-bc55-48a9-bf67-d4a2a75e0252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:52.927541 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-d76671a9-832c-436e-9d89-9cff355214ba None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:52.927541 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-d76671a9-832c-436e-9d89-9cff355214ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:52.992850 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1023/2051] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:53.001449 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeafe46-bc55-48a9-bf67-d4a2a75e0252 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:53.006467 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df55dc4-d643-44f3-8066-e31c111c2f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:53.007521 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df55dc4-d643-44f3-8066-e31c111c2f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:53.007811 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df55dc4-d643-44f3-8066-e31c111c2f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:53.008087 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df55dc4-d643-44f3-8066-e31c111c2f65 admin admin] PATH_INFO: `/v3/users/06a3d99dfb3241cfa3c0b1fe975a9630` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:53.008490 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76671a9-832c-436e-9d89-9cff355214ba None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:53.009291 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df55dc4-d643-44f3-8066-e31c111c2f65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06a3d99dfb3241cfa3c0b1fe975a9630)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:53.010312 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-d76671a9-832c-436e-9d89-9cff355214ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:53.011265 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df55dc4-d643-44f3-8066-e31c111c2f65 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:53.036561 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:53.072547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76671a9-832c-436e-9d89-9cff355214ba None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:53.076164 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007eb1b-2899-4309-8663-e36d6e3a620a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:53.076892 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007eb1b-2899-4309-8663-e36d6e3a620a service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:53.077180 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007eb1b-2899-4309-8663-e36d6e3a620a service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:53.077457 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007eb1b-2899-4309-8663-e36d6e3a620a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:53.086657 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007eb1b-2899-4309-8663-e36d6e3a620a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:53.088226 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007eb1b-2899-4309-8663-e36d6e3a620a service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:53.099210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1024/2052] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:55:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:55:53.259980 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-1df55dc4-d643-44f3-8066-e31c111c2f65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06a3d99dfb3241cfa3c0b1fe975a9630'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:53.367860 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-1df55dc4-d643-44f3-8066-e31c111c2f65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06a3d99dfb3241cfa3c0b1fe975a9630'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:53.378716 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-1df55dc4-d643-44f3-8066-e31c111c2f65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06a3d99dfb3241cfa3c0b1fe975a9630'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:53.401934 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-1df55dc4-d643-44f3-8066-e31c111c2f65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06a3d99dfb3241cfa3c0b1fe975a9630'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:53.403293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-1df55dc4-d643-44f3-8066-e31c111c2f65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06a3d99dfb3241cfa3c0b1fe975a9630'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:53.410986 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1029/2053] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:55:52 2022] DELETE /identity/v3/users/06a3d99dfb3241cfa3c0b1fe975a9630 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:55:53.415769 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fc984-3d52-480d-9f15-ff7a81eae9a7 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:53.418547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fc984-3d52-480d-9f15-ff7a81eae9a7 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:53.418547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fc984-3d52-480d-9f15-ff7a81eae9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:53.445534 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-fb5fc984-3d52-480d-9f15-ff7a81eae9a7 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:53.447226 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-fb5fc984-3d52-480d-9f15-ff7a81eae9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:53.553926 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1025/2054] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:53.576487 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df55dc4-d643-44f3-8066-e31c111c2f65 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:53.578704 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-1df55dc4-d643-44f3-8066-e31c111c2f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:53.594790 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5fc984-3d52-480d-9f15-ff7a81eae9a7 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:53.600351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-fb5fc984-3d52-480d-9f15-ff7a81eae9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:53.644028 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5fc984-3d52-480d-9f15-ff7a81eae9a7 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:53.650066 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81a737-78ca-4953-8520-afbde8670269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:53.650715 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81a737-78ca-4953-8520-afbde8670269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:53.651088 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81a737-78ca-4953-8520-afbde8670269 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:53.651267 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81a737-78ca-4953-8520-afbde8670269 admin admin] PATH_INFO: `/v3/projects/e4e4f0384b384f1cab9d269eb98f6a1e` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:53.653916 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81a737-78ca-4953-8520-afbde8670269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4e4f0384b384f1cab9d269eb98f6a1e)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:53.656089 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81a737-78ca-4953-8520-afbde8670269 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:53.676014 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df55dc4-d643-44f3-8066-e31c111c2f65 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:53.681282 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449c10e-8d5e-4a81-8898-c1bad67825c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:53.682034 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449c10e-8d5e-4a81-8898-c1bad67825c2 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:53.682271 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449c10e-8d5e-4a81-8898-c1bad67825c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:53.682595 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449c10e-8d5e-4a81-8898-c1bad67825c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:53.695807 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449c10e-8d5e-4a81-8898-c1bad67825c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:53.697955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449c10e-8d5e-4a81-8898-c1bad67825c2 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:53.714029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1030/2055] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:55:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:55:53.791861 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:53.799830 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-dd81a737-78ca-4953-8520-afbde8670269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4e4f0384b384f1cab9d269eb98f6a1e', 'request_id': 'req-dd81a737-78ca-4953-8520-afbde8670269'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:53.805846 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-dd81a737-78ca-4953-8520-afbde8670269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4e4f0384b384f1cab9d269eb98f6a1e', 'request_id': 'req-dd81a737-78ca-4953-8520-afbde8670269'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:53.812832 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-dd81a737-78ca-4953-8520-afbde8670269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4e4f0384b384f1cab9d269eb98f6a1e', 'request_id': 'req-dd81a737-78ca-4953-8520-afbde8670269'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:53.948593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-dd81a737-78ca-4953-8520-afbde8670269 admin admin] The token cache is being invalidate because project e4e4f0384b384f1cab9d269eb98f6a1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:55:53.949920 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-dd81a737-78ca-4953-8520-afbde8670269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:53.952111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-dd81a737-78ca-4953-8520-afbde8670269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:53.952111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1026/2056] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:55:53 2022] DELETE /identity/v3/projects/e4e4f0384b384f1cab9d269eb98f6a1e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:53.956193 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449c10e-8d5e-4a81-8898-c1bad67825c2 service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:53.966398 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449c10e-8d5e-4a81-8898-c1bad67825c2 service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:54.061221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12bcc1-4bc5-4753-aee8-6066b0281d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:54.061937 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12bcc1-4bc5-4753-aee8-6066b0281d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:54.062234 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12bcc1-4bc5-4753-aee8-6066b0281d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:54.062509 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12bcc1-4bc5-4753-aee8-6066b0281d02 admin admin] PATH_INFO: `/v3/users/b60e416e2a5945538e4bbfa9d21c2816` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:54.063885 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12bcc1-4bc5-4753-aee8-6066b0281d02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b60e416e2a5945538e4bbfa9d21c2816)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:54.068393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12bcc1-4bc5-4753-aee8-6066b0281d02 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:54.314158 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:54.317167 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-de12bcc1-4bc5-4753-aee8-6066b0281d02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b60e416e2a5945538e4bbfa9d21c2816'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:54.444450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-de12bcc1-4bc5-4753-aee8-6066b0281d02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b60e416e2a5945538e4bbfa9d21c2816'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:54.453194 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-de12bcc1-4bc5-4753-aee8-6066b0281d02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b60e416e2a5945538e4bbfa9d21c2816'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:54.466161 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-de12bcc1-4bc5-4753-aee8-6066b0281d02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b60e416e2a5945538e4bbfa9d21c2816'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:54.466894 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-de12bcc1-4bc5-4753-aee8-6066b0281d02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b60e416e2a5945538e4bbfa9d21c2816'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:54.473396 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1031/2057] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:55:53 2022] DELETE /identity/v3/users/b60e416e2a5945538e4bbfa9d21c2816 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:54.513323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81a737-78ca-4953-8520-afbde8670269 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:54.514878 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-dd81a737-78ca-4953-8520-afbde8670269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:54.529165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81a737-78ca-4953-8520-afbde8670269 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:54.599964 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9a559-d5dd-4061-bb07-a6914027a4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:54.600619 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9a559-d5dd-4061-bb07-a6914027a4e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:54.600910 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9a559-d5dd-4061-bb07-a6914027a4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:54.601188 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9a559-d5dd-4061-bb07-a6914027a4e7 admin admin] PATH_INFO: `/v3/projects/4f615e56dc6d48df8ce7835ee867e500` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:54.602412 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9a559-d5dd-4061-bb07-a6914027a4e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f615e56dc6d48df8ce7835ee867e500)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:54.604423 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9a559-d5dd-4061-bb07-a6914027a4e7 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:54.791741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-16a9a559-d5dd-4061-bb07-a6914027a4e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f615e56dc6d48df8ce7835ee867e500', 'request_id': 'req-16a9a559-d5dd-4061-bb07-a6914027a4e7'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:54.812877 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-16a9a559-d5dd-4061-bb07-a6914027a4e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f615e56dc6d48df8ce7835ee867e500', 'request_id': 'req-16a9a559-d5dd-4061-bb07-a6914027a4e7'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:54.831106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-16a9a559-d5dd-4061-bb07-a6914027a4e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f615e56dc6d48df8ce7835ee867e500', 'request_id': 'req-16a9a559-d5dd-4061-bb07-a6914027a4e7'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:54.983083 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-16a9a559-d5dd-4061-bb07-a6914027a4e7 admin admin] The token cache is being invalidate because project 4f615e56dc6d48df8ce7835ee867e500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:55:54.984205 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-16a9a559-d5dd-4061-bb07-a6914027a4e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:54.985847 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-16a9a559-d5dd-4061-bb07-a6914027a4e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:54.988459 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1027/2058] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:55:54 2022] DELETE /identity/v3/projects/4f615e56dc6d48df8ce7835ee867e500 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:54.992598 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12bcc1-4bc5-4753-aee8-6066b0281d02 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:54.994261 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-de12bcc1-4bc5-4753-aee8-6066b0281d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:55.011382 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12bcc1-4bc5-4753-aee8-6066b0281d02 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:55.106118 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36aef4a-3ff2-4d8d-ad06-0fad387f294e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:55.106973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36aef4a-3ff2-4d8d-ad06-0fad387f294e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:55.108893 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36aef4a-3ff2-4d8d-ad06-0fad387f294e admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:55.108893 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36aef4a-3ff2-4d8d-ad06-0fad387f294e admin admin] PATH_INFO: `/v3/users/d80b8c0622704f199185acf49ffad8e8` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:55.111079 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36aef4a-3ff2-4d8d-ad06-0fad387f294e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d80b8c0622704f199185acf49ffad8e8)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:55.113704 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36aef4a-3ff2-4d8d-ad06-0fad387f294e admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:55.334779 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9a559-d5dd-4061-bb07-a6914027a4e7 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:55.338011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-16a9a559-d5dd-4061-bb07-a6914027a4e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:55.353006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9a559-d5dd-4061-bb07-a6914027a4e7 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:55.361681 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30a73a-15ff-45f1-b5b2-54f9d574c14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:55.362344 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30a73a-15ff-45f1-b5b2-54f9d574c14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:55.362626 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30a73a-15ff-45f1-b5b2-54f9d574c14d admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:55.362904 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30a73a-15ff-45f1-b5b2-54f9d574c14d admin admin] PATH_INFO: `/v3/projects/7a4afb03ec084139b1555ff9f30d95ae` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:55.365397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30a73a-15ff-45f1-b5b2-54f9d574c14d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a4afb03ec084139b1555ff9f30d95ae)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:55.367452 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30a73a-15ff-45f1-b5b2-54f9d574c14d admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:55.373976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-c36aef4a-3ff2-4d8d-ad06-0fad387f294e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd80b8c0622704f199185acf49ffad8e8'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:55.438003 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-c36aef4a-3ff2-4d8d-ad06-0fad387f294e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd80b8c0622704f199185acf49ffad8e8'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:55.446120 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-c36aef4a-3ff2-4d8d-ad06-0fad387f294e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd80b8c0622704f199185acf49ffad8e8'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:55.458951 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-c36aef4a-3ff2-4d8d-ad06-0fad387f294e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd80b8c0622704f199185acf49ffad8e8'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:55.459761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-c36aef4a-3ff2-4d8d-ad06-0fad387f294e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd80b8c0622704f199185acf49ffad8e8'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:55.466954 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1032/2059] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:55:54 2022] DELETE /identity/v3/users/d80b8c0622704f199185acf49ffad8e8 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:55.509293 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-af30a73a-15ff-45f1-b5b2-54f9d574c14d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a4afb03ec084139b1555ff9f30d95ae', 'request_id': 'req-af30a73a-15ff-45f1-b5b2-54f9d574c14d'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:55.512142 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:55.516967 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-af30a73a-15ff-45f1-b5b2-54f9d574c14d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a4afb03ec084139b1555ff9f30d95ae', 'request_id': 'req-af30a73a-15ff-45f1-b5b2-54f9d574c14d'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:55.524630 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-af30a73a-15ff-45f1-b5b2-54f9d574c14d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a4afb03ec084139b1555ff9f30d95ae', 'request_id': 'req-af30a73a-15ff-45f1-b5b2-54f9d574c14d'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:55.631308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-af30a73a-15ff-45f1-b5b2-54f9d574c14d admin admin] The token cache is being invalidate because project 7a4afb03ec084139b1555ff9f30d95ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:55:55.631691 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-af30a73a-15ff-45f1-b5b2-54f9d574c14d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:55.632282 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-af30a73a-15ff-45f1-b5b2-54f9d574c14d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:55.633788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1028/2060] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:55:55 2022] DELETE /identity/v3/projects/7a4afb03ec084139b1555ff9f30d95ae => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:55.638815 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04641c-15c2-4db7-ae3f-2dd61044fc89 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:55.639121 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04641c-15c2-4db7-ae3f-2dd61044fc89 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:55.639439 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04641c-15c2-4db7-ae3f-2dd61044fc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:55.662410 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-de04641c-15c2-4db7-ae3f-2dd61044fc89 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:55.663764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-de04641c-15c2-4db7-ae3f-2dd61044fc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:55.726109 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:55.758553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1033/2061] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:55.766711 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556c22a-5edc-4885-9901-1ca80905cee7 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:55.766995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556c22a-5edc-4885-9901-1ca80905cee7 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:55.767345 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556c22a-5edc-4885-9901-1ca80905cee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:55.802799 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-5556c22a-5edc-4885-9901-1ca80905cee7 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:55.804081 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-5556c22a-5edc-4885-9901-1ca80905cee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:55.818871 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1029/2062] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:55.823391 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04641c-15c2-4db7-ae3f-2dd61044fc89 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:55.834017 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04641c-15c2-4db7-ae3f-2dd61044fc89 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:55.864771 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda992c4-8b39-44b6-9d8e-f12b71973546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:55.864975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda992c4-8b39-44b6-9d8e-f12b71973546 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:55.865382 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda992c4-8b39-44b6-9d8e-f12b71973546 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:55.867442 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda992c4-8b39-44b6-9d8e-f12b71973546 admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:55.868310 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda992c4-8b39-44b6-9d8e-f12b71973546 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:55:55.868979 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda992c4-8b39-44b6-9d8e-f12b71973546 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:55.875459 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda992c4-8b39-44b6-9d8e-f12b71973546 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:55.893109 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1034/2063] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:55:55.893258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556c22a-5edc-4885-9901-1ca80905cee7 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:55.905854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556c22a-5edc-4885-9901-1ca80905cee7 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:55.911230 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0ccf8-6f98-40de-8425-3f238480ce9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:55.912447 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0ccf8-6f98-40de-8425-3f238480ce9c admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:55.912912 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0ccf8-6f98-40de-8425-3f238480ce9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:55.913262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0ccf8-6f98-40de-8425-3f238480ce9c admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:55.913946 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0ccf8-6f98-40de-8425-3f238480ce9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:55.916295 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0ccf8-6f98-40de-8425-3f238480ce9c admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:55.977073 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda992c4-8b39-44b6-9d8e-f12b71973546 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:55.983474 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-bda992c4-8b39-44b6-9d8e-f12b71973546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:56.013800 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda992c4-8b39-44b6-9d8e-f12b71973546 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:56.021294 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0f294-758f-4120-9ed4-2d56ec1b44de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:56.021294 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0f294-758f-4120-9ed4-2d56ec1b44de admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:56.021294 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0f294-758f-4120-9ed4-2d56ec1b44de admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:56.021294 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0f294-758f-4120-9ed4-2d56ec1b44de admin admin] PATH_INFO: `/v3/projects/043b487d8eaf4b1cb5177c20467e9b55` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:56.023289 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0f294-758f-4120-9ed4-2d56ec1b44de admin admin] RBAC: Authorizing `identity:delete_project(project_id=043b487d8eaf4b1cb5177c20467e9b55)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:56.029543 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0f294-758f-4120-9ed4-2d56ec1b44de admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:56.059787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1030/2064] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:55:55 2022] POST /identity/v3/projects => generated 373 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:55:56.063636 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0ccf8-6f98-40de-8425-3f238480ce9c admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:56.200724 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0ccf8-6f98-40de-8425-3f238480ce9c admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:56.205210 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-d2b0f294-758f-4120-9ed4-2d56ec1b44de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '043b487d8eaf4b1cb5177c20467e9b55', 'request_id': 'req-d2b0f294-758f-4120-9ed4-2d56ec1b44de'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:56.212267 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-d2b0f294-758f-4120-9ed4-2d56ec1b44de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '043b487d8eaf4b1cb5177c20467e9b55', 'request_id': 'req-d2b0f294-758f-4120-9ed4-2d56ec1b44de'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:56.272128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2950649-5f50-47bb-9686-d65302ef0702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:56.272738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2950649-5f50-47bb-9686-d65302ef0702 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:56.273015 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2950649-5f50-47bb-9686-d65302ef0702 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:56.273283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2950649-5f50-47bb-9686-d65302ef0702 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:56.273905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2950649-5f50-47bb-9686-d65302ef0702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:56.275984 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2950649-5f50-47bb-9686-d65302ef0702 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:56.282259 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-d2b0f294-758f-4120-9ed4-2d56ec1b44de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '043b487d8eaf4b1cb5177c20467e9b55', 'request_id': 'req-d2b0f294-758f-4120-9ed4-2d56ec1b44de'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:56.296024 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-d2b0f294-758f-4120-9ed4-2d56ec1b44de admin admin] The token cache is being invalidate because project 043b487d8eaf4b1cb5177c20467e9b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:55:56.296315 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-d2b0f294-758f-4120-9ed4-2d56ec1b44de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:56.296987 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-d2b0f294-758f-4120-9ed4-2d56ec1b44de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:56.298562 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1035/2065] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:55:55 2022] DELETE /identity/v3/projects/043b487d8eaf4b1cb5177c20467e9b55 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:56.303573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685ce9f-dd6b-4e71-90f3-f32b7bbaf3be None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:56.304032 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685ce9f-dd6b-4e71-90f3-f32b7bbaf3be None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:56.304317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685ce9f-dd6b-4e71-90f3-f32b7bbaf3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:56.325046 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-b685ce9f-dd6b-4e71-90f3-f32b7bbaf3be None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:56.326276 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b685ce9f-dd6b-4e71-90f3-f32b7bbaf3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:56.334048 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1036/2066] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:55:56.342703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c93cff-8c2d-47ef-8575-a18563cb18a3 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:56.343753 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c93cff-8c2d-47ef-8575-a18563cb18a3 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:56.343753 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c93cff-8c2d-47ef-8575-a18563cb18a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:56.363633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-93c93cff-8c2d-47ef-8575-a18563cb18a3 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:56.365107 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-93c93cff-8c2d-47ef-8575-a18563cb18a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:56.373564 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1037/2067] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:55:56.377885 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c93cff-8c2d-47ef-8575-a18563cb18a3 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:56.387299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c93cff-8c2d-47ef-8575-a18563cb18a3 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:56.392163 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da2673-4ac5-49a2-a450-1d0e46393376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:56.392840 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da2673-4ac5-49a2-a450-1d0e46393376 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:56.393072 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da2673-4ac5-49a2-a450-1d0e46393376 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:56.393345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da2673-4ac5-49a2-a450-1d0e46393376 admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:56.394001 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da2673-4ac5-49a2-a450-1d0e46393376 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:55:56.394361 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da2673-4ac5-49a2-a450-1d0e46393376 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:56.396024 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da2673-4ac5-49a2-a450-1d0e46393376 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:56.397446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1031/2068] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:55:56 2022] POST /identity/v3/users => generated 287 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:55:56.400417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2950649-5f50-47bb-9686-d65302ef0702 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:56.402665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-e2950649-5f50-47bb-9686-d65302ef0702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:56.409798 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1038/2069] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:55:56.414566 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da2673-4ac5-49a2-a450-1d0e46393376 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:56.415694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2950649-5f50-47bb-9686-d65302ef0702 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:56.421741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ddbb3-4c61-4d3b-88cb-881be44d0f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:56.422470 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ddbb3-4c61-4d3b-88cb-881be44d0f59 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:56.422820 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ddbb3-4c61-4d3b-88cb-881be44d0f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:56.423023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ddbb3-4c61-4d3b-88cb-881be44d0f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:56.423746 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ddbb3-4c61-4d3b-88cb-881be44d0f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:56.427328 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da2673-4ac5-49a2-a450-1d0e46393376 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:56.433419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ff2e3-8ba4-463e-a94a-610e88b1d71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:56.434035 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ff2e3-8ba4-463e-a94a-610e88b1d71a admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:56.434141 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ddbb3-4c61-4d3b-88cb-881be44d0f59 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:56.434315 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ff2e3-8ba4-463e-a94a-610e88b1d71a admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:56.434590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ff2e3-8ba4-463e-a94a-610e88b1d71a admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:56.435343 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ff2e3-8ba4-463e-a94a-610e88b1d71a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:56.438142 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ff2e3-8ba4-463e-a94a-610e88b1d71a admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:56.446215 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1032/2070] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:55:56.450518 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ddbb3-4c61-4d3b-88cb-881be44d0f59 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:56.461590 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ddbb3-4c61-4d3b-88cb-881be44d0f59 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:56.467187 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7355d21-9f1e-462b-ba84-d581802d6630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:56.467784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7355d21-9f1e-462b-ba84-d581802d6630 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:56.468062 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7355d21-9f1e-462b-ba84-d581802d6630 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:56.468390 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7355d21-9f1e-462b-ba84-d581802d6630 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:56.469038 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7355d21-9f1e-462b-ba84-d581802d6630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:56.470709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7355d21-9f1e-462b-ba84-d581802d6630 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:56.485313 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1033/2071] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 13:55:56.490096 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7355d21-9f1e-462b-ba84-d581802d6630 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:56.502629 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7355d21-9f1e-462b-ba84-d581802d6630 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:56.507438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ce217-8188-4a55-9d82-41945ad79a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:56.508105 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ce217-8188-4a55-9d82-41945ad79a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:56.508388 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ce217-8188-4a55-9d82-41945ad79a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:56.508662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ce217-8188-4a55-9d82-41945ad79a81 admin admin] PATH_INFO: `/v3/projects/b2568bd642ad497d839a7901b50690fa/users/5c70e1f9b3b84ce3bcaaea79f691a459/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:56.528195 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ce217-8188-4a55-9d82-41945ad79a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2568bd642ad497d839a7901b50690fa, user_id=5c70e1f9b3b84ce3bcaaea79f691a459, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:56.530880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ce217-8188-4a55-9d82-41945ad79a81 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:56.581057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1039/2072] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:55:56 2022] POST /identity/v3/projects => generated 389 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:55:56.585053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ff2e3-8ba4-463e-a94a-610e88b1d71a admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:56.637075 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1034/2073] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:55:56 2022] PUT /identity/v3/projects/b2568bd642ad497d839a7901b50690fa/users/5c70e1f9b3b84ce3bcaaea79f691a459/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:55:56.647635 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa321b2b-a82a-4e27-94e1-3dcaf9f5b328 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:56.647989 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa321b2b-a82a-4e27-94e1-3dcaf9f5b328 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:56.648261 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa321b2b-a82a-4e27-94e1-3dcaf9f5b328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:56.650238 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ff2e3-8ba4-463e-a94a-610e88b1d71a admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:56.655886 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:56.656076 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=92,keystone:DELETE=2,keystone:INSERT=6 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:56.680357 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-fa321b2b-a82a-4e27-94e1-3dcaf9f5b328 None None] MFA Rules not processed for user `5c70e1f9b3b84ce3bcaaea79f691a459`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:56.681783 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-fa321b2b-a82a-4e27-94e1-3dcaf9f5b328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:56.722647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4f974-1cc3-4266-9331-3e7085328a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:56.723223 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4f974-1cc3-4266-9331-3e7085328a89 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:56.723543 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4f974-1cc3-4266-9331-3e7085328a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:56.724084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4f974-1cc3-4266-9331-3e7085328a89 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:56.724747 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c4f974-1cc3-4266-9331-3e7085328a89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:56.726713 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c4f974-1cc3-4266-9331-3e7085328a89 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:56.755689 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1035/2074] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:55:56.760237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa321b2b-a82a-4e27-94e1-3dcaf9f5b328 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:56.771109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa321b2b-a82a-4e27-94e1-3dcaf9f5b328 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:56.775887 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bfe3db-2682-4ed4-930c-60465e433163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:56.776476 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfe3db-2682-4ed4-930c-60465e433163 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:56.776760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfe3db-2682-4ed4-930c-60465e433163 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:56.777580 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfe3db-2682-4ed4-930c-60465e433163 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:56.778242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bfe3db-2682-4ed4-930c-60465e433163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:56.780250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bfe3db-2682-4ed4-930c-60465e433163 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:56.901244 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1040/2075] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:55:56 2022] POST /identity/v3/users => generated 295 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:55:56.904125 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4f974-1cc3-4266-9331-3e7085328a89 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:56.914408 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4f974-1cc3-4266-9331-3e7085328a89 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:56.922416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6832b20-f052-444a-9e8e-e4071b4691f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:56.923236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6832b20-f052-444a-9e8e-e4071b4691f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:56.923647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6832b20-f052-444a-9e8e-e4071b4691f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:56.924321 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6832b20-f052-444a-9e8e-e4071b4691f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:56.924699 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6832b20-f052-444a-9e8e-e4071b4691f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:56.926758 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6832b20-f052-444a-9e8e-e4071b4691f4 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:56.941670 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1041/2076] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:55:56.947822 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6832b20-f052-444a-9e8e-e4071b4691f4 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:56.954248 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1036/2077] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:55:56 2022] POST /identity/v3/projects => generated 373 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:55:56.959071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bfe3db-2682-4ed4-930c-60465e433163 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:56.959235 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6832b20-f052-444a-9e8e-e4071b4691f4 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:57.037439 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d911b7-c768-431d-9d0a-6312aa44e54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:57.038056 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d911b7-c768-431d-9d0a-6312aa44e54d admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:57.038313 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d911b7-c768-431d-9d0a-6312aa44e54d admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:57.038585 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d911b7-c768-431d-9d0a-6312aa44e54d admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:57.039225 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d911b7-c768-431d-9d0a-6312aa44e54d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:57.040894 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d911b7-c768-431d-9d0a-6312aa44e54d admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:57.043089 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bfe3db-2682-4ed4-930c-60465e433163 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:57.048164 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971c893-5a44-4b71-ab7a-e3c36d39beb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:57.048943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971c893-5a44-4b71-ab7a-e3c36d39beb2 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:57.049219 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971c893-5a44-4b71-ab7a-e3c36d39beb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:57.049503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971c893-5a44-4b71-ab7a-e3c36d39beb2 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:57.050161 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4971c893-5a44-4b71-ab7a-e3c36d39beb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:57.052153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4971c893-5a44-4b71-ab7a-e3c36d39beb2 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:57.055452 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1042/2078] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:55:57.057518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d911b7-c768-431d-9d0a-6312aa44e54d admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:57.069604 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d911b7-c768-431d-9d0a-6312aa44e54d admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:57.074782 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7734fb-3cc1-44d6-90a7-ec8baea1e1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:57.075475 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7734fb-3cc1-44d6-90a7-ec8baea1e1cd admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:57.075751 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7734fb-3cc1-44d6-90a7-ec8baea1e1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:57.076255 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7734fb-3cc1-44d6-90a7-ec8baea1e1cd admin admin] PATH_INFO: `/v3/projects/5ab0b708408a41a7a7981d34e1f66ffc/users/fd74776f2b0246eca18e84c2044370ef/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:57.093203 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7734fb-3cc1-44d6-90a7-ec8baea1e1cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ab0b708408a41a7a7981d34e1f66ffc, user_id=fd74776f2b0246eca18e84c2044370ef, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:57.105360 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7734fb-3cc1-44d6-90a7-ec8baea1e1cd admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:57.159488 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1037/2079] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:55:56 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:55:57.166257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971c893-5a44-4b71-ab7a-e3c36d39beb2 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:57.176079 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971c893-5a44-4b71-ab7a-e3c36d39beb2 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:57.184044 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a3569-df1e-4ac0-b0b7-02d7fb4fdb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:57.184819 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a3569-df1e-4ac0-b0b7-02d7fb4fdb4e admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:57.185342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a3569-df1e-4ac0-b0b7-02d7fb4fdb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:57.185837 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a3569-df1e-4ac0-b0b7-02d7fb4fdb4e admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:57.186616 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a3569-df1e-4ac0-b0b7-02d7fb4fdb4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:57.188574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a3569-df1e-4ac0-b0b7-02d7fb4fdb4e admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:57.188775 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1043/2080] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:55:57 2022] PUT /identity/v3/projects/5ab0b708408a41a7a7981d34e1f66ffc/users/fd74776f2b0246eca18e84c2044370ef/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:55:57.201675 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1038/2081] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:55:57.212664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7734fb-3cc1-44d6-90a7-ec8baea1e1cd admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:57.213362 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045313d-d6c7-4a73-ae23-8b4e878d8c98 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:57.213827 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045313d-d6c7-4a73-ae23-8b4e878d8c98 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:57.214134 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045313d-d6c7-4a73-ae23-8b4e878d8c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:57.259331 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-f045313d-d6c7-4a73-ae23-8b4e878d8c98 None None] MFA Rules not processed for user `fd74776f2b0246eca18e84c2044370ef`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:57.260782 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-f045313d-d6c7-4a73-ae23-8b4e878d8c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:57.313097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7734fb-3cc1-44d6-90a7-ec8baea1e1cd admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:57.318988 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:57.329535 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fbefb-294e-4a4b-82ef-895a24f13634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:57.331623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fbefb-294e-4a4b-82ef-895a24f13634 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:57.331623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fbefb-294e-4a4b-82ef-895a24f13634 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:57.331623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fbefb-294e-4a4b-82ef-895a24f13634 admin admin] PATH_INFO: `/v3/projects/b136e985012943109fd1ed133341c3b2/users/25f2f32de69a41a8a107c65e056c6bd3/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:57.334413 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:57.362025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fbefb-294e-4a4b-82ef-895a24f13634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b136e985012943109fd1ed133341c3b2, user_id=25f2f32de69a41a8a107c65e056c6bd3, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:57.365018 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fbefb-294e-4a4b-82ef-895a24f13634 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:57.380902 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1039/2082] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:57.392455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045313d-d6c7-4a73-ae23-8b4e878d8c98 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:57.419861 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045313d-d6c7-4a73-ae23-8b4e878d8c98 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:57.422084 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1594cf-45a3-4fe0-9bfc-1934b9525198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:57.422988 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1594cf-45a3-4fe0-9bfc-1934b9525198 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:57.423513 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1594cf-45a3-4fe0-9bfc-1934b9525198 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:57.423986 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1594cf-45a3-4fe0-9bfc-1934b9525198 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:57.425091 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1594cf-45a3-4fe0-9bfc-1934b9525198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:57.427538 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1594cf-45a3-4fe0-9bfc-1934b9525198 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:57.476158 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1044/2083] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:55:57 2022] PUT /identity/v3/projects/b136e985012943109fd1ed133341c3b2/users/25f2f32de69a41a8a107c65e056c6bd3/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:57.483255 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fbefb-294e-4a4b-82ef-895a24f13634 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:57.559697 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fbefb-294e-4a4b-82ef-895a24f13634 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:57.570939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1040/2084] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:55:57 2022] POST /identity/v3/projects => generated 389 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:55:57.577770 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1594cf-45a3-4fe0-9bfc-1934b9525198 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:57.654133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9e9cf-b819-4109-a09c-6703f895e8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:57.655022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9e9cf-b819-4109-a09c-6703f895e8eb admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:57.655633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9e9cf-b819-4109-a09c-6703f895e8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:57.656377 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9e9cf-b819-4109-a09c-6703f895e8eb admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:57.657131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9e9cf-b819-4109-a09c-6703f895e8eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:57.659223 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9e9cf-b819-4109-a09c-6703f895e8eb admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:57.676445 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1045/2085] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 13:55:57.678633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9e9cf-b819-4109-a09c-6703f895e8eb admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:57.690356 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9e9cf-b819-4109-a09c-6703f895e8eb admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:57.693526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1594cf-45a3-4fe0-9bfc-1934b9525198 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:57.701445 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c83ea-ed4c-4f1a-a521-374ba5d53e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:57.702129 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c83ea-ed4c-4f1a-a521-374ba5d53e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:57.702573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c83ea-ed4c-4f1a-a521-374ba5d53e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:57.702891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c83ea-ed4c-4f1a-a521-374ba5d53e63 admin admin] PATH_INFO: `/v3/projects/b136e985012943109fd1ed133341c3b2/users/25f2f32de69a41a8a107c65e056c6bd3/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:57.705359 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c83ea-ed4c-4f1a-a521-374ba5d53e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b136e985012943109fd1ed133341c3b2, user_id=25f2f32de69a41a8a107c65e056c6bd3, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:57.709582 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c83ea-ed4c-4f1a-a521-374ba5d53e63 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:57.714850 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35642aa0-063c-40e0-88b9-26bcbab51080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:57.715539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35642aa0-063c-40e0-88b9-26bcbab51080 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:57.715816 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35642aa0-063c-40e0-88b9-26bcbab51080 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:57.716122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35642aa0-063c-40e0-88b9-26bcbab51080 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:57.716760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35642aa0-063c-40e0-88b9-26bcbab51080 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:57.718801 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35642aa0-063c-40e0-88b9-26bcbab51080 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:57.724163 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1046/2086] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:55:57 2022] PUT /identity/v3/projects/b136e985012943109fd1ed133341c3b2/users/25f2f32de69a41a8a107c65e056c6bd3/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:57.736694 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa868a2-bf2c-4f44-a06f-2b045716ef1b None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:57.737804 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa868a2-bf2c-4f44-a06f-2b045716ef1b None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:57.737804 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa868a2-bf2c-4f44-a06f-2b045716ef1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:57.770576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-1aa868a2-bf2c-4f44-a06f-2b045716ef1b None None] MFA Rules not processed for user `25f2f32de69a41a8a107c65e056c6bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:57.771857 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-1aa868a2-bf2c-4f44-a06f-2b045716ef1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:57.831688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1041/2087] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:55:57 2022] POST /identity/v3/users => generated 301 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:55:57.836048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35642aa0-063c-40e0-88b9-26bcbab51080 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:57.853697 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35642aa0-063c-40e0-88b9-26bcbab51080 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:57.860646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:57.866041 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1047/2088] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:57.878170 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa868a2-bf2c-4f44-a06f-2b045716ef1b None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:57.879692 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-1aa868a2-bf2c-4f44-a06f-2b045716ef1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:57.921343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c8d29-c86f-4a56-8f60-b8d7e405457a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:57.921993 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c8d29-c86f-4a56-8f60-b8d7e405457a admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:57.922281 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c8d29-c86f-4a56-8f60-b8d7e405457a admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:57.922524 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c8d29-c86f-4a56-8f60-b8d7e405457a admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:57.923185 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c8d29-c86f-4a56-8f60-b8d7e405457a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:57.924871 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c8d29-c86f-4a56-8f60-b8d7e405457a admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:57.945297 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa868a2-bf2c-4f44-a06f-2b045716ef1b None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:57.947546 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1042/2089] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 13:55:57.948745 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c8d29-c86f-4a56-8f60-b8d7e405457a admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:57.950316 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e935e-7071-4345-bc7f-1a87ec591a16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:57.950980 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e935e-7071-4345-bc7f-1a87ec591a16 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:57.951265 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e935e-7071-4345-bc7f-1a87ec591a16 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:57.951570 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e935e-7071-4345-bc7f-1a87ec591a16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:57.959713 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c8d29-c86f-4a56-8f60-b8d7e405457a admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:57.964410 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e935e-7071-4345-bc7f-1a87ec591a16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:57.966176 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e935e-7071-4345-bc7f-1a87ec591a16 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:57.969551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ef127-7fc7-43e6-9e4d-6064f74d939c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:57.970244 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ef127-7fc7-43e6-9e4d-6064f74d939c admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:57.970532 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ef127-7fc7-43e6-9e4d-6064f74d939c admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:57.970854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ef127-7fc7-43e6-9e4d-6064f74d939c admin admin] PATH_INFO: `/v3/projects/1942d216c3e84cd6ac046bc1c38e4305/users/b15aa7af4459490b936d43662ad1b0fa/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:57.981463 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1048/2090] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:55:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 13:55:57.996944 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ef127-7fc7-43e6-9e4d-6064f74d939c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1942d216c3e84cd6ac046bc1c38e4305, user_id=b15aa7af4459490b936d43662ad1b0fa, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:58.000512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ef127-7fc7-43e6-9e4d-6064f74d939c admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:58.137417 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e935e-7071-4345-bc7f-1a87ec591a16 service cinder] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:58.137978 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1043/2091] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:55:57 2022] PUT /identity/v3/projects/1942d216c3e84cd6ac046bc1c38e4305/users/b15aa7af4459490b936d43662ad1b0fa/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:58.148642 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e935e-7071-4345-bc7f-1a87ec591a16 service cinder] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:58.216438 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541cea0-2681-4d0f-8994-3fbe7bdc5143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:58.220236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541cea0-2681-4d0f-8994-3fbe7bdc5143 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:58.220716 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541cea0-2681-4d0f-8994-3fbe7bdc5143 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:58.221732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541cea0-2681-4d0f-8994-3fbe7bdc5143 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:58.222040 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541cea0-2681-4d0f-8994-3fbe7bdc5143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:58.224302 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541cea0-2681-4d0f-8994-3fbe7bdc5143 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:58.243209 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1049/2092] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:55:58.244878 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ef127-7fc7-43e6-9e4d-6064f74d939c admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:58.262506 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ef127-7fc7-43e6-9e4d-6064f74d939c admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:58.267566 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b657735-bbbc-4a6d-956b-865673e0df24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:58.268273 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b657735-bbbc-4a6d-956b-865673e0df24 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:58.268573 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b657735-bbbc-4a6d-956b-865673e0df24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:58.268847 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b657735-bbbc-4a6d-956b-865673e0df24 admin admin] PATH_INFO: `/v3/projects/1942d216c3e84cd6ac046bc1c38e4305/users/b15aa7af4459490b936d43662ad1b0fa/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:58.270988 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b657735-bbbc-4a6d-956b-865673e0df24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1942d216c3e84cd6ac046bc1c38e4305, user_id=b15aa7af4459490b936d43662ad1b0fa, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:58.273936 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b657735-bbbc-4a6d-956b-865673e0df24 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:58.285887 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1044/2093] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:55:58 2022] PUT /identity/v3/projects/1942d216c3e84cd6ac046bc1c38e4305/users/b15aa7af4459490b936d43662ad1b0fa/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:55:58.297080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574601e9-986f-410a-9756-55eb3914d72b None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:58.297382 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574601e9-986f-410a-9756-55eb3914d72b None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:58.297730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574601e9-986f-410a-9756-55eb3914d72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:58.337576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-574601e9-986f-410a-9756-55eb3914d72b None None] MFA Rules not processed for user `b15aa7af4459490b936d43662ad1b0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:58.338885 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-574601e9-986f-410a-9756-55eb3914d72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:58.457412 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1050/2094] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:58 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:58.470024 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b657735-bbbc-4a6d-956b-865673e0df24 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:58.472896 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-1b657735-bbbc-4a6d-956b-865673e0df24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:58.481465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:58.581027 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b657735-bbbc-4a6d-956b-865673e0df24 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:58.582426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ad8d2-21c8-44be-a0b9-a07d9193f066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:58.583447 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ad8d2-21c8-44be-a0b9-a07d9193f066 service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:58.583642 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ad8d2-21c8-44be-a0b9-a07d9193f066 service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:58.583930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ad8d2-21c8-44be-a0b9-a07d9193f066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:58.595006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ad8d2-21c8-44be-a0b9-a07d9193f066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:58.597307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ad8d2-21c8-44be-a0b9-a07d9193f066 service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:58.609791 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1045/2095] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:55:58 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:55:58.794400 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574601e9-986f-410a-9756-55eb3914d72b None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:58.837760 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:58.903502 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574601e9-986f-410a-9756-55eb3914d72b None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:58.909285 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d4afd-5ace-4195-bad8-90e048256baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:58.910158 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d4afd-5ace-4195-bad8-90e048256baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:58.910544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d4afd-5ace-4195-bad8-90e048256baa admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:58.911081 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d4afd-5ace-4195-bad8-90e048256baa admin admin] PATH_INFO: `/v3/users/fd74776f2b0246eca18e84c2044370ef` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:58.912458 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d4afd-5ace-4195-bad8-90e048256baa admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd74776f2b0246eca18e84c2044370ef)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:58.915616 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d4afd-5ace-4195-bad8-90e048256baa admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:59.085933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ad8d2-21c8-44be-a0b9-a07d9193f066 service cinder] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:59.097781 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ad8d2-21c8-44be-a0b9-a07d9193f066 service cinder] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:59.103092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47cab08-b230-4495-8c12-0fb04fc451a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:59.103775 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cab08-b230-4495-8c12-0fb04fc451a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:59.104261 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cab08-b230-4495-8c12-0fb04fc451a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:59.104529 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cab08-b230-4495-8c12-0fb04fc451a0 admin admin] PATH_INFO: `/v3/users/5c70e1f9b3b84ce3bcaaea79f691a459` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:59.106266 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47cab08-b230-4495-8c12-0fb04fc451a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c70e1f9b3b84ce3bcaaea79f691a459)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:59.108435 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47cab08-b230-4495-8c12-0fb04fc451a0 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:59.224912 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-de6d4afd-5ace-4195-bad8-90e048256baa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd74776f2b0246eca18e84c2044370ef'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:59.305075 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-de6d4afd-5ace-4195-bad8-90e048256baa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd74776f2b0246eca18e84c2044370ef'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:59.313776 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-de6d4afd-5ace-4195-bad8-90e048256baa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd74776f2b0246eca18e84c2044370ef'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:59.327770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-de6d4afd-5ace-4195-bad8-90e048256baa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd74776f2b0246eca18e84c2044370ef'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:59.328525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-de6d4afd-5ace-4195-bad8-90e048256baa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd74776f2b0246eca18e84c2044370ef'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:59.335038 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1051/2096] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:55:58 2022] DELETE /identity/v3/users/fd74776f2b0246eca18e84c2044370ef => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:59.339557 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a296e02-4846-4741-80b5-eb68708fe69c None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:59.339848 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a296e02-4846-4741-80b5-eb68708fe69c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:59.340110 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a296e02-4846-4741-80b5-eb68708fe69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:59.363557 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-3a296e02-4846-4741-80b5-eb68708fe69c None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:59.364958 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-3a296e02-4846-4741-80b5-eb68708fe69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:59.386322 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-a47cab08-b230-4495-8c12-0fb04fc451a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c70e1f9b3b84ce3bcaaea79f691a459'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:59.388700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-a47cab08-b230-4495-8c12-0fb04fc451a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c70e1f9b3b84ce3bcaaea79f691a459'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:59.419866 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-a47cab08-b230-4495-8c12-0fb04fc451a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c70e1f9b3b84ce3bcaaea79f691a459'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:59.428909 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-a47cab08-b230-4495-8c12-0fb04fc451a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c70e1f9b3b84ce3bcaaea79f691a459'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:59.451389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1052/2097] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:55:59.452268 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a296e02-4846-4741-80b5-eb68708fe69c None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:59.453645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-3a296e02-4846-4741-80b5-eb68708fe69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:59.466719 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a296e02-4846-4741-80b5-eb68708fe69c None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:59.471619 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2f600-e8b5-40c6-a398-98ee5c09dd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:59.472262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2f600-e8b5-40c6-a398-98ee5c09dd2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:59.472524 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2f600-e8b5-40c6-a398-98ee5c09dd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:59.472798 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2f600-e8b5-40c6-a398-98ee5c09dd2e admin admin] PATH_INFO: `/v3/users/23570a46e7e74e52a81293dbea868360` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:59.474245 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2f600-e8b5-40c6-a398-98ee5c09dd2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=23570a46e7e74e52a81293dbea868360)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:59.476236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2f600-e8b5-40c6-a398-98ee5c09dd2e admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:59.501246 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-a47cab08-b230-4495-8c12-0fb04fc451a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c70e1f9b3b84ce3bcaaea79f691a459'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:59.510375 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1046/2098] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:55:59 2022] DELETE /identity/v3/users/5c70e1f9b3b84ce3bcaaea79f691a459 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:59.515376 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47cab08-b230-4495-8c12-0fb04fc451a0 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:59.516926 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a47cab08-b230-4495-8c12-0fb04fc451a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:59.587902 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47cab08-b230-4495-8c12-0fb04fc451a0 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:59.592042 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe97f0-c7b7-4897-b41d-af16c71c67c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:59.592654 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe97f0-c7b7-4897-b41d-af16c71c67c7 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:59.592930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe97f0-c7b7-4897-b41d-af16c71c67c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:59.593204 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe97f0-c7b7-4897-b41d-af16c71c67c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:59.594963 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-59fe97f0-c7b7-4897-b41d-af16c71c67c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:59.629144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:59.665347 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe97f0-c7b7-4897-b41d-af16c71c67c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:59.666962 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe97f0-c7b7-4897-b41d-af16c71c67c7 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:59.673457 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:59.684624 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-d9d2f600-e8b5-40c6-a398-98ee5c09dd2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23570a46e7e74e52a81293dbea868360'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:59.693634 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1047/2099] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:55:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:55:59.696690 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427e9fe-de9d-4794-aa59-eb322380c8ed None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:59.697001 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427e9fe-de9d-4794-aa59-eb322380c8ed None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:59.697285 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427e9fe-de9d-4794-aa59-eb322380c8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:59.729266 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-8427e9fe-de9d-4794-aa59-eb322380c8ed None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:55:59.732154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-8427e9fe-de9d-4794-aa59-eb322380c8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:59.746968 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1048/2100] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:55:59.750123 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-d9d2f600-e8b5-40c6-a398-98ee5c09dd2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23570a46e7e74e52a81293dbea868360'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:59.758295 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-d9d2f600-e8b5-40c6-a398-98ee5c09dd2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23570a46e7e74e52a81293dbea868360'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:59.773949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427e9fe-de9d-4794-aa59-eb322380c8ed None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:55:59.781945 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-d9d2f600-e8b5-40c6-a398-98ee5c09dd2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23570a46e7e74e52a81293dbea868360'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:59.787977 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-d9d2f600-e8b5-40c6-a398-98ee5c09dd2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23570a46e7e74e52a81293dbea868360'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:55:59.792189 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427e9fe-de9d-4794-aa59-eb322380c8ed None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:55:59.796335 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1053/2101] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:55:59 2022] DELETE /identity/v3/users/23570a46e7e74e52a81293dbea868360 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:55:59.803268 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aaa2e7-5b83-4a58-85c0-a4125edb6934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:55:59.804033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaa2e7-5b83-4a58-85c0-a4125edb6934 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:55:59.804382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaa2e7-5b83-4a58-85c0-a4125edb6934 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:55:59.804744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaa2e7-5b83-4a58-85c0-a4125edb6934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:55:59.806961 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b1aaa2e7-5b83-4a58-85c0-a4125edb6934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:55:59.828118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aaa2e7-5b83-4a58-85c0-a4125edb6934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:55:59.829588 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aaa2e7-5b83-4a58-85c0-a4125edb6934 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:55:59.848569 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1049/2102] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:55:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:56:00.312562 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2f600-e8b5-40c6-a398-98ee5c09dd2e admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:00.320232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-d9d2f600-e8b5-40c6-a398-98ee5c09dd2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:00.484304 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2f600-e8b5-40c6-a398-98ee5c09dd2e admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:00.493228 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859358b8-c7b1-4509-be78-babbf47100db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:00.493918 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859358b8-c7b1-4509-be78-babbf47100db admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:00.494205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859358b8-c7b1-4509-be78-babbf47100db admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:00.498872 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859358b8-c7b1-4509-be78-babbf47100db admin admin] PATH_INFO: `/v3/projects/746e3f51f14a43ff8464d2e1983e46c0` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:00.498872 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859358b8-c7b1-4509-be78-babbf47100db admin admin] RBAC: Authorizing `identity:delete_project(project_id=746e3f51f14a43ff8464d2e1983e46c0)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:00.498872 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859358b8-c7b1-4509-be78-babbf47100db admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:00.584363 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aaa2e7-5b83-4a58-85c0-a4125edb6934 service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:00.585861 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b1aaa2e7-5b83-4a58-85c0-a4125edb6934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:00.607343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aaa2e7-5b83-4a58-85c0-a4125edb6934 service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:00.612960 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4ea65-a253-46ba-b8aa-756b3b7b9c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:00.613636 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4ea65-a253-46ba-b8aa-756b3b7b9c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:00.614377 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4ea65-a253-46ba-b8aa-756b3b7b9c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:00.614876 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4ea65-a253-46ba-b8aa-756b3b7b9c9a admin admin] PATH_INFO: `/v3/projects/b2568bd642ad497d839a7901b50690fa` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:00.616223 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4ea65-a253-46ba-b8aa-756b3b7b9c9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2568bd642ad497d839a7901b50690fa)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:00.618881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4ea65-a253-46ba-b8aa-756b3b7b9c9a admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:00.656360 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-859358b8-c7b1-4509-be78-babbf47100db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '746e3f51f14a43ff8464d2e1983e46c0', 'request_id': 'req-859358b8-c7b1-4509-be78-babbf47100db'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:00.665878 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-859358b8-c7b1-4509-be78-babbf47100db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '746e3f51f14a43ff8464d2e1983e46c0', 'request_id': 'req-859358b8-c7b1-4509-be78-babbf47100db'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:00.758126 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-859358b8-c7b1-4509-be78-babbf47100db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '746e3f51f14a43ff8464d2e1983e46c0', 'request_id': 'req-859358b8-c7b1-4509-be78-babbf47100db'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:00.771609 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-b5a4ea65-a253-46ba-b8aa-756b3b7b9c9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2568bd642ad497d839a7901b50690fa', 'request_id': 'req-b5a4ea65-a253-46ba-b8aa-756b3b7b9c9a'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:00.773466 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-859358b8-c7b1-4509-be78-babbf47100db admin admin] The token cache is being invalidate because project 746e3f51f14a43ff8464d2e1983e46c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:56:00.773765 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-859358b8-c7b1-4509-be78-babbf47100db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:00.774439 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-859358b8-c7b1-4509-be78-babbf47100db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:00.776181 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1054/2103] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:56:00 2022] DELETE /identity/v3/projects/746e3f51f14a43ff8464d2e1983e46c0 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:00.776962 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859358b8-c7b1-4509-be78-babbf47100db admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:00.778382 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-859358b8-c7b1-4509-be78-babbf47100db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:00.782129 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-b5a4ea65-a253-46ba-b8aa-756b3b7b9c9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2568bd642ad497d839a7901b50690fa', 'request_id': 'req-b5a4ea65-a253-46ba-b8aa-756b3b7b9c9a'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:00.789968 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-b5a4ea65-a253-46ba-b8aa-756b3b7b9c9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2568bd642ad497d839a7901b50690fa', 'request_id': 'req-b5a4ea65-a253-46ba-b8aa-756b3b7b9c9a'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:00.848410 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:00.861095 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-b5a4ea65-a253-46ba-b8aa-756b3b7b9c9a admin admin] The token cache is being invalidate because project b2568bd642ad497d839a7901b50690fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:56:00.861422 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-b5a4ea65-a253-46ba-b8aa-756b3b7b9c9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:00.862021 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-b5a4ea65-a253-46ba-b8aa-756b3b7b9c9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:00.863985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1050/2104] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:56:00 2022] DELETE /identity/v3/projects/b2568bd642ad497d839a7901b50690fa => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:56:00.864455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4ea65-a253-46ba-b8aa-756b3b7b9c9a admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:00.865739 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b5a4ea65-a253-46ba-b8aa-756b3b7b9c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:00.871721 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859358b8-c7b1-4509-be78-babbf47100db admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:00.943714 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4ea65-a253-46ba-b8aa-756b3b7b9c9a admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:00.944563 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e17490-54a8-4116-b010-6e7f389ed76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:00.945646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e17490-54a8-4116-b010-6e7f389ed76c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:00.945932 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e17490-54a8-4116-b010-6e7f389ed76c admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:00.946207 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e17490-54a8-4116-b010-6e7f389ed76c admin admin] PATH_INFO: `/v3/projects/5ab0b708408a41a7a7981d34e1f66ffc` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:00.947337 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e17490-54a8-4116-b010-6e7f389ed76c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ab0b708408a41a7a7981d34e1f66ffc)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:00.949491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5d0ba-c72c-452f-9078-1390c750ca0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:00.950135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5d0ba-c72c-452f-9078-1390c750ca0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:00.950418 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5d0ba-c72c-452f-9078-1390c750ca0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:00.950716 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5d0ba-c72c-452f-9078-1390c750ca0e admin admin] PATH_INFO: `/v3/users/a434fb6f41f349f3b26aa894de60ecf5` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:00.952234 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5d0ba-c72c-452f-9078-1390c750ca0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a434fb6f41f349f3b26aa894de60ecf5)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:00.955500 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e17490-54a8-4116-b010-6e7f389ed76c admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:00.955627 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5d0ba-c72c-452f-9078-1390c750ca0e admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:01.080633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b5e17490-54a8-4116-b010-6e7f389ed76c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ab0b708408a41a7a7981d34e1f66ffc', 'request_id': 'req-b5e17490-54a8-4116-b010-6e7f389ed76c'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:01.087627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b5e17490-54a8-4116-b010-6e7f389ed76c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ab0b708408a41a7a7981d34e1f66ffc', 'request_id': 'req-b5e17490-54a8-4116-b010-6e7f389ed76c'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:01.213060 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b5e17490-54a8-4116-b010-6e7f389ed76c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ab0b708408a41a7a7981d34e1f66ffc', 'request_id': 'req-b5e17490-54a8-4116-b010-6e7f389ed76c'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:01.231240 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:01.242195 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b5e17490-54a8-4116-b010-6e7f389ed76c admin admin] The token cache is being invalidate because project 5ab0b708408a41a7a7981d34e1f66ffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:56:01.242506 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b5e17490-54a8-4116-b010-6e7f389ed76c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:01.243634 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b5e17490-54a8-4116-b010-6e7f389ed76c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:01.247802 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1055/2105] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:56:00 2022] DELETE /identity/v3/projects/5ab0b708408a41a7a7981d34e1f66ffc => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:01.248835 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e17490-54a8-4116-b010-6e7f389ed76c admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:01.251152 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b5e17490-54a8-4116-b010-6e7f389ed76c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:01.269317 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-88d5d0ba-c72c-452f-9078-1390c750ca0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a434fb6f41f349f3b26aa894de60ecf5'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:01.274792 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-88d5d0ba-c72c-452f-9078-1390c750ca0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a434fb6f41f349f3b26aa894de60ecf5'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:01.311421 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-88d5d0ba-c72c-452f-9078-1390c750ca0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a434fb6f41f349f3b26aa894de60ecf5'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:01.331920 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-88d5d0ba-c72c-452f-9078-1390c750ca0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a434fb6f41f349f3b26aa894de60ecf5'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:01.433709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-88d5d0ba-c72c-452f-9078-1390c750ca0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a434fb6f41f349f3b26aa894de60ecf5'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:01.439454 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e17490-54a8-4116-b010-6e7f389ed76c admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:01.450592 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1051/2106] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:56:00 2022] DELETE /identity/v3/users/a434fb6f41f349f3b26aa894de60ecf5 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:01.450592 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5d0ba-c72c-452f-9078-1390c750ca0e admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:01.456295 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-88d5d0ba-c72c-452f-9078-1390c750ca0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:01.519583 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:01.600091 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5d0ba-c72c-452f-9078-1390c750ca0e admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:01.606252 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d36ac-18ac-4f54-9f7b-f0aa6d8df251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:01.607164 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d36ac-18ac-4f54-9f7b-f0aa6d8df251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:01.607893 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d36ac-18ac-4f54-9f7b-f0aa6d8df251 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:01.608890 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d36ac-18ac-4f54-9f7b-f0aa6d8df251 admin admin] PATH_INFO: `/v3/users/b15aa7af4459490b936d43662ad1b0fa` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:01.610123 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d36ac-18ac-4f54-9f7b-f0aa6d8df251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b15aa7af4459490b936d43662ad1b0fa)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:01.612221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d36ac-18ac-4f54-9f7b-f0aa6d8df251 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:01.626970 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3173edd-2841-4ec9-bec8-c355649cdca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:01.628046 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3173edd-2841-4ec9-bec8-c355649cdca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:01.628450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3173edd-2841-4ec9-bec8-c355649cdca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:01.628830 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3173edd-2841-4ec9-bec8-c355649cdca2 admin admin] PATH_INFO: `/v3/users/25f2f32de69a41a8a107c65e056c6bd3` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:01.630879 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3173edd-2841-4ec9-bec8-c355649cdca2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25f2f32de69a41a8a107c65e056c6bd3)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:01.634026 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3173edd-2841-4ec9-bec8-c355649cdca2 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:01.838348 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-0c2d36ac-18ac-4f54-9f7b-f0aa6d8df251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b15aa7af4459490b936d43662ad1b0fa'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:01.840559 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-0c2d36ac-18ac-4f54-9f7b-f0aa6d8df251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b15aa7af4459490b936d43662ad1b0fa'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:01.857946 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-c3173edd-2841-4ec9-bec8-c355649cdca2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25f2f32de69a41a8a107c65e056c6bd3'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:01.861672 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-0c2d36ac-18ac-4f54-9f7b-f0aa6d8df251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b15aa7af4459490b936d43662ad1b0fa'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:01.872205 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-0c2d36ac-18ac-4f54-9f7b-f0aa6d8df251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b15aa7af4459490b936d43662ad1b0fa'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:01.968964 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-c3173edd-2841-4ec9-bec8-c355649cdca2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25f2f32de69a41a8a107c65e056c6bd3'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:01.975005 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-c3173edd-2841-4ec9-bec8-c355649cdca2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25f2f32de69a41a8a107c65e056c6bd3'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:01.995299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-c3173edd-2841-4ec9-bec8-c355649cdca2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25f2f32de69a41a8a107c65e056c6bd3'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:01.997264 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-c3173edd-2841-4ec9-bec8-c355649cdca2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25f2f32de69a41a8a107c65e056c6bd3'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:02.002975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1056/2107] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:56:01 2022] DELETE /identity/v3/users/25f2f32de69a41a8a107c65e056c6bd3 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:02.004074 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3173edd-2841-4ec9-bec8-c355649cdca2 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:02.007147 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c3173edd-2841-4ec9-bec8-c355649cdca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:02.080627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3173edd-2841-4ec9-bec8-c355649cdca2 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:02.085506 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc6436-09f2-48e1-8ad8-b4f9872de95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:02.086145 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc6436-09f2-48e1-8ad8-b4f9872de95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:02.086423 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc6436-09f2-48e1-8ad8-b4f9872de95e admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:02.086694 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc6436-09f2-48e1-8ad8-b4f9872de95e admin admin] PATH_INFO: `/v3/projects/883e5c89758d4bbd8a4f90064a4f7fcd` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:02.088460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc6436-09f2-48e1-8ad8-b4f9872de95e admin admin] RBAC: Authorizing `identity:delete_project(project_id=883e5c89758d4bbd8a4f90064a4f7fcd)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:02.094040 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-0c2d36ac-18ac-4f54-9f7b-f0aa6d8df251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b15aa7af4459490b936d43662ad1b0fa'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:02.094187 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc6436-09f2-48e1-8ad8-b4f9872de95e admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:02.098000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1052/2108] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:56:01 2022] DELETE /identity/v3/users/b15aa7af4459490b936d43662ad1b0fa => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:02.221229 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-1abc6436-09f2-48e1-8ad8-b4f9872de95e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '883e5c89758d4bbd8a4f90064a4f7fcd', 'request_id': 'req-1abc6436-09f2-48e1-8ad8-b4f9872de95e'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:02.222401 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:02.227730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-1abc6436-09f2-48e1-8ad8-b4f9872de95e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '883e5c89758d4bbd8a4f90064a4f7fcd', 'request_id': 'req-1abc6436-09f2-48e1-8ad8-b4f9872de95e'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:02.358266 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-1abc6436-09f2-48e1-8ad8-b4f9872de95e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '883e5c89758d4bbd8a4f90064a4f7fcd', 'request_id': 'req-1abc6436-09f2-48e1-8ad8-b4f9872de95e'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:02.383070 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-1abc6436-09f2-48e1-8ad8-b4f9872de95e admin admin] The token cache is being invalidate because project 883e5c89758d4bbd8a4f90064a4f7fcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:56:02.383399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-1abc6436-09f2-48e1-8ad8-b4f9872de95e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:02.384239 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-1abc6436-09f2-48e1-8ad8-b4f9872de95e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:02.391319 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1057/2109] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:56:02 2022] DELETE /identity/v3/projects/883e5c89758d4bbd8a4f90064a4f7fcd => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:02.393080 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2495a5f-ce1f-4548-b68b-a4e4ec3109ba None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:02.393573 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2495a5f-ce1f-4548-b68b-a4e4ec3109ba None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:02.394039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2495a5f-ce1f-4548-b68b-a4e4ec3109ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:02.428025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-e2495a5f-ce1f-4548-b68b-a4e4ec3109ba None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:02.430168 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-e2495a5f-ce1f-4548-b68b-a4e4ec3109ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:02.502458 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:02.587258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1053/2110] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:02.596488 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4817d-52e7-4fec-9158-2e22f3b9b4f3 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:02.597059 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4817d-52e7-4fec-9158-2e22f3b9b4f3 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:02.597059 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4817d-52e7-4fec-9158-2e22f3b9b4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:02.625093 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-fcd4817d-52e7-4fec-9158-2e22f3b9b4f3 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:02.626477 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-fcd4817d-52e7-4fec-9158-2e22f3b9b4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:02.637048 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1058/2111] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:02.643910 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2495a5f-ce1f-4548-b68b-a4e4ec3109ba None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:02.658558 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2495a5f-ce1f-4548-b68b-a4e4ec3109ba None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:02.667835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255e093-9a87-4fa0-b72a-293b9ff8cd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:02.668760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255e093-9a87-4fa0-b72a-293b9ff8cd5d admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:02.669047 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255e093-9a87-4fa0-b72a-293b9ff8cd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:02.669325 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255e093-9a87-4fa0-b72a-293b9ff8cd5d admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:02.669995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255e093-9a87-4fa0-b72a-293b9ff8cd5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:56:02.670309 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255e093-9a87-4fa0-b72a-293b9ff8cd5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:02.671982 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255e093-9a87-4fa0-b72a-293b9ff8cd5d admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:02.684255 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1054/2112] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:56:02.689420 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4817d-52e7-4fec-9158-2e22f3b9b4f3 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:02.702647 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4817d-52e7-4fec-9158-2e22f3b9b4f3 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:02.707558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4899d5-ff12-4d36-a6a3-f073c2aa10aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:02.708171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4899d5-ff12-4d36-a6a3-f073c2aa10aa admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:02.708451 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4899d5-ff12-4d36-a6a3-f073c2aa10aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:02.708724 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4899d5-ff12-4d36-a6a3-f073c2aa10aa admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:02.709368 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4899d5-ff12-4d36-a6a3-f073c2aa10aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:02.711273 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4899d5-ff12-4d36-a6a3-f073c2aa10aa admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:02.858546 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1059/2113] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:56:02 2022] POST /identity/v3/projects => generated 375 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:02.862794 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255e093-9a87-4fa0-b72a-293b9ff8cd5d admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:02.872239 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4899d5-ff12-4d36-a6a3-f073c2aa10aa admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:02.874414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255e093-9a87-4fa0-b72a-293b9ff8cd5d admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:02.874538 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-7e4899d5-ff12-4d36-a6a3-f073c2aa10aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:02.978129 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4ee3d-27dc-470c-8a26-4a5d8de661c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:02.979765 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4ee3d-27dc-470c-8a26-4a5d8de661c3 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:02.980266 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4ee3d-27dc-470c-8a26-4a5d8de661c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:02.980692 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4ee3d-27dc-470c-8a26-4a5d8de661c3 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:02.981500 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4ee3d-27dc-470c-8a26-4a5d8de661c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:02.983654 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4ee3d-27dc-470c-8a26-4a5d8de661c3 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:02.997205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4899d5-ff12-4d36-a6a3-f073c2aa10aa admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:03.003471 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9cf575-0845-418b-a6c5-5a6b6628fb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:03.004263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cf575-0845-418b-a6c5-5a6b6628fb97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:03.004623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cf575-0845-418b-a6c5-5a6b6628fb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:03.004973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cf575-0845-418b-a6c5-5a6b6628fb97 admin admin] PATH_INFO: `/v3/projects/1942d216c3e84cd6ac046bc1c38e4305` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:03.006411 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9cf575-0845-418b-a6c5-5a6b6628fb97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1942d216c3e84cd6ac046bc1c38e4305)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:03.008801 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9cf575-0845-418b-a6c5-5a6b6628fb97 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:03.121334 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1055/2114] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:56:02 2022] POST /identity/v3/users => generated 288 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:03.122113 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4ee3d-27dc-470c-8a26-4a5d8de661c3 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:03.124057 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-17d4ee3d-27dc-470c-8a26-4a5d8de661c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:03.137514 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4ee3d-27dc-470c-8a26-4a5d8de661c3 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:03.145661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e135bb6-c062-48dc-9cd8-45c046debd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:03.147139 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e135bb6-c062-48dc-9cd8-45c046debd16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:03.147139 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e135bb6-c062-48dc-9cd8-45c046debd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:03.147139 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e135bb6-c062-48dc-9cd8-45c046debd16 admin admin] PATH_INFO: `/v3/projects/b136e985012943109fd1ed133341c3b2` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:03.148032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e135bb6-c062-48dc-9cd8-45c046debd16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b136e985012943109fd1ed133341c3b2)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:03.150089 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e135bb6-c062-48dc-9cd8-45c046debd16 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:03.159073 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-0f9cf575-0845-418b-a6c5-5a6b6628fb97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1942d216c3e84cd6ac046bc1c38e4305', 'request_id': 'req-0f9cf575-0845-418b-a6c5-5a6b6628fb97'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:03.165206 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-0f9cf575-0845-418b-a6c5-5a6b6628fb97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1942d216c3e84cd6ac046bc1c38e4305', 'request_id': 'req-0f9cf575-0845-418b-a6c5-5a6b6628fb97'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:03.278850 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-0f9cf575-0845-418b-a6c5-5a6b6628fb97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1942d216c3e84cd6ac046bc1c38e4305', 'request_id': 'req-0f9cf575-0845-418b-a6c5-5a6b6628fb97'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:03.298509 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-0f9cf575-0845-418b-a6c5-5a6b6628fb97 admin admin] The token cache is being invalidate because project 1942d216c3e84cd6ac046bc1c38e4305 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:56:03.299084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-0f9cf575-0845-418b-a6c5-5a6b6628fb97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:03.300835 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-0f9cf575-0845-418b-a6c5-5a6b6628fb97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:03.305745 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1060/2115] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:56:02 2022] DELETE /identity/v3/projects/1942d216c3e84cd6ac046bc1c38e4305 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:03.305745 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9cf575-0845-418b-a6c5-5a6b6628fb97 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:03.305745 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-0f9cf575-0845-418b-a6c5-5a6b6628fb97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:03.311498 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-7e135bb6-c062-48dc-9cd8-45c046debd16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b136e985012943109fd1ed133341c3b2', 'request_id': 'req-7e135bb6-c062-48dc-9cd8-45c046debd16'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:03.325586 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-7e135bb6-c062-48dc-9cd8-45c046debd16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b136e985012943109fd1ed133341c3b2', 'request_id': 'req-7e135bb6-c062-48dc-9cd8-45c046debd16'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:03.339655 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-7e135bb6-c062-48dc-9cd8-45c046debd16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b136e985012943109fd1ed133341c3b2', 'request_id': 'req-7e135bb6-c062-48dc-9cd8-45c046debd16'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:03.378864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:03.410215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9cf575-0845-418b-a6c5-5a6b6628fb97 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:03.482082 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79c9c5-cf5a-41ab-b798-3a8127cd9798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:03.482521 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79c9c5-cf5a-41ab-b798-3a8127cd9798 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:03.482725 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79c9c5-cf5a-41ab-b798-3a8127cd9798 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:03.483089 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79c9c5-cf5a-41ab-b798-3a8127cd9798 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:03.484183 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79c9c5-cf5a-41ab-b798-3a8127cd9798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:03.486279 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79c9c5-cf5a-41ab-b798-3a8127cd9798 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:03.501282 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1061/2116] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:03.501282 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3d6e3-d7d6-479d-8997-befcc69cb67c None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:03.501282 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3d6e3-d7d6-479d-8997-befcc69cb67c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:03.501282 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3d6e3-d7d6-479d-8997-befcc69cb67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:03.506834 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-7e135bb6-c062-48dc-9cd8-45c046debd16 admin admin] The token cache is being invalidate because project b136e985012943109fd1ed133341c3b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:56:03.508855 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-7e135bb6-c062-48dc-9cd8-45c046debd16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:03.511681 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-7e135bb6-c062-48dc-9cd8-45c046debd16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:03.513900 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1056/2117] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:56:03 2022] DELETE /identity/v3/projects/b136e985012943109fd1ed133341c3b2 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:03.514905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e135bb6-c062-48dc-9cd8-45c046debd16 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:03.516563 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-7e135bb6-c062-48dc-9cd8-45c046debd16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:03.531756 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-5ed3d6e3-d7d6-479d-8997-befcc69cb67c None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:03.533596 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-5ed3d6e3-d7d6-479d-8997-befcc69cb67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:03.536421 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e135bb6-c062-48dc-9cd8-45c046debd16 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:03.542694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592ac21-e854-4e2a-9641-421acbcbc310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:03.543749 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592ac21-e854-4e2a-9641-421acbcbc310 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:03.544221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592ac21-e854-4e2a-9641-421acbcbc310 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:03.544649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592ac21-e854-4e2a-9641-421acbcbc310 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:03.545546 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592ac21-e854-4e2a-9641-421acbcbc310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:03.547442 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592ac21-e854-4e2a-9641-421acbcbc310 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:03.551556 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1062/2118] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:03.556748 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26fa20-0d10-4edf-89bd-c90381706ec8 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:03.557064 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26fa20-0d10-4edf-89bd-c90381706ec8 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:03.557405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26fa20-0d10-4edf-89bd-c90381706ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:03.562640 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1057/2119] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:03.564036 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ccfa3-7893-4f55-bf1c-f16538553b6c None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:03.564321 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ccfa3-7893-4f55-bf1c-f16538553b6c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:03.564596 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ccfa3-7893-4f55-bf1c-f16538553b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:03.588351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-0b26fa20-0d10-4edf-89bd-c90381706ec8 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:03.591098 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-0b26fa20-0d10-4edf-89bd-c90381706ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:03.609858 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1063/2120] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:03.609858 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26fa20-0d10-4edf-89bd-c90381706ec8 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:03.620805 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26fa20-0d10-4edf-89bd-c90381706ec8 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:03.630073 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-3c7ccfa3-7893-4f55-bf1c-f16538553b6c None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:03.631494 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-3c7ccfa3-7893-4f55-bf1c-f16538553b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:03.642807 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5c01f-7178-436e-be15-3ce3e0b54a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:03.646266 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5c01f-7178-436e-be15-3ce3e0b54a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:03.646552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5c01f-7178-436e-be15-3ce3e0b54a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:03.646831 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5c01f-7178-436e-be15-3ce3e0b54a7d admin admin] PATH_INFO: `/v3/projects/5014ca06e1134ed790b6c1c21cf4d4d1/users/b67c878d42c94515a8a4ab613c170f02/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:03.665184 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1058/2121] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:03.667582 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6a1d5-67b1-4dab-8951-db1aa3ea7f59 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:03.667868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6a1d5-67b1-4dab-8951-db1aa3ea7f59 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:03.668136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6a1d5-67b1-4dab-8951-db1aa3ea7f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:03.669356 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d5c01f-7178-436e-be15-3ce3e0b54a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5014ca06e1134ed790b6c1c21cf4d4d1, user_id=b67c878d42c94515a8a4ab613c170f02, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:03.673709 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d5c01f-7178-436e-be15-3ce3e0b54a7d admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:03.702286 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-d8b6a1d5-67b1-4dab-8951-db1aa3ea7f59 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:03.703950 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-d8b6a1d5-67b1-4dab-8951-db1aa3ea7f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:03.715137 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1059/2122] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:03.716157 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6a1d5-67b1-4dab-8951-db1aa3ea7f59 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:03.728153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6a1d5-67b1-4dab-8951-db1aa3ea7f59 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:03.734425 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8eeb4c-fc7d-4ed5-848f-1ef0f906da6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:03.735393 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8eeb4c-fc7d-4ed5-848f-1ef0f906da6f admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:03.735905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8eeb4c-fc7d-4ed5-848f-1ef0f906da6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:03.736320 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8eeb4c-fc7d-4ed5-848f-1ef0f906da6f admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:03.737154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8eeb4c-fc7d-4ed5-848f-1ef0f906da6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:56:03.737697 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8eeb4c-fc7d-4ed5-848f-1ef0f906da6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:03.740141 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8eeb4c-fc7d-4ed5-848f-1ef0f906da6f admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:03.743205 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:03.756242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1060/2123] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:56:03.757171 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8eeb4c-fc7d-4ed5-848f-1ef0f906da6f admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:03.768291 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8eeb4c-fc7d-4ed5-848f-1ef0f906da6f admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:03.773812 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8a908-97e9-4738-8f84-7e606e7b4964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:03.774721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8a908-97e9-4738-8f84-7e606e7b4964 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:03.775144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8a908-97e9-4738-8f84-7e606e7b4964 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:03.775594 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8a908-97e9-4738-8f84-7e606e7b4964 admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:03.776493 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8a908-97e9-4738-8f84-7e606e7b4964 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:56:03.776960 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8a908-97e9-4738-8f84-7e606e7b4964 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:03.778771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8a908-97e9-4738-8f84-7e606e7b4964 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:03.791152 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1064/2124] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:56:03 2022] PUT /identity/v3/projects/5014ca06e1134ed790b6c1c21cf4d4d1/users/b67c878d42c94515a8a4ab613c170f02/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:03.793466 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5c01f-7178-436e-be15-3ce3e0b54a7d admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:03.805454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1061/2125] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:56:03.807105 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59124608-f027-4dc0-8170-d6f031f08904 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:03.807483 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59124608-f027-4dc0-8170-d6f031f08904 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:03.808442 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59124608-f027-4dc0-8170-d6f031f08904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:03.844402 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-59124608-f027-4dc0-8170-d6f031f08904 None None] MFA Rules not processed for user `b67c878d42c94515a8a4ab613c170f02`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:03.848428 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-59124608-f027-4dc0-8170-d6f031f08904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:03.876592 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5c01f-7178-436e-be15-3ce3e0b54a7d admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:03.885308 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eda031-a933-4e0c-9370-1db6452d843e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:03.885308 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eda031-a933-4e0c-9370-1db6452d843e admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:03.885308 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eda031-a933-4e0c-9370-1db6452d843e admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:03.885308 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eda031-a933-4e0c-9370-1db6452d843e admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:03.886025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eda031-a933-4e0c-9370-1db6452d843e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:03.888911 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eda031-a933-4e0c-9370-1db6452d843e admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:03.951454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1062/2126] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:03.952664 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59124608-f027-4dc0-8170-d6f031f08904 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:03.980642 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59124608-f027-4dc0-8170-d6f031f08904 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:03.987913 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de435a1-d56a-4879-8edb-663a2fee0e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:03.988547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de435a1-d56a-4879-8edb-663a2fee0e71 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:03.988874 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de435a1-d56a-4879-8edb-663a2fee0e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:03.989188 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de435a1-d56a-4879-8edb-663a2fee0e71 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:03.989828 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de435a1-d56a-4879-8edb-663a2fee0e71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:03.992127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de435a1-d56a-4879-8edb-663a2fee0e71 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:04.016073 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1065/2127] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:56:03 2022] POST /identity/v3/projects => generated 383 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:04.016073 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eda031-a933-4e0c-9370-1db6452d843e admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:04.018042 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-e4eda031-a933-4e0c-9370-1db6452d843e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:04.092815 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eda031-a933-4e0c-9370-1db6452d843e admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:04.097553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554d175-6373-455a-86f6-ad47050bf053 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:04.098797 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554d175-6373-455a-86f6-ad47050bf053 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:04.099084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554d175-6373-455a-86f6-ad47050bf053 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:04.099389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554d175-6373-455a-86f6-ad47050bf053 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:04.136741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1063/2128] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:56:03 2022] POST /identity/v3/projects => generated 391 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:04.137843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de435a1-d56a-4879-8edb-663a2fee0e71 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:04.227687 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554d175-6373-455a-86f6-ad47050bf053 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:04.228797 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554d175-6373-455a-86f6-ad47050bf053 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:04.240714 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1066/2129] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:56:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:56:04.241657 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554d175-6373-455a-86f6-ad47050bf053 service cinder] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:04.256576 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de435a1-d56a-4879-8edb-663a2fee0e71 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:04.264644 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b65964-593d-4072-8c19-3ba1eca90868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:04.265392 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b65964-593d-4072-8c19-3ba1eca90868 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:04.265843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b65964-593d-4072-8c19-3ba1eca90868 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:04.266280 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b65964-593d-4072-8c19-3ba1eca90868 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:04.272037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b65964-593d-4072-8c19-3ba1eca90868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:04.273695 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b65964-593d-4072-8c19-3ba1eca90868 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:04.366442 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554d175-6373-455a-86f6-ad47050bf053 service cinder] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:04.373797 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074ede2-f48f-4d1b-8756-84eeeb5cb668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:04.374533 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074ede2-f48f-4d1b-8756-84eeeb5cb668 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:04.374983 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074ede2-f48f-4d1b-8756-84eeeb5cb668 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:04.375265 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074ede2-f48f-4d1b-8756-84eeeb5cb668 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:04.376283 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074ede2-f48f-4d1b-8756-84eeeb5cb668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:04.378675 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074ede2-f48f-4d1b-8756-84eeeb5cb668 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:04.391452 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:04.396906 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1064/2130] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:56:04 2022] POST /identity/v3/users => generated 292 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:04.400508 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b65964-593d-4072-8c19-3ba1eca90868 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:04.404341 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c5b65964-593d-4072-8c19-3ba1eca90868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:04.419473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b65964-593d-4072-8c19-3ba1eca90868 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:04.425567 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ad82e-6742-4d40-8cc8-26fc4fd82ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:04.426231 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ad82e-6742-4d40-8cc8-26fc4fd82ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:04.426682 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ad82e-6742-4d40-8cc8-26fc4fd82ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:04.426987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ad82e-6742-4d40-8cc8-26fc4fd82ef8 admin admin] PATH_INFO: `/v3/users/90c2ce45096e4fb493314ad3af039724` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:04.428527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ad82e-6742-4d40-8cc8-26fc4fd82ef8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90c2ce45096e4fb493314ad3af039724)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:04.435800 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ad82e-6742-4d40-8cc8-26fc4fd82ef8 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:04.506246 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1067/2131] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:56:04 2022] POST /identity/v3/users => generated 296 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:04.507045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074ede2-f48f-4d1b-8756-84eeeb5cb668 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:04.525488 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074ede2-f48f-4d1b-8756-84eeeb5cb668 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:04.530948 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950171c5-12f2-435b-8a5a-11eef4c1709a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:04.531539 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950171c5-12f2-435b-8a5a-11eef4c1709a admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:04.531824 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950171c5-12f2-435b-8a5a-11eef4c1709a admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:04.532189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950171c5-12f2-435b-8a5a-11eef4c1709a admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:04.532847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950171c5-12f2-435b-8a5a-11eef4c1709a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:04.536212 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950171c5-12f2-435b-8a5a-11eef4c1709a admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:04.551996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1068/2132] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:04.551996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950171c5-12f2-435b-8a5a-11eef4c1709a admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:04.562712 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950171c5-12f2-435b-8a5a-11eef4c1709a admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:04.569611 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e1108-990c-45d2-9356-4f8bf3069818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:04.570515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e1108-990c-45d2-9356-4f8bf3069818 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:04.570884 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e1108-990c-45d2-9356-4f8bf3069818 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:04.571215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e1108-990c-45d2-9356-4f8bf3069818 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:04.573911 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e1108-990c-45d2-9356-4f8bf3069818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:04.573911 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e1108-990c-45d2-9356-4f8bf3069818 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:04.588163 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1069/2133] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:04.589895 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e1108-990c-45d2-9356-4f8bf3069818 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:04.604291 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e1108-990c-45d2-9356-4f8bf3069818 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:04.610674 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97953b2-9f01-48c3-8556-1be828887f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:04.611889 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97953b2-9f01-48c3-8556-1be828887f2d admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:04.611889 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97953b2-9f01-48c3-8556-1be828887f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:04.619571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97953b2-9f01-48c3-8556-1be828887f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:04.620789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97953b2-9f01-48c3-8556-1be828887f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:04.622740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97953b2-9f01-48c3-8556-1be828887f2d admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:04.639527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1070/2134] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:04.640451 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97953b2-9f01-48c3-8556-1be828887f2d admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:04.661693 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97953b2-9f01-48c3-8556-1be828887f2d admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:04.663856 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-569ad82e-6742-4d40-8cc8-26fc4fd82ef8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90c2ce45096e4fb493314ad3af039724'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:04.667939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-569ad82e-6742-4d40-8cc8-26fc4fd82ef8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90c2ce45096e4fb493314ad3af039724'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:04.670718 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a2ff1-d6e7-4315-b7c6-d0c9f84fcd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:04.671547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a2ff1-d6e7-4315-b7c6-d0c9f84fcd44 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:04.671906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a2ff1-d6e7-4315-b7c6-d0c9f84fcd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:04.672251 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a2ff1-d6e7-4315-b7c6-d0c9f84fcd44 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:04.673588 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a2ff1-d6e7-4315-b7c6-d0c9f84fcd44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:04.675338 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a2ff1-d6e7-4315-b7c6-d0c9f84fcd44 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:04.688287 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1071/2135] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:04.691990 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-569ad82e-6742-4d40-8cc8-26fc4fd82ef8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90c2ce45096e4fb493314ad3af039724'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:04.692283 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a2ff1-d6e7-4315-b7c6-d0c9f84fcd44 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:04.700854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-569ad82e-6742-4d40-8cc8-26fc4fd82ef8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90c2ce45096e4fb493314ad3af039724'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:04.712561 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a2ff1-d6e7-4315-b7c6-d0c9f84fcd44 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:04.718506 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66778c-5d78-42a2-b182-54c413301aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:04.719417 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66778c-5d78-42a2-b182-54c413301aac admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:04.719705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66778c-5d78-42a2-b182-54c413301aac admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:04.719979 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66778c-5d78-42a2-b182-54c413301aac admin admin] PATH_INFO: `/v3/projects/915256d5d3cc45e3a2a20a405e580f79/users/fd4a6e5632394a1bbda26bb821cf100b/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:04.738434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66778c-5d78-42a2-b182-54c413301aac admin admin] RBAC: Authorizing `identity:create_grant(project_id=915256d5d3cc45e3a2a20a405e580f79, user_id=fd4a6e5632394a1bbda26bb821cf100b, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:04.741676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66778c-5d78-42a2-b182-54c413301aac admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:04.755868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:04.873266 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-569ad82e-6742-4d40-8cc8-26fc4fd82ef8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90c2ce45096e4fb493314ad3af039724'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:04.880251 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1072/2136] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:56:04 2022] PUT /identity/v3/projects/915256d5d3cc45e3a2a20a405e580f79/users/fd4a6e5632394a1bbda26bb821cf100b/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:04.881434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66778c-5d78-42a2-b182-54c413301aac admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:04.883084 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1065/2137] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:56:04 2022] DELETE /identity/v3/users/90c2ce45096e4fb493314ad3af039724 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:04.891649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-cf66778c-5d78-42a2-b182-54c413301aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:04.893037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee96284-deae-4210-9175-6c7cf77e4416 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:04.893557 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee96284-deae-4210-9175-6c7cf77e4416 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:04.894013 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee96284-deae-4210-9175-6c7cf77e4416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:04.904477 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:04.946151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-aee96284-deae-4210-9175-6c7cf77e4416 None None] MFA Rules not processed for user `fd4a6e5632394a1bbda26bb821cf100b`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:04.947886 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-aee96284-deae-4210-9175-6c7cf77e4416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:05.017102 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66778c-5d78-42a2-b182-54c413301aac admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:05.058960 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1066/2138] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:56:05.064709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee96284-deae-4210-9175-6c7cf77e4416 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:05.067107 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-aee96284-deae-4210-9175-6c7cf77e4416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:05.109664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c197266-596d-4229-bc0e-325bd95887a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:05.111129 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c197266-596d-4229-bc0e-325bd95887a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:05.111553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c197266-596d-4229-bc0e-325bd95887a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:05.111947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c197266-596d-4229-bc0e-325bd95887a6 admin admin] PATH_INFO: `/v3/projects/178c3f2dfab54a108644daa8c8303d7f/users/33d5b1e46dba412e89409a81c40defc8/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:05.141980 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c197266-596d-4229-bc0e-325bd95887a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=178c3f2dfab54a108644daa8c8303d7f, user_id=33d5b1e46dba412e89409a81c40defc8, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:05.141980 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c197266-596d-4229-bc0e-325bd95887a6 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:05.184890 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee96284-deae-4210-9175-6c7cf77e4416 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:05.194990 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2139cfa-6191-4200-a625-f94bd892c833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:05.195792 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2139cfa-6191-4200-a625-f94bd892c833 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:05.196221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2139cfa-6191-4200-a625-f94bd892c833 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:05.196566 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2139cfa-6191-4200-a625-f94bd892c833 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:05.197285 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2139cfa-6191-4200-a625-f94bd892c833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:05.199324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2139cfa-6191-4200-a625-f94bd892c833 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:05.246155 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1073/2139] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:56:04 2022] PUT /identity/v3/projects/178c3f2dfab54a108644daa8c8303d7f/users/33d5b1e46dba412e89409a81c40defc8/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:05.261671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f695caf-12c8-4e43-aaa1-0a2323aef76d None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:05.261671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f695caf-12c8-4e43-aaa1-0a2323aef76d None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:05.261671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f695caf-12c8-4e43-aaa1-0a2323aef76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:05.311450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-7f695caf-12c8-4e43-aaa1-0a2323aef76d None None] MFA Rules not processed for user `33d5b1e46dba412e89409a81c40defc8`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:05.312099 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-7f695caf-12c8-4e43-aaa1-0a2323aef76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:05.314942 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1067/2140] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:56:05 2022] POST /identity/v3/projects => generated 381 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:56:05.316143 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2139cfa-6191-4200-a625-f94bd892c833 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:05.395966 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1074/2141] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:05.400795 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f695caf-12c8-4e43-aaa1-0a2323aef76d None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:05.402895 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2139cfa-6191-4200-a625-f94bd892c833 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:05.413149 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cd29d-56fe-494c-b16b-87f3d1a13930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:05.414272 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cd29d-56fe-494c-b16b-87f3d1a13930 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:05.414600 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cd29d-56fe-494c-b16b-87f3d1a13930 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:05.415238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cd29d-56fe-494c-b16b-87f3d1a13930 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:05.416195 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cd29d-56fe-494c-b16b-87f3d1a13930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:05.419638 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cd29d-56fe-494c-b16b-87f3d1a13930 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:05.424638 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f695caf-12c8-4e43-aaa1-0a2323aef76d None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:05.436520 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af26e79-ec2b-4fd9-8669-ef8faf3820e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:05.437794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af26e79-ec2b-4fd9-8669-ef8faf3820e2 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:05.438937 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af26e79-ec2b-4fd9-8669-ef8faf3820e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:05.439403 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af26e79-ec2b-4fd9-8669-ef8faf3820e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:05.439968 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af26e79-ec2b-4fd9-8669-ef8faf3820e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:05.443659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af26e79-ec2b-4fd9-8669-ef8faf3820e2 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:05.536444 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1068/2142] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:56:05 2022] POST /identity/v3/users => generated 297 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:05.537337 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cd29d-56fe-494c-b16b-87f3d1a13930 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:05.540075 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-bf5cd29d-56fe-494c-b16b-87f3d1a13930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:05.559081 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cd29d-56fe-494c-b16b-87f3d1a13930 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:05.564146 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1075/2143] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:56:05 2022] POST /identity/v3/projects => generated 393 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:05.565321 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af26e79-ec2b-4fd9-8669-ef8faf3820e2 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:05.567585 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f6ca4-4270-4d0f-91f5-acc3c21a80a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:05.568280 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f6ca4-4270-4d0f-91f5-acc3c21a80a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:05.568872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f6ca4-4270-4d0f-91f5-acc3c21a80a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:05.569163 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f6ca4-4270-4d0f-91f5-acc3c21a80a9 admin admin] PATH_INFO: `/v3/projects/32099e5371e84253afb8de38c9c06a82` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:05.570424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f6ca4-4270-4d0f-91f5-acc3c21a80a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32099e5371e84253afb8de38c9c06a82)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:05.572080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:05.572616 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f6ca4-4270-4d0f-91f5-acc3c21a80a9 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:05.633997 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:05.639947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af26e79-ec2b-4fd9-8669-ef8faf3820e2 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:05.644839 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1d9ec-21ab-42a1-a535-dbf383958a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:05.645703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1d9ec-21ab-42a1-a535-dbf383958a6f admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:05.645994 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1d9ec-21ab-42a1-a535-dbf383958a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:05.646265 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1d9ec-21ab-42a1-a535-dbf383958a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:05.646970 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1d9ec-21ab-42a1-a535-dbf383958a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:05.648624 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1d9ec-21ab-42a1-a535-dbf383958a6f admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:05.659765 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1076/2144] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:05.660714 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1d9ec-21ab-42a1-a535-dbf383958a6f admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:05.673172 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1d9ec-21ab-42a1-a535-dbf383958a6f admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:05.678293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66689b-70a7-4cd0-a237-f1a5ae7a3688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:05.678916 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66689b-70a7-4cd0-a237-f1a5ae7a3688 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:05.679184 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66689b-70a7-4cd0-a237-f1a5ae7a3688 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:05.679499 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66689b-70a7-4cd0-a237-f1a5ae7a3688 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:05.680136 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66689b-70a7-4cd0-a237-f1a5ae7a3688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:05.682061 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66689b-70a7-4cd0-a237-f1a5ae7a3688 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:05.731523 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-632f6ca4-4270-4d0f-91f5-acc3c21a80a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32099e5371e84253afb8de38c9c06a82', 'request_id': 'req-632f6ca4-4270-4d0f-91f5-acc3c21a80a9'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:05.737263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-632f6ca4-4270-4d0f-91f5-acc3c21a80a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32099e5371e84253afb8de38c9c06a82', 'request_id': 'req-632f6ca4-4270-4d0f-91f5-acc3c21a80a9'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:05.744854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-632f6ca4-4270-4d0f-91f5-acc3c21a80a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32099e5371e84253afb8de38c9c06a82', 'request_id': 'req-632f6ca4-4270-4d0f-91f5-acc3c21a80a9'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:05.828161 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-632f6ca4-4270-4d0f-91f5-acc3c21a80a9 admin admin] The token cache is being invalidate because project 32099e5371e84253afb8de38c9c06a82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:56:05.828370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1077/2145] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:56:05 2022] POST /identity/v3/users => generated 303 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:05.828488 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-632f6ca4-4270-4d0f-91f5-acc3c21a80a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:05.829118 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66689b-70a7-4cd0-a237-f1a5ae7a3688 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:05.831616 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-632f6ca4-4270-4d0f-91f5-acc3c21a80a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:05.833160 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1069/2146] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:56:05 2022] DELETE /identity/v3/projects/32099e5371e84253afb8de38c9c06a82 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:05.839679 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f6ca4-4270-4d0f-91f5-acc3c21a80a9 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:05.839679 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-632f6ca4-4270-4d0f-91f5-acc3c21a80a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:05.849646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66689b-70a7-4cd0-a237-f1a5ae7a3688 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:05.904205 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f6ca4-4270-4d0f-91f5-acc3c21a80a9 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:05.908848 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28b32d-04b6-497f-9fab-cdd10b1b4877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:05.909025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e5580-65b1-4643-8265-d3ed416b7ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:05.909513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28b32d-04b6-497f-9fab-cdd10b1b4877 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:05.909612 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e5580-65b1-4643-8265-d3ed416b7ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:05.909840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e5580-65b1-4643-8265-d3ed416b7ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:05.909946 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28b32d-04b6-497f-9fab-cdd10b1b4877 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:05.910062 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e5580-65b1-4643-8265-d3ed416b7ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:05.910150 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28b32d-04b6-497f-9fab-cdd10b1b4877 admin admin] PATH_INFO: `/v3/projects/04c55c2b11ff49ca8dfdda9c2a69016e/users/fe12f4e289fd4a0eb2add5fe6d0dfdbe/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:05.910710 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e5580-65b1-4643-8265-d3ed416b7ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:05.912535 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e5580-65b1-4643-8265-d3ed416b7ec6 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:05.922843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1070/2147] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:05.924124 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88fd05-6ff4-4fbc-baf3-65395de0f5c7 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:05.924405 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88fd05-6ff4-4fbc-baf3-65395de0f5c7 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:05.924674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88fd05-6ff4-4fbc-baf3-65395de0f5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:05.925365 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28b32d-04b6-497f-9fab-cdd10b1b4877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04c55c2b11ff49ca8dfdda9c2a69016e, user_id=fe12f4e289fd4a0eb2add5fe6d0dfdbe, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:05.928467 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28b32d-04b6-497f-9fab-cdd10b1b4877 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:05.945531 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-2b88fd05-6ff4-4fbc-baf3-65395de0f5c7 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:05.946737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-2b88fd05-6ff4-4fbc-baf3-65395de0f5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:05.955286 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1071/2148] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:05.956095 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88fd05-6ff4-4fbc-baf3-65395de0f5c7 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:05.969623 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88fd05-6ff4-4fbc-baf3-65395de0f5c7 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:05.974461 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9b581-101c-4779-b096-c13023a5b342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:05.975098 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9b581-101c-4779-b096-c13023a5b342 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:05.975423 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9b581-101c-4779-b096-c13023a5b342 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:05.975697 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9b581-101c-4779-b096-c13023a5b342 admin admin] PATH_INFO: `/v3/projects/76123e1f73454df6945798e9738b9d62/users/e6039d5f46bb462583d175f4bf3a4b08/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:05.990792 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9b581-101c-4779-b096-c13023a5b342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76123e1f73454df6945798e9738b9d62, user_id=e6039d5f46bb462583d175f4bf3a4b08, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:05.993857 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9b581-101c-4779-b096-c13023a5b342 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:06.070293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1078/2149] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:56:05 2022] PUT /identity/v3/projects/04c55c2b11ff49ca8dfdda9c2a69016e/users/fe12f4e289fd4a0eb2add5fe6d0dfdbe/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:06.071799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d1f51-2387-4e25-82e1-ce594419117c None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:06.072228 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d1f51-2387-4e25-82e1-ce594419117c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:06.072581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d1f51-2387-4e25-82e1-ce594419117c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:06.094838 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-088d1f51-2387-4e25-82e1-ce594419117c None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:06.096113 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-088d1f51-2387-4e25-82e1-ce594419117c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:06.123728 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1072/2150] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:56:05 2022] PUT /identity/v3/projects/76123e1f73454df6945798e9738b9d62/users/e6039d5f46bb462583d175f4bf3a4b08/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:06.126264 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9b581-101c-4779-b096-c13023a5b342 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:06.129493 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-7cd9b581-101c-4779-b096-c13023a5b342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:06.166826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1079/2151] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:06.167763 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d1f51-2387-4e25-82e1-ce594419117c None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:06.178293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d1f51-2387-4e25-82e1-ce594419117c None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:06.208760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9b581-101c-4779-b096-c13023a5b342 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:06.214081 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90000e-03e3-451a-8268-b1c5e3c58a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:06.214702 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90000e-03e3-451a-8268-b1c5e3c58a71 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:06.214984 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90000e-03e3-451a-8268-b1c5e3c58a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:06.215260 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90000e-03e3-451a-8268-b1c5e3c58a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:06.215959 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90000e-03e3-451a-8268-b1c5e3c58a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:06.217634 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90000e-03e3-451a-8268-b1c5e3c58a71 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:06.236434 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1073/2152] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:06.236434 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90000e-03e3-451a-8268-b1c5e3c58a71 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:06.249191 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90000e-03e3-451a-8268-b1c5e3c58a71 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:06.259494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bebc1c-e5ef-48a9-95ab-5bbf57b7c195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:06.259494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bebc1c-e5ef-48a9-95ab-5bbf57b7c195 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:06.259494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bebc1c-e5ef-48a9-95ab-5bbf57b7c195 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:06.259494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bebc1c-e5ef-48a9-95ab-5bbf57b7c195 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:06.260016 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bebc1c-e5ef-48a9-95ab-5bbf57b7c195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:06.260016 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bebc1c-e5ef-48a9-95ab-5bbf57b7c195 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:06.260151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b9a5a-af89-4bb9-8977-eca9948aedcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:06.260151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b9a5a-af89-4bb9-8977-eca9948aedcf admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:06.260151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b9a5a-af89-4bb9-8977-eca9948aedcf admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:06.260151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b9a5a-af89-4bb9-8977-eca9948aedcf admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:06.260396 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b9a5a-af89-4bb9-8977-eca9948aedcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:56:06.260396 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b9a5a-af89-4bb9-8977-eca9948aedcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:06.262046 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b9a5a-af89-4bb9-8977-eca9948aedcf admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:06.265718 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1080/2153] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:06.267481 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bebc1c-e5ef-48a9-95ab-5bbf57b7c195 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:06.279875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bebc1c-e5ef-48a9-95ab-5bbf57b7c195 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:06.280005 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1074/2154] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:56:06.281009 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b9a5a-af89-4bb9-8977-eca9948aedcf admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:06.287795 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ea406-8787-492a-9b4c-257571c343d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:06.287795 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ea406-8787-492a-9b4c-257571c343d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:06.287795 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ea406-8787-492a-9b4c-257571c343d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:06.287795 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ea406-8787-492a-9b4c-257571c343d1 admin admin] PATH_INFO: `/v3/projects/04c55c2b11ff49ca8dfdda9c2a69016e/users/fe12f4e289fd4a0eb2add5fe6d0dfdbe/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:06.290549 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ea406-8787-492a-9b4c-257571c343d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04c55c2b11ff49ca8dfdda9c2a69016e, user_id=fe12f4e289fd4a0eb2add5fe6d0dfdbe, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:06.294793 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ea406-8787-492a-9b4c-257571c343d1 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:06.299065 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b9a5a-af89-4bb9-8977-eca9948aedcf admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:06.305147 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafd13a-4150-46aa-9d2c-52703795e035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:06.305972 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafd13a-4150-46aa-9d2c-52703795e035 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:06.306155 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafd13a-4150-46aa-9d2c-52703795e035 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:06.306423 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafd13a-4150-46aa-9d2c-52703795e035 admin admin] PATH_INFO: `/v3/projects/76123e1f73454df6945798e9738b9d62/users/e6039d5f46bb462583d175f4bf3a4b08/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:06.309265 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafd13a-4150-46aa-9d2c-52703795e035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76123e1f73454df6945798e9738b9d62, user_id=e6039d5f46bb462583d175f4bf3a4b08, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:06.312272 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafd13a-4150-46aa-9d2c-52703795e035 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:06.316241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1081/2155] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:56:06 2022] PUT /identity/v3/projects/04c55c2b11ff49ca8dfdda9c2a69016e/users/fe12f4e289fd4a0eb2add5fe6d0dfdbe/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:06.317092 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ea406-8787-492a-9b4c-257571c343d1 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:06.334266 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1075/2156] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:56:06 2022] PUT /identity/v3/projects/76123e1f73454df6945798e9738b9d62/users/e6039d5f46bb462583d175f4bf3a4b08/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:06.335190 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d729b-f41f-42f2-9ed1-a4b798a49244 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:06.335533 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d729b-f41f-42f2-9ed1-a4b798a49244 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:06.337881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d729b-f41f-42f2-9ed1-a4b798a49244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:06.370947 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-d72d729b-f41f-42f2-9ed1-a4b798a49244 None None] MFA Rules not processed for user `fe12f4e289fd4a0eb2add5fe6d0dfdbe`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:06.372211 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-d72d729b-f41f-42f2-9ed1-a4b798a49244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:06.395271 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ea406-8787-492a-9b4c-257571c343d1 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:06.451899 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1076/2157] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:06.453648 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657c5e3-42e6-44dd-91cf-699b563a80b9 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:06.454088 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657c5e3-42e6-44dd-91cf-699b563a80b9 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:06.454741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657c5e3-42e6-44dd-91cf-699b563a80b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:06.457644 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ec1ea-e77d-44ab-9b12-92cb7363d00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:06.458295 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ec1ea-e77d-44ab-9b12-92cb7363d00c admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:06.458579 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ec1ea-e77d-44ab-9b12-92cb7363d00c admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:06.459090 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ec1ea-e77d-44ab-9b12-92cb7363d00c admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:06.459656 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ec1ea-e77d-44ab-9b12-92cb7363d00c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:06.461528 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ec1ea-e77d-44ab-9b12-92cb7363d00c admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:06.491228 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-b657c5e3-42e6-44dd-91cf-699b563a80b9 None None] MFA Rules not processed for user `e6039d5f46bb462583d175f4bf3a4b08`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:06.492476 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b657c5e3-42e6-44dd-91cf-699b563a80b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:06.550394 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:06.564707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1077/2158] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:06 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:06.565659 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657c5e3-42e6-44dd-91cf-699b563a80b9 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:06.566985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b657c5e3-42e6-44dd-91cf-699b563a80b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:06.592764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1082/2159] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:56:06 2022] POST /identity/v3/projects => generated 387 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:06.597960 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ec1ea-e77d-44ab-9b12-92cb7363d00c admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:06.659308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657c5e3-42e6-44dd-91cf-699b563a80b9 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:06.676340 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ec1ea-e77d-44ab-9b12-92cb7363d00c admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:06.687508 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8d0fc-4af8-4d47-afcf-d36f41ee2ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:06.688133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8d0fc-4af8-4d47-afcf-d36f41ee2ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:06.688414 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8d0fc-4af8-4d47-afcf-d36f41ee2ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:06.688718 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8d0fc-4af8-4d47-afcf-d36f41ee2ca3 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:06.689887 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8d0fc-4af8-4d47-afcf-d36f41ee2ca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:06.691643 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8d0fc-4af8-4d47-afcf-d36f41ee2ca3 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:06.741726 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ed924-c5e5-4a16-8298-b6a7d35ea6e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:06.742757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ed924-c5e5-4a16-8298-b6a7d35ea6e3 service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:06.743321 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ed924-c5e5-4a16-8298-b6a7d35ea6e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:06.743930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ed924-c5e5-4a16-8298-b6a7d35ea6e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:06.841252 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1083/2160] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:56:06 2022] POST /identity/v3/users => generated 294 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:06.842115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8d0fc-4af8-4d47-afcf-d36f41ee2ca3 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:06.844194 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ed924-c5e5-4a16-8298-b6a7d35ea6e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:06.845923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ed924-c5e5-4a16-8298-b6a7d35ea6e3 service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:06.846698 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-35c8d0fc-4af8-4d47-afcf-d36f41ee2ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:06.870924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8d0fc-4af8-4d47-afcf-d36f41ee2ca3 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:06.872578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1078/2161] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:56:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:56:06.873394 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ed924-c5e5-4a16-8298-b6a7d35ea6e3 service cinder] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:06.877606 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cb7ef-2f63-4fe4-adcf-325dad3e409f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:06.890500 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cb7ef-2f63-4fe4-adcf-325dad3e409f service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:06.890898 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cb7ef-2f63-4fe4-adcf-325dad3e409f service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:06.891252 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cb7ef-2f63-4fe4-adcf-325dad3e409f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:06.895461 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ed924-c5e5-4a16-8298-b6a7d35ea6e3 service cinder] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:06.919875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2ea71-bbb7-4017-b23d-f4e75197e1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:06.920491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2ea71-bbb7-4017-b23d-f4e75197e1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:06.920767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2ea71-bbb7-4017-b23d-f4e75197e1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:06.921043 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2ea71-bbb7-4017-b23d-f4e75197e1e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:06.921694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2ea71-bbb7-4017-b23d-f4e75197e1e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:06.926330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2ea71-bbb7-4017-b23d-f4e75197e1e3 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:06.943762 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1079/2162] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:06.947452 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2ea71-bbb7-4017-b23d-f4e75197e1e3 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:06.958299 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2ea71-bbb7-4017-b23d-f4e75197e1e3 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:06.967654 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f2e1a-6ba1-4192-bace-e61d805c857b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:06.968377 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f2e1a-6ba1-4192-bace-e61d805c857b admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:06.968693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f2e1a-6ba1-4192-bace-e61d805c857b admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:06.968963 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f2e1a-6ba1-4192-bace-e61d805c857b admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:06.970600 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f2e1a-6ba1-4192-bace-e61d805c857b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:06.972255 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f2e1a-6ba1-4192-bace-e61d805c857b admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:07.003596 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1080/2163] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 13:56:07.006877 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f2e1a-6ba1-4192-bace-e61d805c857b admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:07.008188 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cb7ef-2f63-4fe4-adcf-325dad3e409f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:07.009632 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cb7ef-2f63-4fe4-adcf-325dad3e409f service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:07.018803 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:07.023056 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1084/2164] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:56:06 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:56:07.023526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f2e1a-6ba1-4192-bace-e61d805c857b admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:07.031851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a254c1-acca-40a3-8f96-54a24f84df32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:07.032265 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a254c1-acca-40a3-8f96-54a24f84df32 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:07.032414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a254c1-acca-40a3-8f96-54a24f84df32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:07.032691 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a254c1-acca-40a3-8f96-54a24f84df32 admin admin] PATH_INFO: `/v3/projects/a5ccb0fe770a41e99a822a6d4f88d401/users/658108c26fb74eba911e249819f8b290/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:07.050274 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a254c1-acca-40a3-8f96-54a24f84df32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ccb0fe770a41e99a822a6d4f88d401, user_id=658108c26fb74eba911e249819f8b290, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:07.053075 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a254c1-acca-40a3-8f96-54a24f84df32 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:07.079559 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cb7ef-2f63-4fe4-adcf-325dad3e409f service cinder] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:07.090324 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cb7ef-2f63-4fe4-adcf-325dad3e409f service cinder] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:07.094241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e5b56-dc0e-4fb1-a9a1-79907e25930c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:07.094855 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e5b56-dc0e-4fb1-a9a1-79907e25930c service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:07.095137 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e5b56-dc0e-4fb1-a9a1-79907e25930c service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:07.095439 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e5b56-dc0e-4fb1-a9a1-79907e25930c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:07.097208 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-f78e5b56-dc0e-4fb1-a9a1-79907e25930c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:07.170807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1081/2165] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:56:07 2022] PUT /identity/v3/projects/a5ccb0fe770a41e99a822a6d4f88d401/users/658108c26fb74eba911e249819f8b290/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:56:07.172796 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a254c1-acca-40a3-8f96-54a24f84df32 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:07.251848 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a254c1-acca-40a3-8f96-54a24f84df32 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:07.254552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:07.255964 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223bdde-0fb2-465e-94ca-087635eeb1c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:07.256644 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223bdde-0fb2-465e-94ca-087635eeb1c4 service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:07.256935 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223bdde-0fb2-465e-94ca-087635eeb1c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:07.257217 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223bdde-0fb2-465e-94ca-087635eeb1c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:07.259064 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-7223bdde-0fb2-465e-94ca-087635eeb1c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:07.299062 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e5b56-dc0e-4fb1-a9a1-79907e25930c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:07.300550 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e5b56-dc0e-4fb1-a9a1-79907e25930c service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:07.312425 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1085/2166] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:56:07 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 13:56:07.314121 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3f0da-1572-4395-8368-42afcce3ed60 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:07.314415 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3f0da-1572-4395-8368-42afcce3ed60 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:07.314747 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3f0da-1572-4395-8368-42afcce3ed60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:07.322240 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223bdde-0fb2-465e-94ca-087635eeb1c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:07.323956 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223bdde-0fb2-465e-94ca-087635eeb1c4 service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:07.335109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1082/2167] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:56:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:56:07.340726 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-c4f3f0da-1572-4395-8368-42afcce3ed60 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:07.341932 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c4f3f0da-1572-4395-8368-42afcce3ed60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:07.411657 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1086/2168] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:07.422678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223bdde-0fb2-465e-94ca-087635eeb1c4 service cinder] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:07.424024 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-7223bdde-0fb2-465e-94ca-087635eeb1c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:07.495442 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223bdde-0fb2-465e-94ca-087635eeb1c4 service cinder] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:07.496353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194da2ba-5771-4d00-9c38-8640f5f5858e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:07.496968 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194da2ba-5771-4d00-9c38-8640f5f5858e service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:07.497251 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194da2ba-5771-4d00-9c38-8640f5f5858e service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:07.497526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194da2ba-5771-4d00-9c38-8640f5f5858e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:07.507818 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194da2ba-5771-4d00-9c38-8640f5f5858e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:07.509534 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194da2ba-5771-4d00-9c38-8640f5f5858e service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:07.521033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1083/2169] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:56:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 13:56:07.837084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3f0da-1572-4395-8368-42afcce3ed60 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:07.851809 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3f0da-1572-4395-8368-42afcce3ed60 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:07.856933 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e3589-7676-4c6b-be08-610a7cc11f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:07.857689 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e3589-7676-4c6b-be08-610a7cc11f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:07.857848 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e3589-7676-4c6b-be08-610a7cc11f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:07.858123 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e3589-7676-4c6b-be08-610a7cc11f78 admin admin] PATH_INFO: `/v3/users/fd4a6e5632394a1bbda26bb821cf100b` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:07.859653 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e3589-7676-4c6b-be08-610a7cc11f78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd4a6e5632394a1bbda26bb821cf100b)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:07.861624 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e3589-7676-4c6b-be08-610a7cc11f78 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:08.060027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:08.112204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-4d9e3589-7676-4c6b-be08-610a7cc11f78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd4a6e5632394a1bbda26bb821cf100b'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:08.185193 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:08.224576 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-4d9e3589-7676-4c6b-be08-610a7cc11f78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd4a6e5632394a1bbda26bb821cf100b'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:08.234602 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-4d9e3589-7676-4c6b-be08-610a7cc11f78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd4a6e5632394a1bbda26bb821cf100b'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:08.273808 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-4d9e3589-7676-4c6b-be08-610a7cc11f78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd4a6e5632394a1bbda26bb821cf100b'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:08.278295 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-4d9e3589-7676-4c6b-be08-610a7cc11f78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd4a6e5632394a1bbda26bb821cf100b'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:08.283112 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1087/2170] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:56:07 2022] DELETE /identity/v3/users/fd4a6e5632394a1bbda26bb821cf100b => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:08.287832 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f1008-1ff0-4198-9e98-3363c310a922 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:08.288112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f1008-1ff0-4198-9e98-3363c310a922 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:08.288964 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f1008-1ff0-4198-9e98-3363c310a922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:08.309468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-ee1f1008-1ff0-4198-9e98-3363c310a922 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:08.311017 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-ee1f1008-1ff0-4198-9e98-3363c310a922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:08.376301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1084/2171] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:08.389536 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e3589-7676-4c6b-be08-610a7cc11f78 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:08.391627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-4d9e3589-7676-4c6b-be08-610a7cc11f78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:08.457201 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e3589-7676-4c6b-be08-610a7cc11f78 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:08.460938 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62902435-3ddd-4f3a-9caa-4b1650b7adf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:08.461606 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62902435-3ddd-4f3a-9caa-4b1650b7adf4 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:08.461884 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62902435-3ddd-4f3a-9caa-4b1650b7adf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:08.462156 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62902435-3ddd-4f3a-9caa-4b1650b7adf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:08.472066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62902435-3ddd-4f3a-9caa-4b1650b7adf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:08.473778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62902435-3ddd-4f3a-9caa-4b1650b7adf4 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:08.484649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1088/2172] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:56:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:56:08.991885 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f1008-1ff0-4198-9e98-3363c310a922 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:08.993316 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-ee1f1008-1ff0-4198-9e98-3363c310a922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:09.011618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f1008-1ff0-4198-9e98-3363c310a922 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:09.016937 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68306eb2-d1be-4c7b-a192-549e5a250db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:09.017110 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68306eb2-d1be-4c7b-a192-549e5a250db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:09.017421 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68306eb2-d1be-4c7b-a192-549e5a250db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:09.017702 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68306eb2-d1be-4c7b-a192-549e5a250db2 admin admin] PATH_INFO: `/v3/projects/915256d5d3cc45e3a2a20a405e580f79` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:09.018843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68306eb2-d1be-4c7b-a192-549e5a250db2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=915256d5d3cc45e3a2a20a405e580f79)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:09.020874 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68306eb2-d1be-4c7b-a192-549e5a250db2 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:09.065322 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:09.135702 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-68306eb2-d1be-4c7b-a192-549e5a250db2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '915256d5d3cc45e3a2a20a405e580f79', 'request_id': 'req-68306eb2-d1be-4c7b-a192-549e5a250db2'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:09.141210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-68306eb2-d1be-4c7b-a192-549e5a250db2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '915256d5d3cc45e3a2a20a405e580f79', 'request_id': 'req-68306eb2-d1be-4c7b-a192-549e5a250db2'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:09.147673 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-68306eb2-d1be-4c7b-a192-549e5a250db2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '915256d5d3cc45e3a2a20a405e580f79', 'request_id': 'req-68306eb2-d1be-4c7b-a192-549e5a250db2'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:09.241679 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-68306eb2-d1be-4c7b-a192-549e5a250db2 admin admin] The token cache is being invalidate because project 915256d5d3cc45e3a2a20a405e580f79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:56:09.242322 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-68306eb2-d1be-4c7b-a192-549e5a250db2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:09.242621 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-68306eb2-d1be-4c7b-a192-549e5a250db2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:09.244273 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1085/2173] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:56:08 2022] DELETE /identity/v3/projects/915256d5d3cc45e3a2a20a405e580f79 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:56:09.248298 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62902435-3ddd-4f3a-9caa-4b1650b7adf4 service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:09.259977 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62902435-3ddd-4f3a-9caa-4b1650b7adf4 service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:09.353752 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f033e2-8e15-4928-a067-e58536b02ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:09.355390 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f033e2-8e15-4928-a067-e58536b02ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:09.355776 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f033e2-8e15-4928-a067-e58536b02ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:09.356723 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f033e2-8e15-4928-a067-e58536b02ddd admin admin] PATH_INFO: `/v3/users/fe12f4e289fd4a0eb2add5fe6d0dfdbe` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:09.358162 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f033e2-8e15-4928-a067-e58536b02ddd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe12f4e289fd4a0eb2add5fe6d0dfdbe)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:09.360867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f033e2-8e15-4928-a067-e58536b02ddd admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:09.362671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:09.578293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-32f033e2-8e15-4928-a067-e58536b02ddd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe12f4e289fd4a0eb2add5fe6d0dfdbe'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:09.638325 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-32f033e2-8e15-4928-a067-e58536b02ddd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe12f4e289fd4a0eb2add5fe6d0dfdbe'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:09.648168 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-32f033e2-8e15-4928-a067-e58536b02ddd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe12f4e289fd4a0eb2add5fe6d0dfdbe'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:09.663520 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-32f033e2-8e15-4928-a067-e58536b02ddd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe12f4e289fd4a0eb2add5fe6d0dfdbe'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:09.664527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-32f033e2-8e15-4928-a067-e58536b02ddd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe12f4e289fd4a0eb2add5fe6d0dfdbe'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:09.674660 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1089/2174] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:56:09 2022] DELETE /identity/v3/users/fe12f4e289fd4a0eb2add5fe6d0dfdbe => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:09.993559 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:10.204754 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68306eb2-d1be-4c7b-a192-549e5a250db2 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:10.207769 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-68306eb2-d1be-4c7b-a192-549e5a250db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:10.223390 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68306eb2-d1be-4c7b-a192-549e5a250db2 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:10.318013 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fc62d-f59b-474f-b9c4-e0e82e1a2489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:10.318678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fc62d-f59b-474f-b9c4-e0e82e1a2489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:10.318936 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fc62d-f59b-474f-b9c4-e0e82e1a2489 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:10.319207 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fc62d-f59b-474f-b9c4-e0e82e1a2489 admin admin] PATH_INFO: `/v3/projects/04c55c2b11ff49ca8dfdda9c2a69016e` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:10.320390 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fc62d-f59b-474f-b9c4-e0e82e1a2489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04c55c2b11ff49ca8dfdda9c2a69016e)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:10.322326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fc62d-f59b-474f-b9c4-e0e82e1a2489 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:10.482914 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-899fc62d-f59b-474f-b9c4-e0e82e1a2489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04c55c2b11ff49ca8dfdda9c2a69016e', 'request_id': 'req-899fc62d-f59b-474f-b9c4-e0e82e1a2489'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:10.489922 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-899fc62d-f59b-474f-b9c4-e0e82e1a2489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04c55c2b11ff49ca8dfdda9c2a69016e', 'request_id': 'req-899fc62d-f59b-474f-b9c4-e0e82e1a2489'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:10.499031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-899fc62d-f59b-474f-b9c4-e0e82e1a2489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04c55c2b11ff49ca8dfdda9c2a69016e', 'request_id': 'req-899fc62d-f59b-474f-b9c4-e0e82e1a2489'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:10.619276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-899fc62d-f59b-474f-b9c4-e0e82e1a2489 admin admin] The token cache is being invalidate because project 04c55c2b11ff49ca8dfdda9c2a69016e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:56:10.621915 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-899fc62d-f59b-474f-b9c4-e0e82e1a2489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:10.622659 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-899fc62d-f59b-474f-b9c4-e0e82e1a2489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:10.627642 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1086/2175] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:56:10 2022] DELETE /identity/v3/projects/04c55c2b11ff49ca8dfdda9c2a69016e => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:10.629940 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63460e-1c72-4214-8d90-a0d56e74e6be None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:10.630871 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63460e-1c72-4214-8d90-a0d56e74e6be None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:10.631378 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63460e-1c72-4214-8d90-a0d56e74e6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:10.662731 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-bd63460e-1c72-4214-8d90-a0d56e74e6be None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:10.668254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-bd63460e-1c72-4214-8d90-a0d56e74e6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:10.743437 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1090/2176] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:10.753017 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3622349-73ba-480c-865b-8988a347dc9a None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:10.753305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3622349-73ba-480c-865b-8988a347dc9a None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:10.753583 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3622349-73ba-480c-865b-8988a347dc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:10.777409 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-c3622349-73ba-480c-865b-8988a347dc9a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:10.778848 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c3622349-73ba-480c-865b-8988a347dc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:10.787988 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1087/2177] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:10.792819 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63460e-1c72-4214-8d90-a0d56e74e6be None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:10.804226 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63460e-1c72-4214-8d90-a0d56e74e6be None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:10.810239 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fa4fc-9aa1-475d-b716-682017faa905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:10.811055 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fa4fc-9aa1-475d-b716-682017faa905 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:10.811442 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fa4fc-9aa1-475d-b716-682017faa905 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:10.811792 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fa4fc-9aa1-475d-b716-682017faa905 admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:10.812858 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7fa4fc-9aa1-475d-b716-682017faa905 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:56:10.813387 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7fa4fc-9aa1-475d-b716-682017faa905 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:10.816185 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7fa4fc-9aa1-475d-b716-682017faa905 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:10.830423 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1091/2178] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:56:10.835040 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3622349-73ba-480c-865b-8988a347dc9a None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:10.855975 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3622349-73ba-480c-865b-8988a347dc9a None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:10.860856 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07340b33-85a2-4558-841e-ccb5fb20fd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:10.861489 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07340b33-85a2-4558-841e-ccb5fb20fd3d admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:10.861767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07340b33-85a2-4558-841e-ccb5fb20fd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:10.862042 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07340b33-85a2-4558-841e-ccb5fb20fd3d admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:10.862683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07340b33-85a2-4558-841e-ccb5fb20fd3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:10.864666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07340b33-85a2-4558-841e-ccb5fb20fd3d admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:10.870220 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:11.016521 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1088/2179] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:56:10 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:56:11.018596 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fa4fc-9aa1-475d-b716-682017faa905 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:11.031130 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fa4fc-9aa1-475d-b716-682017faa905 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:11.129052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab518349-1bbf-428e-81f6-aa11566c05c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:11.129817 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab518349-1bbf-428e-81f6-aa11566c05c1 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:11.134203 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab518349-1bbf-428e-81f6-aa11566c05c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:11.134203 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab518349-1bbf-428e-81f6-aa11566c05c1 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:11.134203 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab518349-1bbf-428e-81f6-aa11566c05c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:11.134203 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab518349-1bbf-428e-81f6-aa11566c05c1 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:11.165529 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:11.326343 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1092/2180] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:56:11 2022] POST /identity/v3/users => generated 293 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:11.330119 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07340b33-85a2-4558-841e-ccb5fb20fd3d admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:11.341422 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07340b33-85a2-4558-841e-ccb5fb20fd3d admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:11.357280 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e6cdc-b483-4dc3-a6b9-c2c97e4a397e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:11.357937 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e6cdc-b483-4dc3-a6b9-c2c97e4a397e admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:11.358221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e6cdc-b483-4dc3-a6b9-c2c97e4a397e admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:11.361253 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e6cdc-b483-4dc3-a6b9-c2c97e4a397e admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:11.363745 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e6cdc-b483-4dc3-a6b9-c2c97e4a397e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:11.366030 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e6cdc-b483-4dc3-a6b9-c2c97e4a397e admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:11.386250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1089/2181] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:11.390124 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab518349-1bbf-428e-81f6-aa11566c05c1 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:11.418343 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab518349-1bbf-428e-81f6-aa11566c05c1 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:11.423867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18db71-ea3c-47ea-89a9-1c3b3e428adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:11.424483 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18db71-ea3c-47ea-89a9-1c3b3e428adb admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:11.424762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18db71-ea3c-47ea-89a9-1c3b3e428adb admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:11.425034 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18db71-ea3c-47ea-89a9-1c3b3e428adb admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:11.425683 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18db71-ea3c-47ea-89a9-1c3b3e428adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:11.433040 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18db71-ea3c-47ea-89a9-1c3b3e428adb admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:11.458877 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1093/2182] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 13:56:11.459554 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e6cdc-b483-4dc3-a6b9-c2c97e4a397e admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:11.476416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e6cdc-b483-4dc3-a6b9-c2c97e4a397e admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:11.490765 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c8463-e9c4-49e1-a4a3-0c49ab5eab35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:11.491501 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c8463-e9c4-49e1-a4a3-0c49ab5eab35 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:11.491786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c8463-e9c4-49e1-a4a3-0c49ab5eab35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:11.492058 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c8463-e9c4-49e1-a4a3-0c49ab5eab35 admin admin] PATH_INFO: `/v3/projects/c6a36b0d312344f68fe7a67baded8e02/users/2997a577a8ad47f7a501869a2ce8b5e7/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:11.515900 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c8463-e9c4-49e1-a4a3-0c49ab5eab35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6a36b0d312344f68fe7a67baded8e02, user_id=2997a577a8ad47f7a501869a2ce8b5e7, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:11.518698 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c8463-e9c4-49e1-a4a3-0c49ab5eab35 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:11.622797 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1090/2183] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:56:11 2022] PUT /identity/v3/projects/c6a36b0d312344f68fe7a67baded8e02/users/2997a577a8ad47f7a501869a2ce8b5e7/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:11.623087 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623e42e-184e-436f-957d-56dba875a8e4 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:11.623393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623e42e-184e-436f-957d-56dba875a8e4 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:11.623685 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623e42e-184e-436f-957d-56dba875a8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:11.665987 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-f623e42e-184e-436f-957d-56dba875a8e4 None None] MFA Rules not processed for user `2997a577a8ad47f7a501869a2ce8b5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:11.668529 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-f623e42e-184e-436f-957d-56dba875a8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:11.855703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1094/2184] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:11.860252 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c8463-e9c4-49e1-a4a3-0c49ab5eab35 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:12.064184 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c8463-e9c4-49e1-a4a3-0c49ab5eab35 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:12.071276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c3adc-01da-43ac-9191-28ba41ce656d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:12.071977 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c3adc-01da-43ac-9191-28ba41ce656d admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:12.072615 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c3adc-01da-43ac-9191-28ba41ce656d admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:12.072896 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c3adc-01da-43ac-9191-28ba41ce656d admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:12.074405 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c3adc-01da-43ac-9191-28ba41ce656d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:12.077435 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c3adc-01da-43ac-9191-28ba41ce656d admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:12.224949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1091/2185] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:56:11 2022] POST /identity/v3/projects => generated 383 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:12.228428 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623e42e-184e-436f-957d-56dba875a8e4 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:12.243638 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623e42e-184e-436f-957d-56dba875a8e4 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:12.382164 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158791c-a12e-4bfe-9221-a14601562b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:12.383438 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158791c-a12e-4bfe-9221-a14601562b6b admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:12.383827 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158791c-a12e-4bfe-9221-a14601562b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:12.384238 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158791c-a12e-4bfe-9221-a14601562b6b admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:12.385026 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158791c-a12e-4bfe-9221-a14601562b6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:12.388988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158791c-a12e-4bfe-9221-a14601562b6b admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:12.498964 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1095/2186] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:56:12 2022] POST /identity/v3/users => generated 298 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:12.502935 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c3adc-01da-43ac-9191-28ba41ce656d admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:12.516931 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c3adc-01da-43ac-9191-28ba41ce656d admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:12.524397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a20ea-c114-46c7-a9a0-7caebc0851d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:12.525585 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a20ea-c114-46c7-a9a0-7caebc0851d0 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:12.526029 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a20ea-c114-46c7-a9a0-7caebc0851d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:12.527079 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a20ea-c114-46c7-a9a0-7caebc0851d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:12.531580 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a20ea-c114-46c7-a9a0-7caebc0851d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:12.533742 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a20ea-c114-46c7-a9a0-7caebc0851d0 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:12.559023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1092/2187] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:12.563279 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158791c-a12e-4bfe-9221-a14601562b6b admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:12.581868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158791c-a12e-4bfe-9221-a14601562b6b admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:12.590666 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd33e8b-1b34-4e6e-bef9-d1b59daacd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:12.591599 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd33e8b-1b34-4e6e-bef9-d1b59daacd2d admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:12.592474 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd33e8b-1b34-4e6e-bef9-d1b59daacd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:12.592917 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd33e8b-1b34-4e6e-bef9-d1b59daacd2d admin admin] PATH_INFO: `/v3/projects/e59ae542ed2a438cb0df72cce43474f0/users/59396550f04e466f9d04649336edfaf4/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:12.618587 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd33e8b-1b34-4e6e-bef9-d1b59daacd2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59ae542ed2a438cb0df72cce43474f0, user_id=59396550f04e466f9d04649336edfaf4, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:12.623293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd33e8b-1b34-4e6e-bef9-d1b59daacd2d admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:12.713294 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1096/2188] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:56:12 2022] PUT /identity/v3/projects/e59ae542ed2a438cb0df72cce43474f0/users/59396550f04e466f9d04649336edfaf4/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:12.717851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a20ea-c114-46c7-a9a0-7caebc0851d0 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:12.730080 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a20ea-c114-46c7-a9a0-7caebc0851d0 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:12.804025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a833456-2162-444b-afbb-a2560dcbadef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:12.804652 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a833456-2162-444b-afbb-a2560dcbadef admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:12.804937 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a833456-2162-444b-afbb-a2560dcbadef admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:12.805240 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a833456-2162-444b-afbb-a2560dcbadef admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:12.806161 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a833456-2162-444b-afbb-a2560dcbadef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:12.807898 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a833456-2162-444b-afbb-a2560dcbadef admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:12.819856 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1093/2189] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:12.824488 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd33e8b-1b34-4e6e-bef9-d1b59daacd2d admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:12.840355 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd33e8b-1b34-4e6e-bef9-d1b59daacd2d admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:12.846559 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177c947-5548-4cf6-ad00-2423f01fc4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:12.847683 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177c947-5548-4cf6-ad00-2423f01fc4c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:12.848243 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177c947-5548-4cf6-ad00-2423f01fc4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:12.848830 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177c947-5548-4cf6-ad00-2423f01fc4c6 admin admin] PATH_INFO: `/v3/projects/e59ae542ed2a438cb0df72cce43474f0/users/59396550f04e466f9d04649336edfaf4/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:12.852458 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177c947-5548-4cf6-ad00-2423f01fc4c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59ae542ed2a438cb0df72cce43474f0, user_id=59396550f04e466f9d04649336edfaf4, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:12.859261 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177c947-5548-4cf6-ad00-2423f01fc4c6 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:12.881661 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1097/2190] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:56:12 2022] PUT /identity/v3/projects/e59ae542ed2a438cb0df72cce43474f0/users/59396550f04e466f9d04649336edfaf4/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:56:12.897092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e1e48-3035-476b-a598-91761304f01c None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:12.897399 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e1e48-3035-476b-a598-91761304f01c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:12.897981 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e1e48-3035-476b-a598-91761304f01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:12.932194 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-f23e1e48-3035-476b-a598-91761304f01c None None] MFA Rules not processed for user `59396550f04e466f9d04649336edfaf4`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:12.933560 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-f23e1e48-3035-476b-a598-91761304f01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:13.048795 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1094/2191] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:13.138612 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:13.185796 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177c947-5548-4cf6-ad00-2423f01fc4c6 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:13.187987 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-f177c947-5548-4cf6-ad00-2423f01fc4c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:13.270895 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177c947-5548-4cf6-ad00-2423f01fc4c6 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:13.277819 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4880f7-e2c7-4c6e-8c07-6cfe9b5b7f40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:13.278805 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4880f7-e2c7-4c6e-8c07-6cfe9b5b7f40 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:13.279379 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4880f7-e2c7-4c6e-8c07-6cfe9b5b7f40 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:13.279812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4880f7-e2c7-4c6e-8c07-6cfe9b5b7f40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:13.407438 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4880f7-e2c7-4c6e-8c07-6cfe9b5b7f40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:13.408962 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4880f7-e2c7-4c6e-8c07-6cfe9b5b7f40 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:13.422374 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1098/2192] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:56:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:56:13.758919 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:14.914966 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1959611-79b6-434c-bf1f-1e52ea31f860 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:14.915539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1959611-79b6-434c-bf1f-1e52ea31f860 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:14.915539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1959611-79b6-434c-bf1f-1e52ea31f860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:14.949434 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-b1959611-79b6-434c-bf1f-1e52ea31f860 None None] MFA Rules not processed for user `658108c26fb74eba911e249819f8b290`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:14.950712 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b1959611-79b6-434c-bf1f-1e52ea31f860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:15.043459 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1095/2193] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:15.060550 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4880f7-e2c7-4c6e-8c07-6cfe9b5b7f40 service cinder] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:15.063933 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-2a4880f7-e2c7-4c6e-8c07-6cfe9b5b7f40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:15.142880 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4880f7-e2c7-4c6e-8c07-6cfe9b5b7f40 service cinder] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:15.150351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e669cdc-6600-4a7d-9908-b0052043aa9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:15.155325 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e669cdc-6600-4a7d-9908-b0052043aa9a service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:15.155325 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e669cdc-6600-4a7d-9908-b0052043aa9a service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:15.155325 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e669cdc-6600-4a7d-9908-b0052043aa9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:15.160523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e669cdc-6600-4a7d-9908-b0052043aa9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:15.162102 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e669cdc-6600-4a7d-9908-b0052043aa9a service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:15.172334 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1099/2194] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:56:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:56:18.235164 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc681f66-77ca-413b-b6a7-05de5748a3b1 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:18.235699 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc681f66-77ca-413b-b6a7-05de5748a3b1 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:18.235801 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc681f66-77ca-413b-b6a7-05de5748a3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:18.269556 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-bc681f66-77ca-413b-b6a7-05de5748a3b1 None None] MFA Rules not processed for user `658108c26fb74eba911e249819f8b290`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:18.270858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-bc681f66-77ca-413b-b6a7-05de5748a3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:18.277908 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1096/2195] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:22.456470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e669cdc-6600-4a7d-9908-b0052043aa9a service nova] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:22.458512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-8e669cdc-6600-4a7d-9908-b0052043aa9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:22.557646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e669cdc-6600-4a7d-9908-b0052043aa9a service nova] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:22.562545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c47fbf-0357-431a-bf6f-938c5275fdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:22.563338 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c47fbf-0357-431a-bf6f-938c5275fdc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:22.563652 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c47fbf-0357-431a-bf6f-938c5275fdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:22.563931 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c47fbf-0357-431a-bf6f-938c5275fdc8 admin admin] PATH_INFO: `/v3/users/33d5b1e46dba412e89409a81c40defc8` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:22.565217 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c47fbf-0357-431a-bf6f-938c5275fdc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33d5b1e46dba412e89409a81c40defc8)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:22.567166 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c47fbf-0357-431a-bf6f-938c5275fdc8 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:22.575323 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:22.847934 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-13c47fbf-0357-431a-bf6f-938c5275fdc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33d5b1e46dba412e89409a81c40defc8'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:22.930674 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-13c47fbf-0357-431a-bf6f-938c5275fdc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33d5b1e46dba412e89409a81c40defc8'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:22.939849 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-13c47fbf-0357-431a-bf6f-938c5275fdc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33d5b1e46dba412e89409a81c40defc8'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:22.954667 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-13c47fbf-0357-431a-bf6f-938c5275fdc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33d5b1e46dba412e89409a81c40defc8'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:22.955443 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-13c47fbf-0357-431a-bf6f-938c5275fdc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33d5b1e46dba412e89409a81c40defc8'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:22.962671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1100/2196] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:56:22 2022] DELETE /identity/v3/users/33d5b1e46dba412e89409a81c40defc8 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:22.967767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53ffe7-fcb4-4d18-8df0-5b0f88c4c9c2 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:22.968568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53ffe7-fcb4-4d18-8df0-5b0f88c4c9c2 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:22.972331 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53ffe7-fcb4-4d18-8df0-5b0f88c4c9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:22.989520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-db53ffe7-fcb4-4d18-8df0-5b0f88c4c9c2 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:22.991000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-db53ffe7-fcb4-4d18-8df0-5b0f88c4c9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:23.055112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1097/2197] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:23.065058 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c47fbf-0357-431a-bf6f-938c5275fdc8 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:23.066554 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-13c47fbf-0357-431a-bf6f-938c5275fdc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:23.162603 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c47fbf-0357-431a-bf6f-938c5275fdc8 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:23.167281 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4d38a-457b-4c90-bf76-e2e9a557ec26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:23.167939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4d38a-457b-4c90-bf76-e2e9a557ec26 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:23.168218 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4d38a-457b-4c90-bf76-e2e9a557ec26 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:23.168489 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4d38a-457b-4c90-bf76-e2e9a557ec26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:23.179056 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f4d38a-457b-4c90-bf76-e2e9a557ec26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:23.180548 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f4d38a-457b-4c90-bf76-e2e9a557ec26 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:23.192010 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1101/2198] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:56:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:56:23.770392 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53ffe7-fcb4-4d18-8df0-5b0f88c4c9c2 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:23.776182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-db53ffe7-fcb4-4d18-8df0-5b0f88c4c9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:23.806726 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53ffe7-fcb4-4d18-8df0-5b0f88c4c9c2 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:23.828340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24cba3-68b1-45ef-872a-86b3fb5480fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:23.828340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24cba3-68b1-45ef-872a-86b3fb5480fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:23.828340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24cba3-68b1-45ef-872a-86b3fb5480fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:23.828340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24cba3-68b1-45ef-872a-86b3fb5480fa admin admin] PATH_INFO: `/v3/projects/178c3f2dfab54a108644daa8c8303d7f` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:23.828811 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24cba3-68b1-45ef-872a-86b3fb5480fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=178c3f2dfab54a108644daa8c8303d7f)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:23.828811 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24cba3-68b1-45ef-872a-86b3fb5480fa admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:23.871197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:24.021763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-8d24cba3-68b1-45ef-872a-86b3fb5480fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '178c3f2dfab54a108644daa8c8303d7f', 'request_id': 'req-8d24cba3-68b1-45ef-872a-86b3fb5480fa'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:24.027045 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-8d24cba3-68b1-45ef-872a-86b3fb5480fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '178c3f2dfab54a108644daa8c8303d7f', 'request_id': 'req-8d24cba3-68b1-45ef-872a-86b3fb5480fa'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:24.033743 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-8d24cba3-68b1-45ef-872a-86b3fb5480fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '178c3f2dfab54a108644daa8c8303d7f', 'request_id': 'req-8d24cba3-68b1-45ef-872a-86b3fb5480fa'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:24.155339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-8d24cba3-68b1-45ef-872a-86b3fb5480fa admin admin] The token cache is being invalidate because project 178c3f2dfab54a108644daa8c8303d7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:56:24.155339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-8d24cba3-68b1-45ef-872a-86b3fb5480fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:24.155339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-8d24cba3-68b1-45ef-872a-86b3fb5480fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:24.159113 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1098/2199] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:56:23 2022] DELETE /identity/v3/projects/178c3f2dfab54a108644daa8c8303d7f => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:24.160714 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4d38a-457b-4c90-bf76-e2e9a557ec26 service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:24.175485 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4d38a-457b-4c90-bf76-e2e9a557ec26 service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:24.266406 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d55c4-5ba1-4b9f-9b44-59b33335841f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:24.267248 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d55c4-5ba1-4b9f-9b44-59b33335841f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:24.267394 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d55c4-5ba1-4b9f-9b44-59b33335841f admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:24.267629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d55c4-5ba1-4b9f-9b44-59b33335841f admin admin] PATH_INFO: `/v3/users/e6039d5f46bb462583d175f4bf3a4b08` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:24.268824 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d55c4-5ba1-4b9f-9b44-59b33335841f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6039d5f46bb462583d175f4bf3a4b08)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:24.270955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d55c4-5ba1-4b9f-9b44-59b33335841f admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:24.457597 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:24.483500 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-997d55c4-5ba1-4b9f-9b44-59b33335841f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6039d5f46bb462583d175f4bf3a4b08'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:24.518304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24cba3-68b1-45ef-872a-86b3fb5480fa admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:24.520827 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-8d24cba3-68b1-45ef-872a-86b3fb5480fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:24.570059 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-997d55c4-5ba1-4b9f-9b44-59b33335841f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6039d5f46bb462583d175f4bf3a4b08'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:24.588076 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-997d55c4-5ba1-4b9f-9b44-59b33335841f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6039d5f46bb462583d175f4bf3a4b08'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:24.607208 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-997d55c4-5ba1-4b9f-9b44-59b33335841f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6039d5f46bb462583d175f4bf3a4b08'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:24.608096 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-997d55c4-5ba1-4b9f-9b44-59b33335841f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6039d5f46bb462583d175f4bf3a4b08'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:24.619042 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1102/2200] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:56:24 2022] DELETE /identity/v3/users/e6039d5f46bb462583d175f4bf3a4b08 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:24.626786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24cba3-68b1-45ef-872a-86b3fb5480fa admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:24.693365 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76ff78-1c29-46da-b3db-799996478ba1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:24.694574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76ff78-1c29-46da-b3db-799996478ba1 service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:24.695192 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76ff78-1c29-46da-b3db-799996478ba1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:24.695302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76ff78-1c29-46da-b3db-799996478ba1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:24.699596 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-3c76ff78-1c29-46da-b3db-799996478ba1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:24.790811 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76ff78-1c29-46da-b3db-799996478ba1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:24.793289 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76ff78-1c29-46da-b3db-799996478ba1 service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:24.810846 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1099/2201] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:56:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:56:25.407881 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d55c4-5ba1-4b9f-9b44-59b33335841f admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:25.409454 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-997d55c4-5ba1-4b9f-9b44-59b33335841f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:25.485437 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d55c4-5ba1-4b9f-9b44-59b33335841f admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:25.496144 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aaa332-7332-4adf-bdd5-8dc4b0e4d2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:25.497132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aaa332-7332-4adf-bdd5-8dc4b0e4d2fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:25.497540 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aaa332-7332-4adf-bdd5-8dc4b0e4d2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:25.497884 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aaa332-7332-4adf-bdd5-8dc4b0e4d2fd admin admin] PATH_INFO: `/v3/projects/76123e1f73454df6945798e9738b9d62` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:25.499291 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aaa332-7332-4adf-bdd5-8dc4b0e4d2fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=76123e1f73454df6945798e9738b9d62)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:25.501379 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aaa332-7332-4adf-bdd5-8dc4b0e4d2fd admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:25.653244 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-76aaa332-7332-4adf-bdd5-8dc4b0e4d2fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76123e1f73454df6945798e9738b9d62', 'request_id': 'req-76aaa332-7332-4adf-bdd5-8dc4b0e4d2fd'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:25.659678 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-76aaa332-7332-4adf-bdd5-8dc4b0e4d2fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76123e1f73454df6945798e9738b9d62', 'request_id': 'req-76aaa332-7332-4adf-bdd5-8dc4b0e4d2fd'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:25.792924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-76aaa332-7332-4adf-bdd5-8dc4b0e4d2fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76123e1f73454df6945798e9738b9d62', 'request_id': 'req-76aaa332-7332-4adf-bdd5-8dc4b0e4d2fd'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:25.821254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-76aaa332-7332-4adf-bdd5-8dc4b0e4d2fd admin admin] The token cache is being invalidate because project 76123e1f73454df6945798e9738b9d62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:56:25.821501 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-76aaa332-7332-4adf-bdd5-8dc4b0e4d2fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:25.822234 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-76aaa332-7332-4adf-bdd5-8dc4b0e4d2fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:25.824452 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1103/2202] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:56:25 2022] DELETE /identity/v3/projects/76123e1f73454df6945798e9738b9d62 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:25.830046 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e6c88-fbf4-4e9f-942d-a2423081956b None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:25.830792 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e6c88-fbf4-4e9f-942d-a2423081956b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:25.831045 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e6c88-fbf4-4e9f-942d-a2423081956b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:25.917971 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-548e6c88-fbf4-4e9f-942d-a2423081956b None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:25.917971 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-548e6c88-fbf4-4e9f-942d-a2423081956b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:25.917971 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:25.923897 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1100/2203] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:25.931727 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa8f51-7437-44b3-9695-ce656c2603de None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:25.932009 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa8f51-7437-44b3-9695-ce656c2603de None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:25.932280 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa8f51-7437-44b3-9695-ce656c2603de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:25.952506 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-0bfa8f51-7437-44b3-9695-ce656c2603de None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:25.953730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-0bfa8f51-7437-44b3-9695-ce656c2603de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:25.961511 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1104/2204] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:26.104039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e6c88-fbf4-4e9f-942d-a2423081956b None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:26.116547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e6c88-fbf4-4e9f-942d-a2423081956b None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:26.128205 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161589e9-b12c-46e7-8d20-e4429264119b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:26.129008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161589e9-b12c-46e7-8d20-e4429264119b admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:26.129621 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161589e9-b12c-46e7-8d20-e4429264119b admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:26.129904 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161589e9-b12c-46e7-8d20-e4429264119b admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:26.130569 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161589e9-b12c-46e7-8d20-e4429264119b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:56:26.130881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161589e9-b12c-46e7-8d20-e4429264119b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:26.132603 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161589e9-b12c-46e7-8d20-e4429264119b admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:26.151702 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1101/2205] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:56:26.156400 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa8f51-7437-44b3-9695-ce656c2603de None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:26.166464 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa8f51-7437-44b3-9695-ce656c2603de None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:26.172360 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90a08b-f9ed-4cd1-a51e-5dcd8a0f8ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:26.173067 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90a08b-f9ed-4cd1-a51e-5dcd8a0f8ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:26.173544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90a08b-f9ed-4cd1-a51e-5dcd8a0f8ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:26.173910 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90a08b-f9ed-4cd1-a51e-5dcd8a0f8ab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:26.174646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90a08b-f9ed-4cd1-a51e-5dcd8a0f8ab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:26.176933 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90a08b-f9ed-4cd1-a51e-5dcd8a0f8ab6 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:26.393443 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1105/2206] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:56:26 2022] POST /identity/v3/projects => generated 407 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:26.394693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161589e9-b12c-46e7-8d20-e4429264119b admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:26.405657 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161589e9-b12c-46e7-8d20-e4429264119b admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:26.464917 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec325b2-aabe-436b-8979-baf91b27bd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:26.468589 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec325b2-aabe-436b-8979-baf91b27bd62 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:26.468589 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec325b2-aabe-436b-8979-baf91b27bd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:26.468589 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec325b2-aabe-436b-8979-baf91b27bd62 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:26.468589 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec325b2-aabe-436b-8979-baf91b27bd62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:26.469044 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec325b2-aabe-436b-8979-baf91b27bd62 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:26.570183 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1102/2207] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:56:26 2022] POST /identity/v3/users => generated 304 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:26.572003 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90a08b-f9ed-4cd1-a51e-5dcd8a0f8ab6 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:26.585911 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90a08b-f9ed-4cd1-a51e-5dcd8a0f8ab6 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:26.590620 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d89e5-c1ac-4416-842c-8d665ada4fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:26.591219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d89e5-c1ac-4416-842c-8d665ada4fcb admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:26.591536 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d89e5-c1ac-4416-842c-8d665ada4fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:26.591809 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d89e5-c1ac-4416-842c-8d665ada4fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:26.592446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d89e5-c1ac-4416-842c-8d665ada4fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:26.594030 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d89e5-c1ac-4416-842c-8d665ada4fcb admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:26.596324 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:26.605268 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1106/2208] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:26.609569 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec325b2-aabe-436b-8979-baf91b27bd62 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:26.620871 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec325b2-aabe-436b-8979-baf91b27bd62 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:26.625606 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7d35d-f99e-48ab-ba30-b64b1d0a8df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:26.626201 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7d35d-f99e-48ab-ba30-b64b1d0a8df2 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:26.626481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7d35d-f99e-48ab-ba30-b64b1d0a8df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:26.626750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7d35d-f99e-48ab-ba30-b64b1d0a8df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:26.627422 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7d35d-f99e-48ab-ba30-b64b1d0a8df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:26.629030 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7d35d-f99e-48ab-ba30-b64b1d0a8df2 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:26.640686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1103/2209] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:26.644961 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d89e5-c1ac-4416-842c-8d665ada4fcb admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:26.654841 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d89e5-c1ac-4416-842c-8d665ada4fcb admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:26.660840 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe400834-01a0-48c7-8140-f400ecc19680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:26.661487 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe400834-01a0-48c7-8140-f400ecc19680 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:26.661768 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe400834-01a0-48c7-8140-f400ecc19680 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:26.662041 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe400834-01a0-48c7-8140-f400ecc19680 admin admin] PATH_INFO: `/v3/projects/8d92e25609ad41e28133d1e3bd7e7873/users/549c8083315f4304993f5ff96926c457/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:26.677887 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe400834-01a0-48c7-8140-f400ecc19680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d92e25609ad41e28133d1e3bd7e7873, user_id=549c8083315f4304993f5ff96926c457, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:26.680841 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe400834-01a0-48c7-8140-f400ecc19680 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:26.756043 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1107/2210] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:56:26 2022] PUT /identity/v3/projects/8d92e25609ad41e28133d1e3bd7e7873/users/549c8083315f4304993f5ff96926c457/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:26.767494 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd26871-e42d-42e7-bd48-4df7958a5b1d None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:26.767794 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd26871-e42d-42e7-bd48-4df7958a5b1d None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:26.768076 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd26871-e42d-42e7-bd48-4df7958a5b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:26.796904 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-6cd26871-e42d-42e7-bd48-4df7958a5b1d None None] MFA Rules not processed for user `549c8083315f4304993f5ff96926c457`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:26.798141 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-6cd26871-e42d-42e7-bd48-4df7958a5b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:26.864064 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1104/2211] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:26 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:26.868588 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe400834-01a0-48c7-8140-f400ecc19680 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:26.931283 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe400834-01a0-48c7-8140-f400ecc19680 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:26.936441 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf7f8f-0db2-4ca2-8820-99674ad96cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:26.937037 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf7f8f-0db2-4ca2-8820-99674ad96cbf admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:26.937353 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf7f8f-0db2-4ca2-8820-99674ad96cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:26.937627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf7f8f-0db2-4ca2-8820-99674ad96cbf admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:26.938253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf7f8f-0db2-4ca2-8820-99674ad96cbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:26.940160 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf7f8f-0db2-4ca2-8820-99674ad96cbf admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:27.048996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1108/2212] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:56:26 2022] POST /identity/v3/projects => generated 409 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:27.056854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd26871-e42d-42e7-bd48-4df7958a5b1d None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:27.067681 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd26871-e42d-42e7-bd48-4df7958a5b1d None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:27.124848 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994fb5e-c1f8-41bb-87a7-96e5feb265c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:27.125459 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994fb5e-c1f8-41bb-87a7-96e5feb265c3 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:27.125739 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994fb5e-c1f8-41bb-87a7-96e5feb265c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:27.126017 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994fb5e-c1f8-41bb-87a7-96e5feb265c3 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:27.126725 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0994fb5e-c1f8-41bb-87a7-96e5feb265c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:27.128626 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0994fb5e-c1f8-41bb-87a7-96e5feb265c3 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:27.137522 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:27.266220 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1105/2213] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:56:27 2022] POST /identity/v3/users => generated 311 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:27.270992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf7f8f-0db2-4ca2-8820-99674ad96cbf admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:27.283789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf7f8f-0db2-4ca2-8820-99674ad96cbf admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:27.291190 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76ad42-3a2d-4010-a9b2-7d3351ccada7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:27.291190 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76ad42-3a2d-4010-a9b2-7d3351ccada7 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:27.291190 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76ad42-3a2d-4010-a9b2-7d3351ccada7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:27.291190 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76ad42-3a2d-4010-a9b2-7d3351ccada7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:27.292640 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76ad42-3a2d-4010-a9b2-7d3351ccada7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:27.293398 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76ad42-3a2d-4010-a9b2-7d3351ccada7 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:27.316998 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1109/2214] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:27.317216 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994fb5e-c1f8-41bb-87a7-96e5feb265c3 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:27.323955 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994fb5e-c1f8-41bb-87a7-96e5feb265c3 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:27.330937 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d46bf-55e3-410e-8c56-dd39bcb010ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:27.332093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d46bf-55e3-410e-8c56-dd39bcb010ca admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:27.332583 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d46bf-55e3-410e-8c56-dd39bcb010ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:27.333065 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d46bf-55e3-410e-8c56-dd39bcb010ca admin admin] PATH_INFO: `/v3/projects/802beab71eb148bebc0aa44473528d5e/users/3401ac1439f0456ea221b9d4fed14f9b/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:27.366059 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d46bf-55e3-410e-8c56-dd39bcb010ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=802beab71eb148bebc0aa44473528d5e, user_id=3401ac1439f0456ea221b9d4fed14f9b, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:27.369066 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d46bf-55e3-410e-8c56-dd39bcb010ca admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:27.470564 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1106/2215] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:56:27 2022] PUT /identity/v3/projects/802beab71eb148bebc0aa44473528d5e/users/3401ac1439f0456ea221b9d4fed14f9b/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:27.475437 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76ad42-3a2d-4010-a9b2-7d3351ccada7 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:27.486467 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76ad42-3a2d-4010-a9b2-7d3351ccada7 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:27.545133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d9a68-12bf-4f7c-a40e-78890e05354b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:27.545747 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d9a68-12bf-4f7c-a40e-78890e05354b admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:27.546024 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d9a68-12bf-4f7c-a40e-78890e05354b admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:27.546374 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d9a68-12bf-4f7c-a40e-78890e05354b admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:27.546936 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d9a68-12bf-4f7c-a40e-78890e05354b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:27.548640 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d9a68-12bf-4f7c-a40e-78890e05354b admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:27.559883 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1110/2216] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:27.564071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d46bf-55e3-410e-8c56-dd39bcb010ca admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:27.574882 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d46bf-55e3-410e-8c56-dd39bcb010ca admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:27.579991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17601f18-89d8-46a9-8ed0-1c629eb520f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:27.580787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17601f18-89d8-46a9-8ed0-1c629eb520f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:27.581126 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17601f18-89d8-46a9-8ed0-1c629eb520f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:27.581465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17601f18-89d8-46a9-8ed0-1c629eb520f3 admin admin] PATH_INFO: `/v3/projects/802beab71eb148bebc0aa44473528d5e/users/3401ac1439f0456ea221b9d4fed14f9b/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:27.583651 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17601f18-89d8-46a9-8ed0-1c629eb520f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=802beab71eb148bebc0aa44473528d5e, user_id=3401ac1439f0456ea221b9d4fed14f9b, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:27.586345 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17601f18-89d8-46a9-8ed0-1c629eb520f3 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:27.597085 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1107/2217] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:56:27 2022] PUT /identity/v3/projects/802beab71eb148bebc0aa44473528d5e/users/3401ac1439f0456ea221b9d4fed14f9b/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:27.608370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780842c-b586-4f9d-b3d5-245778e0b54f None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:27.608898 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780842c-b586-4f9d-b3d5-245778e0b54f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:27.609014 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780842c-b586-4f9d-b3d5-245778e0b54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:27.638470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-9780842c-b586-4f9d-b3d5-245778e0b54f None None] MFA Rules not processed for user `3401ac1439f0456ea221b9d4fed14f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:27.640436 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-9780842c-b586-4f9d-b3d5-245778e0b54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:27.675203 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:27.710242 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1111/2218] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:27 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:27.722057 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17601f18-89d8-46a9-8ed0-1c629eb520f3 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:27.723993 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-17601f18-89d8-46a9-8ed0-1c629eb520f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:27.783976 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17601f18-89d8-46a9-8ed0-1c629eb520f3 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:27.787722 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6708a8f-e9b1-455c-bd61-4d54fb6d0f77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:27.788324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6708a8f-e9b1-455c-bd61-4d54fb6d0f77 service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:27.788601 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6708a8f-e9b1-455c-bd61-4d54fb6d0f77 service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:27.788958 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6708a8f-e9b1-455c-bd61-4d54fb6d0f77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:27.798965 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6708a8f-e9b1-455c-bd61-4d54fb6d0f77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:27.800470 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6708a8f-e9b1-455c-bd61-4d54fb6d0f77 service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:27.810367 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1108/2219] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:56:27 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:56:28.185235 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780842c-b586-4f9d-b3d5-245778e0b54f None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:28.195070 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780842c-b586-4f9d-b3d5-245778e0b54f None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:28.199137 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07558d9-144c-41fb-9ac3-6b2b07ad4028 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:28.199877 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07558d9-144c-41fb-9ac3-6b2b07ad4028 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:28.200249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07558d9-144c-41fb-9ac3-6b2b07ad4028 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:28.200616 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07558d9-144c-41fb-9ac3-6b2b07ad4028 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:28.260367 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07558d9-144c-41fb-9ac3-6b2b07ad4028 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:28.261811 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07558d9-144c-41fb-9ac3-6b2b07ad4028 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:28.270672 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1112/2220] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:56:28 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:56:37.805855 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=64,keystone:INSERT=5 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:38.266609 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=42 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:40.069331 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6708a8f-e9b1-455c-bd61-4d54fb6d0f77 service cinder] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:40.070982 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-e6708a8f-e9b1-455c-bd61-4d54fb6d0f77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:40.153278 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6708a8f-e9b1-455c-bd61-4d54fb6d0f77 service cinder] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:40.158140 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2467b-45db-4c73-8e9c-98429131cf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:40.158804 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2467b-45db-4c73-8e9c-98429131cf7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:40.159084 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2467b-45db-4c73-8e9c-98429131cf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:40.159393 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2467b-45db-4c73-8e9c-98429131cf7c admin admin] PATH_INFO: `/v3/users/2997a577a8ad47f7a501869a2ce8b5e7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:40.160819 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2467b-45db-4c73-8e9c-98429131cf7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2997a577a8ad47f7a501869a2ce8b5e7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:40.162812 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2467b-45db-4c73-8e9c-98429131cf7c admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:40.385268 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-8cf2467b-45db-4c73-8e9c-98429131cf7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2997a577a8ad47f7a501869a2ce8b5e7'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:40.386527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-8cf2467b-45db-4c73-8e9c-98429131cf7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2997a577a8ad47f7a501869a2ce8b5e7'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:40.402558 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-8cf2467b-45db-4c73-8e9c-98429131cf7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2997a577a8ad47f7a501869a2ce8b5e7'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:40.412417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-8cf2467b-45db-4c73-8e9c-98429131cf7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2997a577a8ad47f7a501869a2ce8b5e7'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:40.499572 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-8cf2467b-45db-4c73-8e9c-98429131cf7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2997a577a8ad47f7a501869a2ce8b5e7'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:40.511516 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1109/2221] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:56:40 2022] DELETE /identity/v3/users/2997a577a8ad47f7a501869a2ce8b5e7 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:40.513298 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87c5b8-b2d7-4dd3-95b4-1d86166e35c0 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:40.513780 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87c5b8-b2d7-4dd3-95b4-1d86166e35c0 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:40.513906 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87c5b8-b2d7-4dd3-95b4-1d86166e35c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:40.535427 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-0a87c5b8-b2d7-4dd3-95b4-1d86166e35c0 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:40.546513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-0a87c5b8-b2d7-4dd3-95b4-1d86166e35c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:40.620761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1113/2222] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:40.639054 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2467b-45db-4c73-8e9c-98429131cf7c admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:40.640566 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-8cf2467b-45db-4c73-8e9c-98429131cf7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:40.746736 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2467b-45db-4c73-8e9c-98429131cf7c admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:40.755979 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe897ee-7f7b-4776-87aa-39388255a6dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:40.756945 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe897ee-7f7b-4776-87aa-39388255a6dd service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:40.757310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe897ee-7f7b-4776-87aa-39388255a6dd service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:40.757657 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe897ee-7f7b-4776-87aa-39388255a6dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:40.768743 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe897ee-7f7b-4776-87aa-39388255a6dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:40.770236 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe897ee-7f7b-4776-87aa-39388255a6dd service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:40.782433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1110/2223] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:56:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:56:41.302304 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87c5b8-b2d7-4dd3-95b4-1d86166e35c0 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:41.303840 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-0a87c5b8-b2d7-4dd3-95b4-1d86166e35c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:41.316706 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87c5b8-b2d7-4dd3-95b4-1d86166e35c0 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:41.322813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154ff81-8c88-4ed3-a78a-30ee0b794a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:41.323387 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154ff81-8c88-4ed3-a78a-30ee0b794a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:41.323679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154ff81-8c88-4ed3-a78a-30ee0b794a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:41.328655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154ff81-8c88-4ed3-a78a-30ee0b794a9d admin admin] PATH_INFO: `/v3/projects/c6a36b0d312344f68fe7a67baded8e02` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:41.328655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154ff81-8c88-4ed3-a78a-30ee0b794a9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6a36b0d312344f68fe7a67baded8e02)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:41.329502 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154ff81-8c88-4ed3-a78a-30ee0b794a9d admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:41.470103 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-9154ff81-8c88-4ed3-a78a-30ee0b794a9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6a36b0d312344f68fe7a67baded8e02', 'request_id': 'req-9154ff81-8c88-4ed3-a78a-30ee0b794a9d'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:41.476113 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-9154ff81-8c88-4ed3-a78a-30ee0b794a9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6a36b0d312344f68fe7a67baded8e02', 'request_id': 'req-9154ff81-8c88-4ed3-a78a-30ee0b794a9d'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:41.598358 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-9154ff81-8c88-4ed3-a78a-30ee0b794a9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6a36b0d312344f68fe7a67baded8e02', 'request_id': 'req-9154ff81-8c88-4ed3-a78a-30ee0b794a9d'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:41.611110 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-9154ff81-8c88-4ed3-a78a-30ee0b794a9d admin admin] The token cache is being invalidate because project c6a36b0d312344f68fe7a67baded8e02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:56:41.611591 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-9154ff81-8c88-4ed3-a78a-30ee0b794a9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:41.613503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-9154ff81-8c88-4ed3-a78a-30ee0b794a9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:41.613837 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1114/2224] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:56:41 2022] DELETE /identity/v3/projects/c6a36b0d312344f68fe7a67baded8e02 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:56:41.618066 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe897ee-7f7b-4776-87aa-39388255a6dd service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:41.628622 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe897ee-7f7b-4776-87aa-39388255a6dd service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:41.647166 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:41.685008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a7f09-28f2-4bd6-8f96-e0f642c0a5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:41.694068 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a7f09-28f2-4bd6-8f96-e0f642c0a5fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:41.694068 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a7f09-28f2-4bd6-8f96-e0f642c0a5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:41.694068 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a7f09-28f2-4bd6-8f96-e0f642c0a5fa admin admin] PATH_INFO: `/v3/users/59396550f04e466f9d04649336edfaf4` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:41.694068 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a7f09-28f2-4bd6-8f96-e0f642c0a5fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=59396550f04e466f9d04649336edfaf4)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:41.694068 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a7f09-28f2-4bd6-8f96-e0f642c0a5fa admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:41.933845 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-540a7f09-28f2-4bd6-8f96-e0f642c0a5fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59396550f04e466f9d04649336edfaf4'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:41.934559 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-540a7f09-28f2-4bd6-8f96-e0f642c0a5fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59396550f04e466f9d04649336edfaf4'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:41.956417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-540a7f09-28f2-4bd6-8f96-e0f642c0a5fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59396550f04e466f9d04649336edfaf4'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:41.965369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-540a7f09-28f2-4bd6-8f96-e0f642c0a5fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59396550f04e466f9d04649336edfaf4'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:42.074197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-540a7f09-28f2-4bd6-8f96-e0f642c0a5fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59396550f04e466f9d04649336edfaf4'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:42.102820 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1111/2225] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:56:41 2022] DELETE /identity/v3/users/59396550f04e466f9d04649336edfaf4 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:56:42.343636 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154ff81-8c88-4ed3-a78a-30ee0b794a9d admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:42.345165 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-9154ff81-8c88-4ed3-a78a-30ee0b794a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:42.360184 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154ff81-8c88-4ed3-a78a-30ee0b794a9d admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:42.431477 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567d13a-0d9d-4469-916e-a4e115957ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:42.432362 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567d13a-0d9d-4469-916e-a4e115957ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:42.434508 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567d13a-0d9d-4469-916e-a4e115957ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:42.434508 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567d13a-0d9d-4469-916e-a4e115957ccd admin admin] PATH_INFO: `/v3/users/549c8083315f4304993f5ff96926c457` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:42.435037 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567d13a-0d9d-4469-916e-a4e115957ccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=549c8083315f4304993f5ff96926c457)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:42.437839 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567d13a-0d9d-4469-916e-a4e115957ccd admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:42.555277 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a7f09-28f2-4bd6-8f96-e0f642c0a5fa admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:42.557005 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-540a7f09-28f2-4bd6-8f96-e0f642c0a5fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:42.569431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:42.572654 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a7f09-28f2-4bd6-8f96-e0f642c0a5fa admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:42.577457 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e229d48-e26b-48e9-b476-af2ed8c5df16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:42.578154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e229d48-e26b-48e9-b476-af2ed8c5df16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:42.578999 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e229d48-e26b-48e9-b476-af2ed8c5df16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:42.579284 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e229d48-e26b-48e9-b476-af2ed8c5df16 admin admin] PATH_INFO: `/v3/users/b67c878d42c94515a8a4ab613c170f02` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:42.580831 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e229d48-e26b-48e9-b476-af2ed8c5df16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b67c878d42c94515a8a4ab613c170f02)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:42.582807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e229d48-e26b-48e9-b476-af2ed8c5df16 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:42.699675 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-c567d13a-0d9d-4469-916e-a4e115957ccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '549c8083315f4304993f5ff96926c457'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:42.787916 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-c567d13a-0d9d-4469-916e-a4e115957ccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '549c8083315f4304993f5ff96926c457'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:42.796132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-c567d13a-0d9d-4469-916e-a4e115957ccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '549c8083315f4304993f5ff96926c457'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:42.802425 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-3e229d48-e26b-48e9-b476-af2ed8c5df16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b67c878d42c94515a8a4ab613c170f02'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:42.803253 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-3e229d48-e26b-48e9-b476-af2ed8c5df16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b67c878d42c94515a8a4ab613c170f02'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:42.810742 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-c567d13a-0d9d-4469-916e-a4e115957ccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '549c8083315f4304993f5ff96926c457'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:42.811876 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-c567d13a-0d9d-4469-916e-a4e115957ccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '549c8083315f4304993f5ff96926c457'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:42.819725 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-3e229d48-e26b-48e9-b476-af2ed8c5df16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b67c878d42c94515a8a4ab613c170f02'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:42.824565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1115/2226] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:56:42 2022] DELETE /identity/v3/users/549c8083315f4304993f5ff96926c457 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:42.827665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-3e229d48-e26b-48e9-b476-af2ed8c5df16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b67c878d42c94515a8a4ab613c170f02'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:42.829681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567d13a-0d9d-4469-916e-a4e115957ccd admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:42.835120 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c567d13a-0d9d-4469-916e-a4e115957ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:42.900570 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567d13a-0d9d-4469-916e-a4e115957ccd admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:42.905589 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef74d2-fd12-419b-80db-ae071af74d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:42.906239 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef74d2-fd12-419b-80db-ae071af74d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:42.906515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef74d2-fd12-419b-80db-ae071af74d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:42.906785 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef74d2-fd12-419b-80db-ae071af74d40 admin admin] PATH_INFO: `/v3/projects/e59ae542ed2a438cb0df72cce43474f0` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:42.907979 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef74d2-fd12-419b-80db-ae071af74d40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e59ae542ed2a438cb0df72cce43474f0)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:42.910243 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef74d2-fd12-419b-80db-ae071af74d40 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:42.919026 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-3e229d48-e26b-48e9-b476-af2ed8c5df16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b67c878d42c94515a8a4ab613c170f02'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:42.926798 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1112/2227] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:56:42 2022] DELETE /identity/v3/users/b67c878d42c94515a8a4ab613c170f02 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:56:42.927942 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb8a0c-ba10-4a86-9336-c7b2935237ea None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:42.927942 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb8a0c-ba10-4a86-9336-c7b2935237ea None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:42.928223 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb8a0c-ba10-4a86-9336-c7b2935237ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:42.948397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-5efb8a0c-ba10-4a86-9336-c7b2935237ea None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:42.949663 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-5efb8a0c-ba10-4a86-9336-c7b2935237ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:42.958114 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:43.013657 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1113/2228] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:43.015063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b961cd2-c169-4409-b1c5-e376ed6e70c1 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:43.015350 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b961cd2-c169-4409-b1c5-e376ed6e70c1 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:43.015650 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b961cd2-c169-4409-b1c5-e376ed6e70c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:43.037181 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-5b961cd2-c169-4409-b1c5-e376ed6e70c1 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:43.038383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-5b961cd2-c169-4409-b1c5-e376ed6e70c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:43.047183 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1114/2229] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:43.048023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b961cd2-c169-4409-b1c5-e376ed6e70c1 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:43.057114 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-5b961cd2-c169-4409-b1c5-e376ed6e70c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:43.069134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-9aef74d2-fd12-419b-80db-ae071af74d40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e59ae542ed2a438cb0df72cce43474f0', 'request_id': 'req-9aef74d2-fd12-419b-80db-ae071af74d40'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:43.076402 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-9aef74d2-fd12-419b-80db-ae071af74d40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e59ae542ed2a438cb0df72cce43474f0', 'request_id': 'req-9aef74d2-fd12-419b-80db-ae071af74d40'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:43.120863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b961cd2-c169-4409-b1c5-e376ed6e70c1 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:43.153852 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-9aef74d2-fd12-419b-80db-ae071af74d40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e59ae542ed2a438cb0df72cce43474f0', 'request_id': 'req-9aef74d2-fd12-419b-80db-ae071af74d40'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:43.170882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-9aef74d2-fd12-419b-80db-ae071af74d40 admin admin] The token cache is being invalidate because project e59ae542ed2a438cb0df72cce43474f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:56:43.171547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-9aef74d2-fd12-419b-80db-ae071af74d40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:43.172036 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-9aef74d2-fd12-419b-80db-ae071af74d40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:43.175591 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1116/2230] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:56:42 2022] DELETE /identity/v3/projects/e59ae542ed2a438cb0df72cce43474f0 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:43.176492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef74d2-fd12-419b-80db-ae071af74d40 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:43.177950 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-9aef74d2-fd12-419b-80db-ae071af74d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:43.248027 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2795f-b7c4-41c5-9012-518c0bef32a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:43.249343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2795f-b7c4-41c5-9012-518c0bef32a1 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:43.251741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2795f-b7c4-41c5-9012-518c0bef32a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:43.252241 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2795f-b7c4-41c5-9012-518c0bef32a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:43.257846 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-e5e2795f-b7c4-41c5-9012-518c0bef32a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:43.271756 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:43.304346 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef74d2-fd12-419b-80db-ae071af74d40 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:43.310211 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c4a4e-0c8a-42bb-9a2a-4b259d390349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:43.311133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c4a4e-0c8a-42bb-9a2a-4b259d390349 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:43.311632 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c4a4e-0c8a-42bb-9a2a-4b259d390349 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:43.312144 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c4a4e-0c8a-42bb-9a2a-4b259d390349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:43.314066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-d66c4a4e-0c8a-42bb-9a2a-4b259d390349 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:43.396070 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2795f-b7c4-41c5-9012-518c0bef32a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:43.397918 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2795f-b7c4-41c5-9012-518c0bef32a1 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:43.418225 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1115/2231] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:56:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:56:43.419669 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e458af-0dd7-4593-b27b-45e20226b611 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:43.419960 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e458af-0dd7-4593-b27b-45e20226b611 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:43.420247 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e458af-0dd7-4593-b27b-45e20226b611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:43.441418 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c4a4e-0c8a-42bb-9a2a-4b259d390349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:43.442940 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c4a4e-0c8a-42bb-9a2a-4b259d390349 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:43.444685 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-b5e458af-0dd7-4593-b27b-45e20226b611 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:43.445754 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b5e458af-0dd7-4593-b27b-45e20226b611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:43.462847 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1116/2232] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:43.463864 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e458af-0dd7-4593-b27b-45e20226b611 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:43.468406 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b5e458af-0dd7-4593-b27b-45e20226b611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:43.470210 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1117/2233] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:56:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:56:43.471903 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc4dec-1372-483b-9a8f-0c2708756358 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:43.473250 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc4dec-1372-483b-9a8f-0c2708756358 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:43.474736 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc4dec-1372-483b-9a8f-0c2708756358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:43.479063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e458af-0dd7-4593-b27b-45e20226b611 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:43.484481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2e27d-e619-4fb8-a8a3-207ff3e573bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:43.485121 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2e27d-e619-4fb8-a8a3-207ff3e573bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:43.485403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2e27d-e619-4fb8-a8a3-207ff3e573bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:43.485685 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2e27d-e619-4fb8-a8a3-207ff3e573bf admin admin] PATH_INFO: `/v3/users/32e93bb245c6446195bc35569a90d9b2` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:43.486845 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e2e27d-e619-4fb8-a8a3-207ff3e573bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=32e93bb245c6446195bc35569a90d9b2)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:43.489062 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e2e27d-e619-4fb8-a8a3-207ff3e573bf admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:43.491418 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:43.500433 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-c7dc4dec-1372-483b-9a8f-0c2708756358 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:43.501817 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c7dc4dec-1372-483b-9a8f-0c2708756358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:43.512635 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1118/2234] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:43.524582 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc4dec-1372-483b-9a8f-0c2708756358 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:43.536749 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc4dec-1372-483b-9a8f-0c2708756358 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:43.541714 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f67e0-a8eb-4d6c-ab12-8485fbb03aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:43.542436 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f67e0-a8eb-4d6c-ab12-8485fbb03aed admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:43.542925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f67e0-a8eb-4d6c-ab12-8485fbb03aed admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:43.543109 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f67e0-a8eb-4d6c-ab12-8485fbb03aed admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:43.543914 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f67e0-a8eb-4d6c-ab12-8485fbb03aed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:56:43.544306 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f67e0-a8eb-4d6c-ab12-8485fbb03aed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:43.553329 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f67e0-a8eb-4d6c-ab12-8485fbb03aed admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:43.563873 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1119/2235] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:56:43.568460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f67e0-a8eb-4d6c-ab12-8485fbb03aed admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:43.582608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f67e0-a8eb-4d6c-ab12-8485fbb03aed admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:43.587864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99466a90-3577-4c73-90e4-420120894a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:43.588470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99466a90-3577-4c73-90e4-420120894a40 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:43.598227 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99466a90-3577-4c73-90e4-420120894a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:43.598227 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99466a90-3577-4c73-90e4-420120894a40 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:43.598227 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99466a90-3577-4c73-90e4-420120894a40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:43.598227 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99466a90-3577-4c73-90e4-420120894a40 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:43.692263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1120/2236] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:56:43 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:56:43.696103 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99466a90-3577-4c73-90e4-420120894a40 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:43.763895 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99466a90-3577-4c73-90e4-420120894a40 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:43.790123 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340160f-0405-4700-a243-7a1ff50642cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:43.790855 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340160f-0405-4700-a243-7a1ff50642cb admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:43.791143 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340160f-0405-4700-a243-7a1ff50642cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:43.791448 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340160f-0405-4700-a243-7a1ff50642cb admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:43.793617 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d340160f-0405-4700-a243-7a1ff50642cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:43.795997 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d340160f-0405-4700-a243-7a1ff50642cb admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:43.802584 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-99e2e27d-e619-4fb8-a8a3-207ff3e573bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32e93bb245c6446195bc35569a90d9b2'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:43.803911 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-99e2e27d-e619-4fb8-a8a3-207ff3e573bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32e93bb245c6446195bc35569a90d9b2'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:43.821019 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-99e2e27d-e619-4fb8-a8a3-207ff3e573bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32e93bb245c6446195bc35569a90d9b2'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:43.828700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-99e2e27d-e619-4fb8-a8a3-207ff3e573bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32e93bb245c6446195bc35569a90d9b2'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:43.913119 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-99e2e27d-e619-4fb8-a8a3-207ff3e573bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32e93bb245c6446195bc35569a90d9b2'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:43.923711 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1121/2237] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:56:43 2022] POST /identity/v3/users => generated 292 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:56:43.925118 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340160f-0405-4700-a243-7a1ff50642cb admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:43.927736 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1117/2238] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:56:43 2022] DELETE /identity/v3/users/32e93bb245c6446195bc35569a90d9b2 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:43.932013 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641b036-665a-4dd4-ae5f-9c718c000f0a None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:43.933871 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-d340160f-0405-4700-a243-7a1ff50642cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:43.935330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641b036-665a-4dd4-ae5f-9c718c000f0a None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:43.935645 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641b036-665a-4dd4-ae5f-9c718c000f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:43.957004 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340160f-0405-4700-a243-7a1ff50642cb admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:43.966230 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-e641b036-665a-4dd4-ae5f-9c718c000f0a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:43.967395 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-e641b036-665a-4dd4-ae5f-9c718c000f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:44.065715 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825758e3-b9af-49cf-8149-10fe983eb0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:44.066348 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825758e3-b9af-49cf-8149-10fe983eb0ec admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:44.066628 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825758e3-b9af-49cf-8149-10fe983eb0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:44.066899 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825758e3-b9af-49cf-8149-10fe983eb0ec admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:44.067816 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825758e3-b9af-49cf-8149-10fe983eb0ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:44.069969 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825758e3-b9af-49cf-8149-10fe983eb0ec admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:44.070515 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1118/2239] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:56:44.079200 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641b036-665a-4dd4-ae5f-9c718c000f0a None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:44.083178 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1122/2240] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:44.087030 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-e641b036-665a-4dd4-ae5f-9c718c000f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:44.088412 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825758e3-b9af-49cf-8149-10fe983eb0ec admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:44.105831 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825758e3-b9af-49cf-8149-10fe983eb0ec admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:44.133487 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53886173-eccc-4e50-a02f-fec2f81aaa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:44.134641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53886173-eccc-4e50-a02f-fec2f81aaa82 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:44.134641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53886173-eccc-4e50-a02f-fec2f81aaa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:44.134641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53886173-eccc-4e50-a02f-fec2f81aaa82 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:44.135327 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53886173-eccc-4e50-a02f-fec2f81aaa82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:44.139202 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53886173-eccc-4e50-a02f-fec2f81aaa82 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:44.152169 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1123/2241] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:44.157091 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53886173-eccc-4e50-a02f-fec2f81aaa82 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:44.171572 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53886173-eccc-4e50-a02f-fec2f81aaa82 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:44.176440 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c18bee-e7d5-4815-902e-3ddcdbb852aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:44.177039 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c18bee-e7d5-4815-902e-3ddcdbb852aa admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:44.177577 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c18bee-e7d5-4815-902e-3ddcdbb852aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:44.177698 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c18bee-e7d5-4815-902e-3ddcdbb852aa admin admin] PATH_INFO: `/v3/projects/6adc50a0779f4f7c8b9e4eac1804a7e6/users/c0a5e7b4e1b3420ca900960235ead029/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:44.182687 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:44.196683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641b036-665a-4dd4-ae5f-9c718c000f0a None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:44.200212 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c18bee-e7d5-4815-902e-3ddcdbb852aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6adc50a0779f4f7c8b9e4eac1804a7e6, user_id=c0a5e7b4e1b3420ca900960235ead029, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:44.203999 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c18bee-e7d5-4815-902e-3ddcdbb852aa admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:44.209654 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eed69b-bee6-41e8-9291-9010997d9a5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:44.210308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eed69b-bee6-41e8-9291-9010997d9a5d service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:44.210584 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eed69b-bee6-41e8-9291-9010997d9a5d service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:44.210861 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eed69b-bee6-41e8-9291-9010997d9a5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:44.240226 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eed69b-bee6-41e8-9291-9010997d9a5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:44.248043 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eed69b-bee6-41e8-9291-9010997d9a5d service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:44.289311 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1119/2242] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:56:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:56:44.300237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eed69b-bee6-41e8-9291-9010997d9a5d service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:44.307629 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-15eed69b-bee6-41e8-9291-9010997d9a5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:44.329892 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eed69b-bee6-41e8-9291-9010997d9a5d service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:44.338131 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343180fe-ae2f-4ccf-b4b1-297a065db443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:44.338131 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343180fe-ae2f-4ccf-b4b1-297a065db443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:44.338131 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343180fe-ae2f-4ccf-b4b1-297a065db443 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:44.338397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343180fe-ae2f-4ccf-b4b1-297a065db443 admin admin] PATH_INFO: `/v3/projects/8d92e25609ad41e28133d1e3bd7e7873` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:44.340830 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343180fe-ae2f-4ccf-b4b1-297a065db443 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d92e25609ad41e28133d1e3bd7e7873)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:44.343285 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343180fe-ae2f-4ccf-b4b1-297a065db443 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:44.365474 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:44.410501 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1124/2243] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:56:44 2022] PUT /identity/v3/projects/6adc50a0779f4f7c8b9e4eac1804a7e6/users/c0a5e7b4e1b3420ca900960235ead029/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:44.411470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c18bee-e7d5-4815-902e-3ddcdbb852aa admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:44.419693 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-e9c18bee-e7d5-4815-902e-3ddcdbb852aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:44.520326 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c18bee-e7d5-4815-902e-3ddcdbb852aa admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:44.534366 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f937cd1-ce6e-4e05-bc98-0c45fbcd4ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:44.535025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f937cd1-ce6e-4e05-bc98-0c45fbcd4ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:44.535295 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f937cd1-ce6e-4e05-bc98-0c45fbcd4ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:44.535629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f937cd1-ce6e-4e05-bc98-0c45fbcd4ea2 admin admin] PATH_INFO: `/v3/projects/5014ca06e1134ed790b6c1c21cf4d4d1` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:44.538581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f937cd1-ce6e-4e05-bc98-0c45fbcd4ea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5014ca06e1134ed790b6c1c21cf4d4d1)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:44.542068 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f937cd1-ce6e-4e05-bc98-0c45fbcd4ea2 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:44.590327 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-343180fe-ae2f-4ccf-b4b1-297a065db443 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d92e25609ad41e28133d1e3bd7e7873', 'request_id': 'req-343180fe-ae2f-4ccf-b4b1-297a065db443'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:44.601253 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-343180fe-ae2f-4ccf-b4b1-297a065db443 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d92e25609ad41e28133d1e3bd7e7873', 'request_id': 'req-343180fe-ae2f-4ccf-b4b1-297a065db443'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:44.612815 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-343180fe-ae2f-4ccf-b4b1-297a065db443 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d92e25609ad41e28133d1e3bd7e7873', 'request_id': 'req-343180fe-ae2f-4ccf-b4b1-297a065db443'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:44.677406 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-4f937cd1-ce6e-4e05-bc98-0c45fbcd4ea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5014ca06e1134ed790b6c1c21cf4d4d1', 'request_id': 'req-4f937cd1-ce6e-4e05-bc98-0c45fbcd4ea2'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:44.684428 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-4f937cd1-ce6e-4e05-bc98-0c45fbcd4ea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5014ca06e1134ed790b6c1c21cf4d4d1', 'request_id': 'req-4f937cd1-ce6e-4e05-bc98-0c45fbcd4ea2'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:44.750912 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-343180fe-ae2f-4ccf-b4b1-297a065db443 admin admin] The token cache is being invalidate because project 8d92e25609ad41e28133d1e3bd7e7873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:56:44.750912 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-343180fe-ae2f-4ccf-b4b1-297a065db443 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:44.750912 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-343180fe-ae2f-4ccf-b4b1-297a065db443 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:44.752444 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1120/2244] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:56:44 2022] DELETE /identity/v3/projects/8d92e25609ad41e28133d1e3bd7e7873 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:44.756786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc23d3c-569e-4604-8468-8f5f57a65410 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:44.757074 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc23d3c-569e-4604-8468-8f5f57a65410 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:44.757355 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc23d3c-569e-4604-8468-8f5f57a65410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:44.788711 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-dfc23d3c-569e-4604-8468-8f5f57a65410 None None] MFA Rules not processed for user `c0a5e7b4e1b3420ca900960235ead029`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:44.789936 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-dfc23d3c-569e-4604-8468-8f5f57a65410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:44.849380 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-4f937cd1-ce6e-4e05-bc98-0c45fbcd4ea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5014ca06e1134ed790b6c1c21cf4d4d1', 'request_id': 'req-4f937cd1-ce6e-4e05-bc98-0c45fbcd4ea2'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:44.866509 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-4f937cd1-ce6e-4e05-bc98-0c45fbcd4ea2 admin admin] The token cache is being invalidate because project 5014ca06e1134ed790b6c1c21cf4d4d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:56:44.866723 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-4f937cd1-ce6e-4e05-bc98-0c45fbcd4ea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:44.867320 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-4f937cd1-ce6e-4e05-bc98-0c45fbcd4ea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:44.874120 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1125/2245] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:56:44 2022] DELETE /identity/v3/projects/5014ca06e1134ed790b6c1c21cf4d4d1 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:44.874120 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f937cd1-ce6e-4e05-bc98-0c45fbcd4ea2 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:44.874372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1121/2246] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:44.875911 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-4f937cd1-ce6e-4e05-bc98-0c45fbcd4ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:44.877942 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc23d3c-569e-4604-8468-8f5f57a65410 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:44.879602 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-dfc23d3c-569e-4604-8468-8f5f57a65410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:44.967715 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f937cd1-ce6e-4e05-bc98-0c45fbcd4ea2 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:44.976241 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc23d3c-569e-4604-8468-8f5f57a65410 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:44.976454 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30d5db-677c-418f-96f3-c05d35e864ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:44.976819 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30d5db-677c-418f-96f3-c05d35e864ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:44.977103 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30d5db-677c-418f-96f3-c05d35e864ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:44.977495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30d5db-677c-418f-96f3-c05d35e864ee admin admin] PATH_INFO: `/v3/users/3401ac1439f0456ea221b9d4fed14f9b` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:44.978719 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be30d5db-677c-418f-96f3-c05d35e864ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=3401ac1439f0456ea221b9d4fed14f9b)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:44.980969 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be30d5db-677c-418f-96f3-c05d35e864ee admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:44.992883 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f204ac-04dc-40f5-896c-3bfc40df95c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:44.992883 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f204ac-04dc-40f5-896c-3bfc40df95c8 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:44.992883 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f204ac-04dc-40f5-896c-3bfc40df95c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:44.992883 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f204ac-04dc-40f5-896c-3bfc40df95c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:44.993298 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f204ac-04dc-40f5-896c-3bfc40df95c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:44.993455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f204ac-04dc-40f5-896c-3bfc40df95c8 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:45.105865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1122/2247] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:56:44 2022] POST /identity/v3/projects => generated 383 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:45.107241 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d15b06-407c-4f72-9b8b-4f3dd570f11b None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:45.107564 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d15b06-407c-4f72-9b8b-4f3dd570f11b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:45.107849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d15b06-407c-4f72-9b8b-4f3dd570f11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:45.132904 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-d5d15b06-407c-4f72-9b8b-4f3dd570f11b None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:45.134294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-d5d15b06-407c-4f72-9b8b-4f3dd570f11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:45.200004 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1123/2248] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:45.201077 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d15b06-407c-4f72-9b8b-4f3dd570f11b None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:45.205802 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-d5d15b06-407c-4f72-9b8b-4f3dd570f11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:45.220373 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-be30d5db-677c-418f-96f3-c05d35e864ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3401ac1439f0456ea221b9d4fed14f9b'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:45.267632 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d15b06-407c-4f72-9b8b-4f3dd570f11b None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:45.271860 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2de01-183d-40c3-865d-a2f761722478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:45.272429 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2de01-183d-40c3-865d-a2f761722478 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:45.272733 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2de01-183d-40c3-865d-a2f761722478 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:45.273012 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2de01-183d-40c3-865d-a2f761722478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:45.275450 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-bce2de01-183d-40c3-865d-a2f761722478 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:45.347551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2de01-183d-40c3-865d-a2f761722478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:45.349026 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2de01-183d-40c3-865d-a2f761722478 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:45.350854 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-be30d5db-677c-418f-96f3-c05d35e864ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3401ac1439f0456ea221b9d4fed14f9b'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:45.371678 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-be30d5db-677c-418f-96f3-c05d35e864ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3401ac1439f0456ea221b9d4fed14f9b'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:45.371808 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1124/2249] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:56:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:56:45.371808 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2de01-183d-40c3-865d-a2f761722478 service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:45.371808 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-bce2de01-183d-40c3-865d-a2f761722478 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:45.376404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-be30d5db-677c-418f-96f3-c05d35e864ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3401ac1439f0456ea221b9d4fed14f9b'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:45.382176 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-be30d5db-677c-418f-96f3-c05d35e864ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3401ac1439f0456ea221b9d4fed14f9b'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:45.384985 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1126/2250] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:56:44 2022] DELETE /identity/v3/users/3401ac1439f0456ea221b9d4fed14f9b => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:45.389639 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30d5db-677c-418f-96f3-c05d35e864ee admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:45.390948 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2de01-183d-40c3-865d-a2f761722478 service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:45.391509 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-be30d5db-677c-418f-96f3-c05d35e864ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:45.455256 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94eb638-f098-4880-97fd-0408d28dff12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:45.456255 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94eb638-f098-4880-97fd-0408d28dff12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:45.456773 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94eb638-f098-4880-97fd-0408d28dff12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:45.456994 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94eb638-f098-4880-97fd-0408d28dff12 admin admin] PATH_INFO: `/v3/projects/219cd6bbbbf942debec88577d7f18646` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:45.458179 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94eb638-f098-4880-97fd-0408d28dff12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=219cd6bbbbf942debec88577d7f18646)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:45.460258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94eb638-f098-4880-97fd-0408d28dff12 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:45.473088 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30d5db-677c-418f-96f3-c05d35e864ee admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:45.475564 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc860ecb-56a7-4892-b028-dee06219aa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:45.476281 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc860ecb-56a7-4892-b028-dee06219aa8a admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:45.476642 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc860ecb-56a7-4892-b028-dee06219aa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:45.477137 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc860ecb-56a7-4892-b028-dee06219aa8a admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:45.478254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc860ecb-56a7-4892-b028-dee06219aa8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:45.480931 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc860ecb-56a7-4892-b028-dee06219aa8a admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:45.536328 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:45.617061 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1127/2251] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:56:45 2022] POST /identity/v3/users => generated 292 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:45.618485 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e0f74-0007-4f8f-ab34-3aa5e227864e None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:45.622450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e0f74-0007-4f8f-ab34-3aa5e227864e None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:45.622450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e0f74-0007-4f8f-ab34-3aa5e227864e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:45.634445 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c94eb638-f098-4880-97fd-0408d28dff12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '219cd6bbbbf942debec88577d7f18646', 'request_id': 'req-c94eb638-f098-4880-97fd-0408d28dff12'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:45.642880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c94eb638-f098-4880-97fd-0408d28dff12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '219cd6bbbbf942debec88577d7f18646', 'request_id': 'req-c94eb638-f098-4880-97fd-0408d28dff12'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:45.656295 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-4c8e0f74-0007-4f8f-ab34-3aa5e227864e None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:45.657469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c94eb638-f098-4880-97fd-0408d28dff12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '219cd6bbbbf942debec88577d7f18646', 'request_id': 'req-c94eb638-f098-4880-97fd-0408d28dff12'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:45.660495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-4c8e0f74-0007-4f8f-ab34-3aa5e227864e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:45.735125 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1128/2252] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:45.736144 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e0f74-0007-4f8f-ab34-3aa5e227864e None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:45.745808 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e0f74-0007-4f8f-ab34-3aa5e227864e None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:45.750812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc3e7e-bae1-4013-bc53-5a2104ba6af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:45.751595 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc3e7e-bae1-4013-bc53-5a2104ba6af6 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:45.751785 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc3e7e-bae1-4013-bc53-5a2104ba6af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:45.752063 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc3e7e-bae1-4013-bc53-5a2104ba6af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:45.752717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc3e7e-bae1-4013-bc53-5a2104ba6af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:45.754349 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc3e7e-bae1-4013-bc53-5a2104ba6af6 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:45.765995 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1129/2253] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:45.766810 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc3e7e-bae1-4013-bc53-5a2104ba6af6 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:45.780016 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc3e7e-bae1-4013-bc53-5a2104ba6af6 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:45.783184 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c94eb638-f098-4880-97fd-0408d28dff12 admin admin] The token cache is being invalidate because project 219cd6bbbbf942debec88577d7f18646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:56:45.786294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c94eb638-f098-4880-97fd-0408d28dff12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:45.786795 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413a96d-9330-4d64-a191-247a52b32054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:45.786913 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c94eb638-f098-4880-97fd-0408d28dff12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:45.787021 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413a96d-9330-4d64-a191-247a52b32054 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:45.787021 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413a96d-9330-4d64-a191-247a52b32054 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:45.787021 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413a96d-9330-4d64-a191-247a52b32054 admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:45.787321 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413a96d-9330-4d64-a191-247a52b32054 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:56:45.788005 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413a96d-9330-4d64-a191-247a52b32054 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:45.788614 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1125/2254] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:56:45 2022] DELETE /identity/v3/projects/219cd6bbbbf942debec88577d7f18646 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:45.792038 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413a96d-9330-4d64-a191-247a52b32054 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:45.794101 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94eb638-f098-4880-97fd-0408d28dff12 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:45.796482 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c94eb638-f098-4880-97fd-0408d28dff12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:45.808102 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1130/2255] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:56:45.809990 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a5018-b820-41bf-9d50-3ab9be2db377 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:45.810451 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a5018-b820-41bf-9d50-3ab9be2db377 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:45.810901 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a5018-b820-41bf-9d50-3ab9be2db377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:45.815345 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94eb638-f098-4880-97fd-0408d28dff12 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:45.821568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9d5dd-caa9-447b-9830-4cb50426c114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:45.822294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9d5dd-caa9-447b-9830-4cb50426c114 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:45.822647 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9d5dd-caa9-447b-9830-4cb50426c114 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:45.823838 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9d5dd-caa9-447b-9830-4cb50426c114 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:45.824729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9d5dd-caa9-447b-9830-4cb50426c114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:45.827164 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9d5dd-caa9-447b-9830-4cb50426c114 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:45.838102 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-680a5018-b820-41bf-9d50-3ab9be2db377 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:45.840380 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-680a5018-b820-41bf-9d50-3ab9be2db377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:45.850053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1131/2256] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:45.851856 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a5018-b820-41bf-9d50-3ab9be2db377 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:45.853488 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-680a5018-b820-41bf-9d50-3ab9be2db377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:45.855831 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1126/2257] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:45.861907 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ab52d-72a8-4968-b891-4309d8d72ae5 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:45.862883 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ab52d-72a8-4968-b891-4309d8d72ae5 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:45.863568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ab52d-72a8-4968-b891-4309d8d72ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:45.880792 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a5018-b820-41bf-9d50-3ab9be2db377 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:45.892990 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-c10ab52d-72a8-4968-b891-4309d8d72ae5 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:45.893588 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ecc8b-ee66-4b74-96b1-b02c5d97f75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:45.893956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ecc8b-ee66-4b74-96b1-b02c5d97f75f admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:45.894439 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ecc8b-ee66-4b74-96b1-b02c5d97f75f admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:45.894661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c10ab52d-72a8-4968-b891-4309d8d72ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:45.895167 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ecc8b-ee66-4b74-96b1-b02c5d97f75f admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:45.896199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ecc8b-ee66-4b74-96b1-b02c5d97f75f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:45.903213 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ecc8b-ee66-4b74-96b1-b02c5d97f75f admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:45.911650 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1127/2258] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:45.911650 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ab52d-72a8-4968-b891-4309d8d72ae5 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:45.929377 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ab52d-72a8-4968-b891-4309d8d72ae5 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:45.943472 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c816358-1d74-41dd-8708-9277a74590dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:45.944933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c816358-1d74-41dd-8708-9277a74590dd admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:45.945227 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c816358-1d74-41dd-8708-9277a74590dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:45.945506 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c816358-1d74-41dd-8708-9277a74590dd admin admin] PATH_INFO: `/v3/projects/180fcde75b2949c8b2d0d53adc1a6a06/users/99efc00443cc46c3a318ac78ef0f1658/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:45.963832 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c816358-1d74-41dd-8708-9277a74590dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=180fcde75b2949c8b2d0d53adc1a6a06, user_id=99efc00443cc46c3a318ac78ef0f1658, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:45.969679 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c816358-1d74-41dd-8708-9277a74590dd admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:46.066424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1128/2259] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:56:45 2022] PUT /identity/v3/projects/180fcde75b2949c8b2d0d53adc1a6a06/users/99efc00443cc46c3a318ac78ef0f1658/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:46.067549 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c816358-1d74-41dd-8708-9277a74590dd admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:46.080513 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1132/2260] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:56:45 2022] POST /identity/v3/projects => generated 379 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:46.082274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd7f6b-f246-4bce-9397-ca3f7032f29c None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:46.082563 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd7f6b-f246-4bce-9397-ca3f7032f29c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:46.082838 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd7f6b-f246-4bce-9397-ca3f7032f29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:46.114428 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-80cd7f6b-f246-4bce-9397-ca3f7032f29c None None] MFA Rules not processed for user `99efc00443cc46c3a318ac78ef0f1658`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:46.116948 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-80cd7f6b-f246-4bce-9397-ca3f7032f29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:46.142858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c816358-1d74-41dd-8708-9277a74590dd admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:46.218721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329382f-70b3-484b-a9d2-379e8ba40f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:46.219347 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329382f-70b3-484b-a9d2-379e8ba40f4d admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:46.219663 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329382f-70b3-484b-a9d2-379e8ba40f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:46.219981 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329382f-70b3-484b-a9d2-379e8ba40f4d admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:46.221508 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329382f-70b3-484b-a9d2-379e8ba40f4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:56:46.221508 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329382f-70b3-484b-a9d2-379e8ba40f4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:46.223097 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329382f-70b3-484b-a9d2-379e8ba40f4d admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:46.224153 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1133/2261] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:46.224988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd7f6b-f246-4bce-9397-ca3f7032f29c None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:46.235791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd7f6b-f246-4bce-9397-ca3f7032f29c None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:46.240584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88ad3c-650c-4773-8b9a-83dd13494d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:46.241193 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88ad3c-650c-4773-8b9a-83dd13494d48 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:46.241468 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88ad3c-650c-4773-8b9a-83dd13494d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:46.241747 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88ad3c-650c-4773-8b9a-83dd13494d48 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:46.242033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1129/2262] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:56:46.242414 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88ad3c-650c-4773-8b9a-83dd13494d48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:46.243287 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329382f-70b3-484b-a9d2-379e8ba40f4d admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:46.244368 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88ad3c-650c-4773-8b9a-83dd13494d48 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:46.245009 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-4329382f-70b3-484b-a9d2-379e8ba40f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:46.254158 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:46.259615 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329382f-70b3-484b-a9d2-379e8ba40f4d admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:46.265177 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b7cf4-7e68-4428-a1d4-cebec8061897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:46.265802 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b7cf4-7e68-4428-a1d4-cebec8061897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:46.266105 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b7cf4-7e68-4428-a1d4-cebec8061897 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:46.266376 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b7cf4-7e68-4428-a1d4-cebec8061897 admin admin] PATH_INFO: `/v3/projects/802beab71eb148bebc0aa44473528d5e` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:46.267520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b7cf4-7e68-4428-a1d4-cebec8061897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=802beab71eb148bebc0aa44473528d5e)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:46.269454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b7cf4-7e68-4428-a1d4-cebec8061897 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:46.347922 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1134/2263] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:56:46 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:46.347922 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88ad3c-650c-4773-8b9a-83dd13494d48 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:46.359306 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88ad3c-650c-4773-8b9a-83dd13494d48 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:46.366357 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7228a38-2022-4664-89b2-ef665c4f006c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:46.367411 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7228a38-2022-4664-89b2-ef665c4f006c admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:46.367782 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7228a38-2022-4664-89b2-ef665c4f006c admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:46.368199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7228a38-2022-4664-89b2-ef665c4f006c admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:46.369296 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7228a38-2022-4664-89b2-ef665c4f006c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:46.373019 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7228a38-2022-4664-89b2-ef665c4f006c admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:46.397611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-a28b7cf4-7e68-4428-a1d4-cebec8061897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '802beab71eb148bebc0aa44473528d5e', 'request_id': 'req-a28b7cf4-7e68-4428-a1d4-cebec8061897'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:46.406026 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-a28b7cf4-7e68-4428-a1d4-cebec8061897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '802beab71eb148bebc0aa44473528d5e', 'request_id': 'req-a28b7cf4-7e68-4428-a1d4-cebec8061897'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:46.415589 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-a28b7cf4-7e68-4428-a1d4-cebec8061897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '802beab71eb148bebc0aa44473528d5e', 'request_id': 'req-a28b7cf4-7e68-4428-a1d4-cebec8061897'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:46.501903 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-a28b7cf4-7e68-4428-a1d4-cebec8061897 admin admin] The token cache is being invalidate because project 802beab71eb148bebc0aa44473528d5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:56:46.502476 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-a28b7cf4-7e68-4428-a1d4-cebec8061897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:46.505189 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1135/2264] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:56:46 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:46.507523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7228a38-2022-4664-89b2-ef665c4f006c admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:46.521886 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-a28b7cf4-7e68-4428-a1d4-cebec8061897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:56:46.533693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1130/2265] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:56:46 2022] DELETE /identity/v3/projects/802beab71eb148bebc0aa44473528d5e => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:46.533693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b7cf4-7e68-4428-a1d4-cebec8061897 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:46.533693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a28b7cf4-7e68-4428-a1d4-cebec8061897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:46.600003 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7228a38-2022-4664-89b2-ef665c4f006c admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:46.609655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598636f-9e8f-409e-a374-f70326c30c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:46.610682 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598636f-9e8f-409e-a374-f70326c30c28 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:46.611228 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598636f-9e8f-409e-a374-f70326c30c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:46.611935 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598636f-9e8f-409e-a374-f70326c30c28 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:46.612927 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598636f-9e8f-409e-a374-f70326c30c28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:46.615848 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598636f-9e8f-409e-a374-f70326c30c28 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:46.645365 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b7cf4-7e68-4428-a1d4-cebec8061897 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:46.651501 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621de145-68fa-4d19-ab9b-759e3b0a657a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:46.652267 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621de145-68fa-4d19-ab9b-759e3b0a657a admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:46.652570 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621de145-68fa-4d19-ab9b-759e3b0a657a admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:46.652844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621de145-68fa-4d19-ab9b-759e3b0a657a admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:46.653505 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621de145-68fa-4d19-ab9b-759e3b0a657a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:46.655116 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621de145-68fa-4d19-ab9b-759e3b0a657a admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:46.665717 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1131/2266] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:46.666394 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621de145-68fa-4d19-ab9b-759e3b0a657a admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:46.668185 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-621de145-68fa-4d19-ab9b-759e3b0a657a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:46.685372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621de145-68fa-4d19-ab9b-759e3b0a657a admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:46.689715 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8c647-b100-4c63-b584-71fa3ca2bd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:46.690419 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8c647-b100-4c63-b584-71fa3ca2bd99 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:46.690700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8c647-b100-4c63-b584-71fa3ca2bd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:46.690978 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8c647-b100-4c63-b584-71fa3ca2bd99 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:46.691655 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8c647-b100-4c63-b584-71fa3ca2bd99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:46.693700 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8c647-b100-4c63-b584-71fa3ca2bd99 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:46.719535 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1136/2267] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:56:46 2022] POST /identity/v3/projects => generated 363 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:46.723025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47478231-8703-45ec-bf7d-777caa2a8a3c None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:46.723322 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47478231-8703-45ec-bf7d-777caa2a8a3c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:46.724887 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47478231-8703-45ec-bf7d-777caa2a8a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:46.753315 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-47478231-8703-45ec-bf7d-777caa2a8a3c None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:46.754713 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-47478231-8703-45ec-bf7d-777caa2a8a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:46.794216 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:46.830128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1132/2268] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:56:46 2022] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:46.830128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8c647-b100-4c63-b584-71fa3ca2bd99 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:46.856619 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1137/2269] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:46.858249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47478231-8703-45ec-bf7d-777caa2a8a3c None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:46.861752 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-47478231-8703-45ec-bf7d-777caa2a8a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:46.864989 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8c647-b100-4c63-b584-71fa3ca2bd99 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:46.876248 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47478231-8703-45ec-bf7d-777caa2a8a3c None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:46.878478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac158c9e-d675-4fd5-a9b6-95b7403a3287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:46.879101 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac158c9e-d675-4fd5-a9b6-95b7403a3287 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:46.879397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac158c9e-d675-4fd5-a9b6-95b7403a3287 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:46.879726 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac158c9e-d675-4fd5-a9b6-95b7403a3287 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:46.880389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac158c9e-d675-4fd5-a9b6-95b7403a3287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:46.881663 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a44dd-6afc-49b0-badc-35ccddb0ed81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:46.882338 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac158c9e-d675-4fd5-a9b6-95b7403a3287 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:46.882457 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a44dd-6afc-49b0-badc-35ccddb0ed81 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:46.882636 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a44dd-6afc-49b0-badc-35ccddb0ed81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:46.883077 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a44dd-6afc-49b0-badc-35ccddb0ed81 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:46.883993 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a44dd-6afc-49b0-badc-35ccddb0ed81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:46.887218 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a44dd-6afc-49b0-badc-35ccddb0ed81 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:46.904598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1133/2270] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:46.910956 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac158c9e-d675-4fd5-a9b6-95b7403a3287 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:46.916545 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac158c9e-d675-4fd5-a9b6-95b7403a3287 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:46.924187 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebe40b-0804-4149-9f2d-c5471d394383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:46.924853 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebe40b-0804-4149-9f2d-c5471d394383 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:46.925143 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebe40b-0804-4149-9f2d-c5471d394383 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:46.925499 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebe40b-0804-4149-9f2d-c5471d394383 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:46.926639 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebe40b-0804-4149-9f2d-c5471d394383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:46.929421 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebe40b-0804-4149-9f2d-c5471d394383 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:46.941727 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1134/2271] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:46.942999 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e61f5-33a2-4d38-8ac8-b7dcbef8cab5 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:46.943283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e61f5-33a2-4d38-8ac8-b7dcbef8cab5 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:46.943581 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e61f5-33a2-4d38-8ac8-b7dcbef8cab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:46.965052 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-c40e61f5-33a2-4d38-8ac8-b7dcbef8cab5 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:46.966342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c40e61f5-33a2-4d38-8ac8-b7dcbef8cab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:46.975776 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1135/2272] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:46.976419 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e61f5-33a2-4d38-8ac8-b7dcbef8cab5 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:46.988497 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e61f5-33a2-4d38-8ac8-b7dcbef8cab5 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:46.993823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f51bbf-3de3-4c21-949e-01246c6ccc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:46.994897 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f51bbf-3de3-4c21-949e-01246c6ccc43 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:46.994897 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f51bbf-3de3-4c21-949e-01246c6ccc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:46.995126 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f51bbf-3de3-4c21-949e-01246c6ccc43 admin admin] PATH_INFO: `/v3/projects/4c6e12d2b4fa462eb7cd1275d14faee0/users/b838210ed8ba4cac973eca59c1746c7b/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:47.007411 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1138/2273] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:56:46 2022] POST /identity/v3/users => generated 282 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:47.007411 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a44dd-6afc-49b0-badc-35ccddb0ed81 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:47.016662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f51bbf-3de3-4c21-949e-01246c6ccc43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c6e12d2b4fa462eb7cd1275d14faee0, user_id=b838210ed8ba4cac973eca59c1746c7b, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:47.019553 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f51bbf-3de3-4c21-949e-01246c6ccc43 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:47.037993 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a44dd-6afc-49b0-badc-35ccddb0ed81 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:47.044067 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424df26-7944-4467-9125-fb14eb5a8a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:47.044835 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424df26-7944-4467-9125-fb14eb5a8a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:47.045190 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424df26-7944-4467-9125-fb14eb5a8a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:47.045470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424df26-7944-4467-9125-fb14eb5a8a50 admin admin] PATH_INFO: `/v3/projects/9f1e96fbfbff4798b8d617394f391f7e/users/2f74ba9e1886432087dcdbffd83e50be/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:47.062882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424df26-7944-4467-9125-fb14eb5a8a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f1e96fbfbff4798b8d617394f391f7e, user_id=2f74ba9e1886432087dcdbffd83e50be, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:47.065693 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424df26-7944-4467-9125-fb14eb5a8a50 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:47.102666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:47.146708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1136/2274] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:56:46 2022] PUT /identity/v3/projects/4c6e12d2b4fa462eb7cd1275d14faee0/users/b838210ed8ba4cac973eca59c1746c7b/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:47.146708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f51bbf-3de3-4c21-949e-01246c6ccc43 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:47.172918 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1139/2275] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:56:47 2022] PUT /identity/v3/projects/9f1e96fbfbff4798b8d617394f391f7e/users/2f74ba9e1886432087dcdbffd83e50be/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:47.176511 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424df26-7944-4467-9125-fb14eb5a8a50 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:47.226111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f51bbf-3de3-4c21-949e-01246c6ccc43 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:47.255886 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424df26-7944-4467-9125-fb14eb5a8a50 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:47.261083 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39906828-5fa5-4431-8679-065247d4dd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:47.261836 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39906828-5fa5-4431-8679-065247d4dd1a admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:47.262164 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39906828-5fa5-4431-8679-065247d4dd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:47.262442 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39906828-5fa5-4431-8679-065247d4dd1a admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:47.263108 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39906828-5fa5-4431-8679-065247d4dd1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:47.264919 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39906828-5fa5-4431-8679-065247d4dd1a admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:47.276074 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1140/2276] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:47.277897 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91a6c1-3af8-4d78-b263-bc3dc2481325 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:47.278198 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91a6c1-3af8-4d78-b263-bc3dc2481325 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:47.278453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91a6c1-3af8-4d78-b263-bc3dc2481325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:47.299256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-8d91a6c1-3af8-4d78-b263-bc3dc2481325 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:47.300617 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-8d91a6c1-3af8-4d78-b263-bc3dc2481325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:47.301019 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e1b9d-9d8c-4045-b37a-73297487fc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:47.303692 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e1b9d-9d8c-4045-b37a-73297487fc71 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:47.304278 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e1b9d-9d8c-4045-b37a-73297487fc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:47.304851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e1b9d-9d8c-4045-b37a-73297487fc71 admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:47.305886 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e1b9d-9d8c-4045-b37a-73297487fc71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:56:47.306391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e1b9d-9d8c-4045-b37a-73297487fc71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:47.308608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e1b9d-9d8c-4045-b37a-73297487fc71 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:47.311475 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1141/2277] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:47.312329 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91a6c1-3af8-4d78-b263-bc3dc2481325 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:47.322269 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91a6c1-3af8-4d78-b263-bc3dc2481325 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:47.333658 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1137/2278] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:56:47.335435 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e1b9d-9d8c-4045-b37a-73297487fc71 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:47.337937 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87d37f-4626-457d-9305-4d750c031630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:47.338580 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87d37f-4626-457d-9305-4d750c031630 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:47.338871 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87d37f-4626-457d-9305-4d750c031630 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:47.340498 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87d37f-4626-457d-9305-4d750c031630 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:47.340498 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87d37f-4626-457d-9305-4d750c031630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:47.342353 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87d37f-4626-457d-9305-4d750c031630 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:47.353327 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1142/2279] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:47.358336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87d37f-4626-457d-9305-4d750c031630 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:47.366620 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e1b9d-9d8c-4045-b37a-73297487fc71 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:47.368564 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87d37f-4626-457d-9305-4d750c031630 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:47.374424 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210304c-199e-4aa9-a302-107ba99ea073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:47.375047 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210304c-199e-4aa9-a302-107ba99ea073 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:47.380748 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210304c-199e-4aa9-a302-107ba99ea073 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:47.380748 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210304c-199e-4aa9-a302-107ba99ea073 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:47.380748 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210304c-199e-4aa9-a302-107ba99ea073 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:47.381111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6a7e6-7caf-4b5d-b6ee-acbaad4b919b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:47.381111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6a7e6-7caf-4b5d-b6ee-acbaad4b919b admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:47.381111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6a7e6-7caf-4b5d-b6ee-acbaad4b919b admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:47.381111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6a7e6-7caf-4b5d-b6ee-acbaad4b919b admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:47.381472 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210304c-199e-4aa9-a302-107ba99ea073 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:47.381561 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6a7e6-7caf-4b5d-b6ee-acbaad4b919b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:47.381561 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6a7e6-7caf-4b5d-b6ee-acbaad4b919b admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:47.395156 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1138/2280] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:47.396169 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6a7e6-7caf-4b5d-b6ee-acbaad4b919b admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:47.398051 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-79d6a7e6-7caf-4b5d-b6ee-acbaad4b919b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:47.478148 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6a7e6-7caf-4b5d-b6ee-acbaad4b919b admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:47.481845 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:47.487199 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2e5df-776a-4ea0-a209-d4f088a320ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:47.487199 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2e5df-776a-4ea0-a209-d4f088a320ef service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:47.487199 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2e5df-776a-4ea0-a209-d4f088a320ef service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:47.487199 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2e5df-776a-4ea0-a209-d4f088a320ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:47.498180 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2e5df-776a-4ea0-a209-d4f088a320ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:47.499698 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2e5df-776a-4ea0-a209-d4f088a320ef service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:47.512000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1139/2281] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:56:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:56:47.513105 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2e5df-776a-4ea0-a209-d4f088a320ef service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:47.527976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1143/2282] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:56:47 2022] POST /identity/v3/projects => generated 365 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:47.530319 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210304c-199e-4aa9-a302-107ba99ea073 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:47.533967 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2e5df-776a-4ea0-a209-d4f088a320ef service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:47.617762 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069bf98-4ebd-4698-804d-ef1b77f6de71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:47.617762 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069bf98-4ebd-4698-804d-ef1b77f6de71 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:47.617762 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069bf98-4ebd-4698-804d-ef1b77f6de71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:47.617762 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069bf98-4ebd-4698-804d-ef1b77f6de71 admin admin] PATH_INFO: `/v3/projects/9f1e96fbfbff4798b8d617394f391f7e/users/2f74ba9e1886432087dcdbffd83e50be/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:47.618266 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069bf98-4ebd-4698-804d-ef1b77f6de71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f1e96fbfbff4798b8d617394f391f7e, user_id=2f74ba9e1886432087dcdbffd83e50be, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:47.623503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069bf98-4ebd-4698-804d-ef1b77f6de71 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:47.642319 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1140/2283] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:56:47 2022] PUT /identity/v3/projects/9f1e96fbfbff4798b8d617394f391f7e/users/2f74ba9e1886432087dcdbffd83e50be/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:47.644617 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069bf98-4ebd-4698-804d-ef1b77f6de71 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:47.699502 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210304c-199e-4aa9-a302-107ba99ea073 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:47.727670 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:47.755641 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069bf98-4ebd-4698-804d-ef1b77f6de71 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:47.762354 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e3ca8-8095-4fda-a2b1-dbb0bbd725c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:47.763324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e3ca8-8095-4fda-a2b1-dbb0bbd725c7 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:47.763904 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e3ca8-8095-4fda-a2b1-dbb0bbd725c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:47.764388 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e3ca8-8095-4fda-a2b1-dbb0bbd725c7 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:47.765529 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e3ca8-8095-4fda-a2b1-dbb0bbd725c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:47.767943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e3ca8-8095-4fda-a2b1-dbb0bbd725c7 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:47.791964 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7481b9-ce49-499d-9d0c-5d13b4b67581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:47.792976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7481b9-ce49-499d-9d0c-5d13b4b67581 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:47.793571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7481b9-ce49-499d-9d0c-5d13b4b67581 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:47.793571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7481b9-ce49-499d-9d0c-5d13b4b67581 admin admin] PATH_INFO: `/v3/projects/a27248b4339540bda8bc11bf032c6f15/users/e8efadec01e54de1a173b9162a0bf124/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:47.811930 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7481b9-ce49-499d-9d0c-5d13b4b67581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a27248b4339540bda8bc11bf032c6f15, user_id=e8efadec01e54de1a173b9162a0bf124, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:47.814673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7481b9-ce49-499d-9d0c-5d13b4b67581 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:47.954155 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1144/2284] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:56:47 2022] PUT /identity/v3/projects/a27248b4339540bda8bc11bf032c6f15/users/e8efadec01e54de1a173b9162a0bf124/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:47.954155 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f3582-78d9-46bf-ae98-9e86dc92c76d None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:47.954155 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f3582-78d9-46bf-ae98-9e86dc92c76d None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:47.954155 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f3582-78d9-46bf-ae98-9e86dc92c76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:47.992363 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-878f3582-78d9-46bf-ae98-9e86dc92c76d None None] MFA Rules not processed for user `2f74ba9e1886432087dcdbffd83e50be`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:47.993881 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-878f3582-78d9-46bf-ae98-9e86dc92c76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:48.053420 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1141/2285] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:56:47 2022] POST /identity/v3/users => generated 283 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:48.058616 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e95f3-77a0-404a-b4aa-a94f4fe8c553 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:48.058905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e95f3-77a0-404a-b4aa-a94f4fe8c553 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:48.059206 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e95f3-77a0-404a-b4aa-a94f4fe8c553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:48.094968 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-2d5e95f3-77a0-404a-b4aa-a94f4fe8c553 None None] MFA Rules not processed for user `e8efadec01e54de1a173b9162a0bf124`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:48.097320 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-2d5e95f3-77a0-404a-b4aa-a94f4fe8c553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:48.102681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1145/2286] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:48.103767 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f3582-78d9-46bf-ae98-9e86dc92c76d None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:48.205918 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1142/2287] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:48.207085 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e95f3-77a0-404a-b4aa-a94f4fe8c553 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:48.212989 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-2d5e95f3-77a0-404a-b4aa-a94f4fe8c553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:48.215660 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f3582-78d9-46bf-ae98-9e86dc92c76d None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:48.221268 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afe2e5-46c7-42cd-9e79-5acb24cf3c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:48.222011 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afe2e5-46c7-42cd-9e79-5acb24cf3c2b admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:48.222295 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afe2e5-46c7-42cd-9e79-5acb24cf3c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:48.222563 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afe2e5-46c7-42cd-9e79-5acb24cf3c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:48.223208 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afe2e5-46c7-42cd-9e79-5acb24cf3c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:48.224874 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afe2e5-46c7-42cd-9e79-5acb24cf3c2b admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:48.236893 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1146/2288] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:48.237669 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afe2e5-46c7-42cd-9e79-5acb24cf3c2b admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:48.240058 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a1afe2e5-46c7-42cd-9e79-5acb24cf3c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:48.287789 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e95f3-77a0-404a-b4aa-a94f4fe8c553 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:48.295506 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f644673-0b1a-4c99-8507-26cecb18b7ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:48.296163 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f644673-0b1a-4c99-8507-26cecb18b7ac service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:48.296522 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f644673-0b1a-4c99-8507-26cecb18b7ac service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:48.296805 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f644673-0b1a-4c99-8507-26cecb18b7ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:48.300948 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-5f644673-0b1a-4c99-8507-26cecb18b7ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:48.324536 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afe2e5-46c7-42cd-9e79-5acb24cf3c2b admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:48.329729 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae007907-8144-4319-974f-984a37dca617 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:48.330814 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae007907-8144-4319-974f-984a37dca617 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:48.331128 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae007907-8144-4319-974f-984a37dca617 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:48.331441 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae007907-8144-4319-974f-984a37dca617 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:48.344202 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae007907-8144-4319-974f-984a37dca617 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:48.347523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae007907-8144-4319-974f-984a37dca617 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:48.378105 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1147/2289] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:56:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:56:48.379293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae007907-8144-4319-974f-984a37dca617 service cinder] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:48.390961 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f644673-0b1a-4c99-8507-26cecb18b7ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:48.393625 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f644673-0b1a-4c99-8507-26cecb18b7ac service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:48.395094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae007907-8144-4319-974f-984a37dca617 service cinder] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:48.400589 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e47cc2-49a3-4387-9ab8-e651673e8347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:48.401660 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e47cc2-49a3-4387-9ab8-e651673e8347 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:48.402104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e47cc2-49a3-4387-9ab8-e651673e8347 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:48.402532 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e47cc2-49a3-4387-9ab8-e651673e8347 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:48.403349 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e47cc2-49a3-4387-9ab8-e651673e8347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:48.405541 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e47cc2-49a3-4387-9ab8-e651673e8347 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:48.421133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1148/2290] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:48.421611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1143/2291] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:56:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:56:48.426720 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f644673-0b1a-4c99-8507-26cecb18b7ac service cinder] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:48.451604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f644673-0b1a-4c99-8507-26cecb18b7ac service cinder] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:48.462548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ca03e-8fa2-4d03-a237-a15ec0d4a6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:48.464373 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ca03e-8fa2-4d03-a237-a15ec0d4a6dd admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:48.484309 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ca03e-8fa2-4d03-a237-a15ec0d4a6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:48.488388 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ca03e-8fa2-4d03-a237-a15ec0d4a6dd admin admin] PATH_INFO: `/v3/projects/c09424cff7a449f0834d0c38f8c241a6/users/4ec24ab93c9744e982f22b6a3304f966/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:48.538214 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ca03e-8fa2-4d03-a237-a15ec0d4a6dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c09424cff7a449f0834d0c38f8c241a6, user_id=4ec24ab93c9744e982f22b6a3304f966, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:48.541374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ca03e-8fa2-4d03-a237-a15ec0d4a6dd admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:48.628099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1144/2292] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:56:48 2022] PUT /identity/v3/projects/c09424cff7a449f0834d0c38f8c241a6/users/4ec24ab93c9744e982f22b6a3304f966/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:48.639574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943463d-3f7b-409c-bd5b-c1bc385b0954 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:48.640121 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943463d-3f7b-409c-bd5b-c1bc385b0954 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:48.640584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943463d-3f7b-409c-bd5b-c1bc385b0954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:48.706053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-2943463d-3f7b-409c-bd5b-c1bc385b0954 None None] MFA Rules not processed for user `4ec24ab93c9744e982f22b6a3304f966`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:48.707375 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-2943463d-3f7b-409c-bd5b-c1bc385b0954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:48.728009 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:48.783002 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:48.808547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1149/2293] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:48.813701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ca03e-8fa2-4d03-a237-a15ec0d4a6dd admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:48.923528 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ca03e-8fa2-4d03-a237-a15ec0d4a6dd admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:48.933503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bdea5-bfe0-4f61-9e69-c6406fc579bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:48.934397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bdea5-bfe0-4f61-9e69-c6406fc579bb admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:48.934686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bdea5-bfe0-4f61-9e69-c6406fc579bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:48.934989 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bdea5-bfe0-4f61-9e69-c6406fc579bb admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:48.935726 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bdea5-bfe0-4f61-9e69-c6406fc579bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:48.937762 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bdea5-bfe0-4f61-9e69-c6406fc579bb admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:49.088992 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1145/2294] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:56:48 2022] POST /identity/v3/projects => generated 367 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:49.095020 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943463d-3f7b-409c-bd5b-c1bc385b0954 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:49.107781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943463d-3f7b-409c-bd5b-c1bc385b0954 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:49.189861 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82134a12-b746-4e3c-b695-9ee6fd6f4b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:49.190584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82134a12-b746-4e3c-b695-9ee6fd6f4b2c admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:49.190807 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82134a12-b746-4e3c-b695-9ee6fd6f4b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:49.191086 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82134a12-b746-4e3c-b695-9ee6fd6f4b2c admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:49.191762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82134a12-b746-4e3c-b695-9ee6fd6f4b2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:49.193762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82134a12-b746-4e3c-b695-9ee6fd6f4b2c admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:49.226849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d9905-c0a6-42da-b2a3-41f3272967e5 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:49.227136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d9905-c0a6-42da-b2a3-41f3272967e5 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:49.227445 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d9905-c0a6-42da-b2a3-41f3272967e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:49.257554 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-9b3d9905-c0a6-42da-b2a3-41f3272967e5 None None] MFA Rules not processed for user `5a441adf6eee4ba78992aafbbf02f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:49.258787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-9b3d9905-c0a6-42da-b2a3-41f3272967e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:49.338405 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1146/2295] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:56:49.342137 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1150/2296] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:56:49 2022] POST /identity/v3/users => generated 290 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:56:49.346073 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d9905-c0a6-42da-b2a3-41f3272967e5 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:49.358533 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d9905-c0a6-42da-b2a3-41f3272967e5 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:49.364659 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4bc91-d888-4b32-9deb-ba43cc526bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:49.365483 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4bc91-d888-4b32-9deb-ba43cc526bfe admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:49.365769 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4bc91-d888-4b32-9deb-ba43cc526bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:49.366040 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4bc91-d888-4b32-9deb-ba43cc526bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:49.366710 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4bc91-d888-4b32-9deb-ba43cc526bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:49.368561 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4bc91-d888-4b32-9deb-ba43cc526bfe admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:49.387776 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82134a12-b746-4e3c-b695-9ee6fd6f4b2c admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:49.393774 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1147/2297] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:49.401299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82134a12-b746-4e3c-b695-9ee6fd6f4b2c admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:49.407620 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862b1b3-7acc-4f5d-bbea-b94101044ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:49.409081 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862b1b3-7acc-4f5d-bbea-b94101044ee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:49.409961 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862b1b3-7acc-4f5d-bbea-b94101044ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:49.410455 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862b1b3-7acc-4f5d-bbea-b94101044ee2 admin admin] PATH_INFO: `/v3/projects/e85352e75d534cb4a10ea40bcd1c1c0f/users/a82a1ca455ab48c89734884a43e61f28/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:49.431310 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862b1b3-7acc-4f5d-bbea-b94101044ee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85352e75d534cb4a10ea40bcd1c1c0f, user_id=a82a1ca455ab48c89734884a43e61f28, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:49.434923 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862b1b3-7acc-4f5d-bbea-b94101044ee2 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:49.545275 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1151/2298] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:56:49 2022] PUT /identity/v3/projects/e85352e75d534cb4a10ea40bcd1c1c0f/users/a82a1ca455ab48c89734884a43e61f28/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:49.559176 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862b1b3-7acc-4f5d-bbea-b94101044ee2 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:49.559523 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a5e75-5f2f-4fe0-9b87-e9bf5ddb4424 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:49.559777 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a5e75-5f2f-4fe0-9b87-e9bf5ddb4424 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:49.560060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a5e75-5f2f-4fe0-9b87-e9bf5ddb4424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:49.623951 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-009a5e75-5f2f-4fe0-9b87-e9bf5ddb4424 None None] MFA Rules not processed for user `b838210ed8ba4cac973eca59c1746c7b`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:49.625438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-009a5e75-5f2f-4fe0-9b87-e9bf5ddb4424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:49.707700 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862b1b3-7acc-4f5d-bbea-b94101044ee2 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:49.720701 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797fecd-3cca-4eca-a830-3052bfcd9114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:49.721703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797fecd-3cca-4eca-a830-3052bfcd9114 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:49.722192 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797fecd-3cca-4eca-a830-3052bfcd9114 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:49.722672 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797fecd-3cca-4eca-a830-3052bfcd9114 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:49.723917 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797fecd-3cca-4eca-a830-3052bfcd9114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:49.724999 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797fecd-3cca-4eca-a830-3052bfcd9114 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:49.742921 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1152/2299] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:56:49.749193 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797fecd-3cca-4eca-a830-3052bfcd9114 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:49.768738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1148/2300] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:49.773854 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797fecd-3cca-4eca-a830-3052bfcd9114 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:49.785431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e6eaa-c4c2-4bbb-ba5a-993137abf8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:49.785975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e6eaa-c4c2-4bbb-ba5a-993137abf8b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:49.786261 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e6eaa-c4c2-4bbb-ba5a-993137abf8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:49.786536 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e6eaa-c4c2-4bbb-ba5a-993137abf8b5 admin admin] PATH_INFO: `/v3/projects/e85352e75d534cb4a10ea40bcd1c1c0f/users/a82a1ca455ab48c89734884a43e61f28/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:49.793937 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e6eaa-c4c2-4bbb-ba5a-993137abf8b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85352e75d534cb4a10ea40bcd1c1c0f, user_id=a82a1ca455ab48c89734884a43e61f28, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:49.799823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a5e75-5f2f-4fe0-9b87-e9bf5ddb4424 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:49.803998 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e6eaa-c4c2-4bbb-ba5a-993137abf8b5 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:49.825254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1153/2301] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:56:49 2022] PUT /identity/v3/projects/e85352e75d534cb4a10ea40bcd1c1c0f/users/a82a1ca455ab48c89734884a43e61f28/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:56:49.838879 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414ca66-e557-495e-bdff-56d175f372d3 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:49.838879 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414ca66-e557-495e-bdff-56d175f372d3 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:49.838879 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414ca66-e557-495e-bdff-56d175f372d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:49.917068 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-f414ca66-e557-495e-bdff-56d175f372d3 None None] MFA Rules not processed for user `a82a1ca455ab48c89734884a43e61f28`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:49.918361 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-f414ca66-e557-495e-bdff-56d175f372d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:49.940219 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a5e75-5f2f-4fe0-9b87-e9bf5ddb4424 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:50.034249 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03374ad2-6925-4ab9-b2bf-838f9ea00b12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:50.034954 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03374ad2-6925-4ab9-b2bf-838f9ea00b12 service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:50.035315 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03374ad2-6925-4ab9-b2bf-838f9ea00b12 service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:50.035786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03374ad2-6925-4ab9-b2bf-838f9ea00b12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:50.045429 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1154/2302] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:50.057497 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414ca66-e557-495e-bdff-56d175f372d3 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:50.082364 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414ca66-e557-495e-bdff-56d175f372d3 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:50.088369 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ba1c6-11eb-4532-a53e-70c666edf3c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:50.090217 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ba1c6-11eb-4532-a53e-70c666edf3c2 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:50.090687 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ba1c6-11eb-4532-a53e-70c666edf3c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:50.091760 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ba1c6-11eb-4532-a53e-70c666edf3c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:50.104584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ba1c6-11eb-4532-a53e-70c666edf3c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:50.106533 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ba1c6-11eb-4532-a53e-70c666edf3c2 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:50.119060 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1155/2303] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:56:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:56:50.153809 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:50.180742 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03374ad2-6925-4ab9-b2bf-838f9ea00b12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:50.182308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03374ad2-6925-4ab9-b2bf-838f9ea00b12 service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:50.216849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1149/2304] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:56:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:56:50.379313 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ba1c6-11eb-4532-a53e-70c666edf3c2 service cinder] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:50.390120 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ba1c6-11eb-4532-a53e-70c666edf3c2 service cinder] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:50.399721 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234551c-c525-4729-83e7-41bd59a27e59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:50.400795 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234551c-c525-4729-83e7-41bd59a27e59 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:50.401083 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234551c-c525-4729-83e7-41bd59a27e59 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:50.401360 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234551c-c525-4729-83e7-41bd59a27e59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:50.534556 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234551c-c525-4729-83e7-41bd59a27e59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:50.536250 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234551c-c525-4729-83e7-41bd59a27e59 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:50.547745 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1156/2305] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:56:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:56:51.220806 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:51.757937 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03374ad2-6925-4ab9-b2bf-838f9ea00b12 service cinder] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:51.757937 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03374ad2-6925-4ab9-b2bf-838f9ea00b12 service cinder] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:51.757937 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef854252-a625-4171-b8ee-2466bfdd519b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:51.757937 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef854252-a625-4171-b8ee-2466bfdd519b service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:51.758337 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef854252-a625-4171-b8ee-2466bfdd519b service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:51.758337 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef854252-a625-4171-b8ee-2466bfdd519b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:51.758337 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-ef854252-a625-4171-b8ee-2466bfdd519b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:51.845594 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef854252-a625-4171-b8ee-2466bfdd519b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:51.847333 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef854252-a625-4171-b8ee-2466bfdd519b service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:51.873419 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1150/2306] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:56:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:56:51.975134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:52.227063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:52.754727 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9c3cc-393a-47da-b302-bbf4d6ffcf6d None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:52.755130 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9c3cc-393a-47da-b302-bbf4d6ffcf6d None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:52.755339 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9c3cc-393a-47da-b302-bbf4d6ffcf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:52.789938 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-15c9c3cc-393a-47da-b302-bbf4d6ffcf6d None None] MFA Rules not processed for user `b838210ed8ba4cac973eca59c1746c7b`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:56:52.791928 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-15c9c3cc-393a-47da-b302-bbf4d6ffcf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:56:52.799503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:52.803703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1157/2307] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:56:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:56:53.658933 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef854252-a625-4171-b8ee-2466bfdd519b service cinder] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:53.669404 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef854252-a625-4171-b8ee-2466bfdd519b service cinder] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:53.673371 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184021b5-e260-4079-a462-33b352ee0d5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:53.673981 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184021b5-e260-4079-a462-33b352ee0d5d service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:53.674309 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184021b5-e260-4079-a462-33b352ee0d5d service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:53.674530 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184021b5-e260-4079-a462-33b352ee0d5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:53.754517 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184021b5-e260-4079-a462-33b352ee0d5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:53.756617 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184021b5-e260-4079-a462-33b352ee0d5d service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:53.770355 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1151/2308] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:56:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:56:53.874044 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:55.437880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:56:59.664928 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9c3cc-393a-47da-b302-bbf4d6ffcf6d None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:59.684934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184021b5-e260-4079-a462-33b352ee0d5d service cinder] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:56:59.748996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9c3cc-393a-47da-b302-bbf4d6ffcf6d None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:59.753938 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3cfb3-28cc-4ecc-bfd3-b855234303af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:59.754655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3cfb3-28cc-4ecc-bfd3-b855234303af admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:59.756174 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3cfb3-28cc-4ecc-bfd3-b855234303af admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:59.756457 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3cfb3-28cc-4ecc-bfd3-b855234303af admin admin] PATH_INFO: `/v3/users/c0a5e7b4e1b3420ca900960235ead029` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:59.757644 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3cfb3-28cc-4ecc-bfd3-b855234303af admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0a5e7b4e1b3420ca900960235ead029)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:59.759659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3cfb3-28cc-4ecc-bfd3-b855234303af admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:56:59.760680 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184021b5-e260-4079-a462-33b352ee0d5d service cinder] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:56:59.768228 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa63761-88a8-4080-b8c6-b37e517e3b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:56:59.769165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa63761-88a8-4080-b8c6-b37e517e3b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:56:59.769604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa63761-88a8-4080-b8c6-b37e517e3b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:56:59.770170 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa63761-88a8-4080-b8c6-b37e517e3b99 admin admin] PATH_INFO: `/v3/users/4ec24ab93c9744e982f22b6a3304f966` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:56:59.771650 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa63761-88a8-4080-b8c6-b37e517e3b99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ec24ab93c9744e982f22b6a3304f966)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:56:59.774564 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa63761-88a8-4080-b8c6-b37e517e3b99 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:00.051391 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a7d3cfb3-28cc-4ecc-bfd3-b855234303af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0a5e7b4e1b3420ca900960235ead029'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:00.090346 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:00.097171 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-afa63761-88a8-4080-b8c6-b37e517e3b99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ec24ab93c9744e982f22b6a3304f966'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:00.097978 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-afa63761-88a8-4080-b8c6-b37e517e3b99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ec24ab93c9744e982f22b6a3304f966'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:00.114315 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-afa63761-88a8-4080-b8c6-b37e517e3b99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ec24ab93c9744e982f22b6a3304f966'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:00.122289 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-afa63761-88a8-4080-b8c6-b37e517e3b99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ec24ab93c9744e982f22b6a3304f966'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:00.135485 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a7d3cfb3-28cc-4ecc-bfd3-b855234303af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0a5e7b4e1b3420ca900960235ead029'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:00.144724 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:00.157671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a7d3cfb3-28cc-4ecc-bfd3-b855234303af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0a5e7b4e1b3420ca900960235ead029'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:00.185214 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a7d3cfb3-28cc-4ecc-bfd3-b855234303af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0a5e7b4e1b3420ca900960235ead029'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:00.186134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a7d3cfb3-28cc-4ecc-bfd3-b855234303af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0a5e7b4e1b3420ca900960235ead029'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:00.196088 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1158/2309] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:56:59 2022] DELETE /identity/v3/users/c0a5e7b4e1b3420ca900960235ead029 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:57:00.200920 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f243dc1-b8a1-4f14-a724-72cdef9b685c None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:00.201229 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f243dc1-b8a1-4f14-a724-72cdef9b685c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:00.201554 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f243dc1-b8a1-4f14-a724-72cdef9b685c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:00.223024 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-0f243dc1-b8a1-4f14-a724-72cdef9b685c None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:57:00.224437 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-0f243dc1-b8a1-4f14-a724-72cdef9b685c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:00.231134 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-afa63761-88a8-4080-b8c6-b37e517e3b99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ec24ab93c9744e982f22b6a3304f966'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:00.238679 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1152/2310] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:56:59 2022] DELETE /identity/v3/users/4ec24ab93c9744e982f22b6a3304f966 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:57:00.243775 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a1043-9705-4bff-8764-6e573f512c9d None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:00.244100 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a1043-9705-4bff-8764-6e573f512c9d None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:00.244350 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a1043-9705-4bff-8764-6e573f512c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:00.275335 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-703a1043-9705-4bff-8764-6e573f512c9d None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:57:00.275335 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-703a1043-9705-4bff-8764-6e573f512c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:00.328869 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1159/2311] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:57:00.340037 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f243dc1-b8a1-4f14-a724-72cdef9b685c None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:00.342071 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-0f243dc1-b8a1-4f14-a724-72cdef9b685c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:00.377970 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1153/2312] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:57:00.392140 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a1043-9705-4bff-8764-6e573f512c9d None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:00.393698 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-703a1043-9705-4bff-8764-6e573f512c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:00.431029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f243dc1-b8a1-4f14-a724-72cdef9b685c None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:00.524098 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab800d-2e24-4afd-bb1d-9777e7b31670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:00.524874 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab800d-2e24-4afd-bb1d-9777e7b31670 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:00.525161 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab800d-2e24-4afd-bb1d-9777e7b31670 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:00.525435 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab800d-2e24-4afd-bb1d-9777e7b31670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:00.525544 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a1043-9705-4bff-8764-6e573f512c9d None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:00.530675 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aec0ff-35eb-4e33-adad-b40b15eb864f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:00.531293 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aec0ff-35eb-4e33-adad-b40b15eb864f service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:00.531603 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aec0ff-35eb-4e33-adad-b40b15eb864f service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:00.532160 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aec0ff-35eb-4e33-adad-b40b15eb864f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:00.540410 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab800d-2e24-4afd-bb1d-9777e7b31670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:00.543867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab800d-2e24-4afd-bb1d-9777e7b31670 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:00.550888 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aec0ff-35eb-4e33-adad-b40b15eb864f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:00.552362 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aec0ff-35eb-4e33-adad-b40b15eb864f service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:00.567154 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1160/2313] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:57:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 13:57:00.570242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1154/2314] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:57:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:57:01.172415 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab800d-2e24-4afd-bb1d-9777e7b31670 service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:01.172415 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-58ab800d-2e24-4afd-bb1d-9777e7b31670 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:01.190791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab800d-2e24-4afd-bb1d-9777e7b31670 service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:01.202586 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aec0ff-35eb-4e33-adad-b40b15eb864f service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:01.203041 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0bdaa6-0293-456a-8746-04a606d145f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:01.203545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0bdaa6-0293-456a-8746-04a606d145f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:01.203819 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0bdaa6-0293-456a-8746-04a606d145f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:01.204089 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0bdaa6-0293-456a-8746-04a606d145f7 admin admin] PATH_INFO: `/v3/projects/6adc50a0779f4f7c8b9e4eac1804a7e6` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:01.204693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-28aec0ff-35eb-4e33-adad-b40b15eb864f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:01.205243 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0bdaa6-0293-456a-8746-04a606d145f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6adc50a0779f4f7c8b9e4eac1804a7e6)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:01.207180 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0bdaa6-0293-456a-8746-04a606d145f7 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:01.229881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aec0ff-35eb-4e33-adad-b40b15eb864f service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:01.235181 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63ab83-437f-40f7-aa08-33b723821cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:01.235888 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63ab83-437f-40f7-aa08-33b723821cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:01.236117 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63ab83-437f-40f7-aa08-33b723821cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:01.236387 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63ab83-437f-40f7-aa08-33b723821cc2 admin admin] PATH_INFO: `/v3/projects/c09424cff7a449f0834d0c38f8c241a6` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:01.237807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63ab83-437f-40f7-aa08-33b723821cc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c09424cff7a449f0834d0c38f8c241a6)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:01.239937 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63ab83-437f-40f7-aa08-33b723821cc2 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:01.310417 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:01.326346 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-9a0bdaa6-0293-456a-8746-04a606d145f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6adc50a0779f4f7c8b9e4eac1804a7e6', 'request_id': 'req-9a0bdaa6-0293-456a-8746-04a606d145f7'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:01.332014 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-9a0bdaa6-0293-456a-8746-04a606d145f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6adc50a0779f4f7c8b9e4eac1804a7e6', 'request_id': 'req-9a0bdaa6-0293-456a-8746-04a606d145f7'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:01.354955 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-cc63ab83-437f-40f7-aa08-33b723821cc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c09424cff7a449f0834d0c38f8c241a6', 'request_id': 'req-cc63ab83-437f-40f7-aa08-33b723821cc2'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:01.359574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:01.361846 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-cc63ab83-437f-40f7-aa08-33b723821cc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c09424cff7a449f0834d0c38f8c241a6', 'request_id': 'req-cc63ab83-437f-40f7-aa08-33b723821cc2'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:01.368195 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-cc63ab83-437f-40f7-aa08-33b723821cc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c09424cff7a449f0834d0c38f8c241a6', 'request_id': 'req-cc63ab83-437f-40f7-aa08-33b723821cc2'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:01.422041 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-9a0bdaa6-0293-456a-8746-04a606d145f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6adc50a0779f4f7c8b9e4eac1804a7e6', 'request_id': 'req-9a0bdaa6-0293-456a-8746-04a606d145f7'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:01.434921 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-9a0bdaa6-0293-456a-8746-04a606d145f7 admin admin] The token cache is being invalidate because project 6adc50a0779f4f7c8b9e4eac1804a7e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:57:01.435207 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-9a0bdaa6-0293-456a-8746-04a606d145f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:01.435888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-9a0bdaa6-0293-456a-8746-04a606d145f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:01.437411 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1161/2315] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:57:01 2022] DELETE /identity/v3/projects/6adc50a0779f4f7c8b9e4eac1804a7e6 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:57:01.441328 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0bdaa6-0293-456a-8746-04a606d145f7 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:01.442608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-9a0bdaa6-0293-456a-8746-04a606d145f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:01.479025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-cc63ab83-437f-40f7-aa08-33b723821cc2 admin admin] The token cache is being invalidate because project c09424cff7a449f0834d0c38f8c241a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:57:01.479381 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-cc63ab83-437f-40f7-aa08-33b723821cc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:01.480161 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-cc63ab83-437f-40f7-aa08-33b723821cc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:01.481791 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1155/2316] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:57:01 2022] DELETE /identity/v3/projects/c09424cff7a449f0834d0c38f8c241a6 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:57:01.485809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63ab83-437f-40f7-aa08-33b723821cc2 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:01.487161 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-cc63ab83-437f-40f7-aa08-33b723821cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:01.510329 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0bdaa6-0293-456a-8746-04a606d145f7 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:01.562646 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63ab83-437f-40f7-aa08-33b723821cc2 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:01.568355 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e566165-762f-490f-9d97-4bfd4c164968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:01.568998 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e566165-762f-490f-9d97-4bfd4c164968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:01.569285 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e566165-762f-490f-9d97-4bfd4c164968 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:01.570602 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e566165-762f-490f-9d97-4bfd4c164968 admin admin] PATH_INFO: `/v3/users/a82a1ca455ab48c89734884a43e61f28` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:01.571849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e566165-762f-490f-9d97-4bfd4c164968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a82a1ca455ab48c89734884a43e61f28)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:01.574459 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e566165-762f-490f-9d97-4bfd4c164968 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:01.578098 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c814ffe-91d4-474a-95ec-63814acfb2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:01.578734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c814ffe-91d4-474a-95ec-63814acfb2dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:01.579013 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c814ffe-91d4-474a-95ec-63814acfb2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:01.579284 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c814ffe-91d4-474a-95ec-63814acfb2dd admin admin] PATH_INFO: `/v3/users/99efc00443cc46c3a318ac78ef0f1658` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:01.581702 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c814ffe-91d4-474a-95ec-63814acfb2dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=99efc00443cc46c3a318ac78ef0f1658)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:01.583678 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c814ffe-91d4-474a-95ec-63814acfb2dd admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:01.852169 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-7e566165-762f-490f-9d97-4bfd4c164968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a82a1ca455ab48c89734884a43e61f28'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:01.852924 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-7e566165-762f-490f-9d97-4bfd4c164968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a82a1ca455ab48c89734884a43e61f28'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:01.869015 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-7e566165-762f-490f-9d97-4bfd4c164968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a82a1ca455ab48c89734884a43e61f28'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:01.875697 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-7c814ffe-91d4-474a-95ec-63814acfb2dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99efc00443cc46c3a318ac78ef0f1658'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:01.888040 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-7e566165-762f-490f-9d97-4bfd4c164968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a82a1ca455ab48c89734884a43e61f28'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:01.962395 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-7c814ffe-91d4-474a-95ec-63814acfb2dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99efc00443cc46c3a318ac78ef0f1658'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:01.972522 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-7c814ffe-91d4-474a-95ec-63814acfb2dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99efc00443cc46c3a318ac78ef0f1658'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:01.975425 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:01.992841 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-7c814ffe-91d4-474a-95ec-63814acfb2dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99efc00443cc46c3a318ac78ef0f1658'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:01.993588 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-7c814ffe-91d4-474a-95ec-63814acfb2dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99efc00443cc46c3a318ac78ef0f1658'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:02.001137 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1162/2317] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:57:01 2022] DELETE /identity/v3/users/99efc00443cc46c3a318ac78ef0f1658 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:57:02.020496 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-7e566165-762f-490f-9d97-4bfd4c164968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a82a1ca455ab48c89734884a43e61f28'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:02.040690 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1156/2318] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:57:01 2022] DELETE /identity/v3/users/a82a1ca455ab48c89734884a43e61f28 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:57:02.516301 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c814ffe-91d4-474a-95ec-63814acfb2dd admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:02.517936 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-7c814ffe-91d4-474a-95ec-63814acfb2dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:02.538531 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e566165-762f-490f-9d97-4bfd4c164968 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:02.540204 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-7e566165-762f-490f-9d97-4bfd4c164968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:02.628273 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c814ffe-91d4-474a-95ec-63814acfb2dd admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:02.634478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e566165-762f-490f-9d97-4bfd4c164968 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:02.640416 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008a0b5-8123-44af-b806-9604d447b9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:02.640633 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06076460-472d-459a-ac7b-92667b80c967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:02.641294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008a0b5-8123-44af-b806-9604d447b9a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:02.641447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06076460-472d-459a-ac7b-92667b80c967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:02.641715 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008a0b5-8123-44af-b806-9604d447b9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:02.641848 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06076460-472d-459a-ac7b-92667b80c967 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:02.642152 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06076460-472d-459a-ac7b-92667b80c967 admin admin] PATH_INFO: `/v3/projects/180fcde75b2949c8b2d0d53adc1a6a06` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:02.642328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008a0b5-8123-44af-b806-9604d447b9a3 admin admin] PATH_INFO: `/v3/projects/e85352e75d534cb4a10ea40bcd1c1c0f` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:02.643561 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06076460-472d-459a-ac7b-92667b80c967 admin admin] RBAC: Authorizing `identity:delete_project(project_id=180fcde75b2949c8b2d0d53adc1a6a06)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:02.643688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008a0b5-8123-44af-b806-9604d447b9a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e85352e75d534cb4a10ea40bcd1c1c0f)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:02.645764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008a0b5-8123-44af-b806-9604d447b9a3 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:02.645899 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06076460-472d-459a-ac7b-92667b80c967 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:02.648643 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:02.786935 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-4008a0b5-8123-44af-b806-9604d447b9a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e85352e75d534cb4a10ea40bcd1c1c0f', 'request_id': 'req-4008a0b5-8123-44af-b806-9604d447b9a3'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:02.794846 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-4008a0b5-8123-44af-b806-9604d447b9a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e85352e75d534cb4a10ea40bcd1c1c0f', 'request_id': 'req-4008a0b5-8123-44af-b806-9604d447b9a3'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:02.802487 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-4008a0b5-8123-44af-b806-9604d447b9a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e85352e75d534cb4a10ea40bcd1c1c0f', 'request_id': 'req-4008a0b5-8123-44af-b806-9604d447b9a3'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:02.819690 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-06076460-472d-459a-ac7b-92667b80c967 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '180fcde75b2949c8b2d0d53adc1a6a06', 'request_id': 'req-06076460-472d-459a-ac7b-92667b80c967'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:02.828920 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-06076460-472d-459a-ac7b-92667b80c967 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '180fcde75b2949c8b2d0d53adc1a6a06', 'request_id': 'req-06076460-472d-459a-ac7b-92667b80c967'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:02.902520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-4008a0b5-8123-44af-b806-9604d447b9a3 admin admin] The token cache is being invalidate because project e85352e75d534cb4a10ea40bcd1c1c0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:57:02.902923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-4008a0b5-8123-44af-b806-9604d447b9a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:02.903771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-4008a0b5-8123-44af-b806-9604d447b9a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:02.909957 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1157/2319] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:57:02 2022] DELETE /identity/v3/projects/e85352e75d534cb4a10ea40bcd1c1c0f => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:57:02.912734 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2d3bf-02aa-4104-93f9-4aa7096f26b9 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:02.913151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2d3bf-02aa-4104-93f9-4aa7096f26b9 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:02.913534 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2d3bf-02aa-4104-93f9-4aa7096f26b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:02.939444 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-8ce2d3bf-02aa-4104-93f9-4aa7096f26b9 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:57:02.941196 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-8ce2d3bf-02aa-4104-93f9-4aa7096f26b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:02.942602 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-06076460-472d-459a-ac7b-92667b80c967 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '180fcde75b2949c8b2d0d53adc1a6a06', 'request_id': 'req-06076460-472d-459a-ac7b-92667b80c967'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:02.962339 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-06076460-472d-459a-ac7b-92667b80c967 admin admin] The token cache is being invalidate because project 180fcde75b2949c8b2d0d53adc1a6a06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:57:02.962790 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-06076460-472d-459a-ac7b-92667b80c967 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:02.963518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-06076460-472d-459a-ac7b-92667b80c967 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:02.965638 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1163/2320] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:57:02 2022] DELETE /identity/v3/projects/180fcde75b2949c8b2d0d53adc1a6a06 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:57:02.969380 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06076460-472d-459a-ac7b-92667b80c967 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:02.971174 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-06076460-472d-459a-ac7b-92667b80c967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:03.015451 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1158/2321] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:57:03.024955 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b359aa-d101-4da6-b633-55d09b056542 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:03.025265 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b359aa-d101-4da6-b633-55d09b056542 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:03.025541 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b359aa-d101-4da6-b633-55d09b056542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:03.048719 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-32b359aa-d101-4da6-b633-55d09b056542 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:57:03.049937 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-32b359aa-d101-4da6-b633-55d09b056542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:03.059225 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06076460-472d-459a-ac7b-92667b80c967 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:03.059432 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1159/2322] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:57:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:57:03.064263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b359aa-d101-4da6-b633-55d09b056542 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:03.070990 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235b15a-094e-4774-a482-932153fd8c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:03.071890 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235b15a-094e-4774-a482-932153fd8c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:03.072375 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235b15a-094e-4774-a482-932153fd8c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:03.090130 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235b15a-094e-4774-a482-932153fd8c59 admin admin] PATH_INFO: `/v3/users/2f74ba9e1886432087dcdbffd83e50be` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:03.090130 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235b15a-094e-4774-a482-932153fd8c59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f74ba9e1886432087dcdbffd83e50be)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:03.090130 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235b15a-094e-4774-a482-932153fd8c59 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:03.090371 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b359aa-d101-4da6-b633-55d09b056542 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:03.094661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7656062-bb63-4423-a222-7c8d0dc839c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:03.095606 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:03.095754 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7656062-bb63-4423-a222-7c8d0dc839c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:03.095982 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7656062-bb63-4423-a222-7c8d0dc839c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:03.096284 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7656062-bb63-4423-a222-7c8d0dc839c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:03.096949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7656062-bb63-4423-a222-7c8d0dc839c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:57:03.097252 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7656062-bb63-4423-a222-7c8d0dc839c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:03.100230 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7656062-bb63-4423-a222-7c8d0dc839c3 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:03.113085 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1160/2323] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:57:03.117440 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7656062-bb63-4423-a222-7c8d0dc839c3 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:03.129064 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7656062-bb63-4423-a222-7c8d0dc839c3 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:03.133980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf915f-2cc1-4d48-b5bd-2e31d27cecac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:03.134606 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf915f-2cc1-4d48-b5bd-2e31d27cecac admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:03.134900 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf915f-2cc1-4d48-b5bd-2e31d27cecac admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:03.135177 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf915f-2cc1-4d48-b5bd-2e31d27cecac admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:03.135859 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf915f-2cc1-4d48-b5bd-2e31d27cecac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:03.138445 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf915f-2cc1-4d48-b5bd-2e31d27cecac admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:03.217965 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1161/2324] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:57:03 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:57:03.222097 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf915f-2cc1-4d48-b5bd-2e31d27cecac admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:03.281773 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:03.286961 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-5235b15a-094e-4774-a482-932153fd8c59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f74ba9e1886432087dcdbffd83e50be'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:03.295875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf915f-2cc1-4d48-b5bd-2e31d27cecac admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:03.309565 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d262f-880a-4280-a9f6-631ad52680ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:03.309565 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d262f-880a-4280-a9f6-631ad52680ec admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:03.309565 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d262f-880a-4280-a9f6-631ad52680ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:03.309565 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d262f-880a-4280-a9f6-631ad52680ec admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:03.310005 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d262f-880a-4280-a9f6-631ad52680ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:03.310005 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d262f-880a-4280-a9f6-631ad52680ec admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:03.391200 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-5235b15a-094e-4774-a482-932153fd8c59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f74ba9e1886432087dcdbffd83e50be'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:03.397876 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1162/2325] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:57:03 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:57:03.399611 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-5235b15a-094e-4774-a482-932153fd8c59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f74ba9e1886432087dcdbffd83e50be'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:03.409728 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d262f-880a-4280-a9f6-631ad52680ec admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:03.416516 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-5235b15a-094e-4774-a482-932153fd8c59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f74ba9e1886432087dcdbffd83e50be'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:03.417449 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-5235b15a-094e-4774-a482-932153fd8c59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f74ba9e1886432087dcdbffd83e50be'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:03.423445 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d262f-880a-4280-a9f6-631ad52680ec admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:03.425819 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1164/2326] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:57:02 2022] DELETE /identity/v3/users/2f74ba9e1886432087dcdbffd83e50be => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:57:03.492479 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5865db-4873-4724-9090-02722e4f8274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:03.493105 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5865db-4873-4724-9090-02722e4f8274 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:03.493499 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5865db-4873-4724-9090-02722e4f8274 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:03.493781 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5865db-4873-4724-9090-02722e4f8274 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:03.494435 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5865db-4873-4724-9090-02722e4f8274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:03.496743 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5865db-4873-4724-9090-02722e4f8274 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:03.507950 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1163/2327] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 13:57:03.512037 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235b15a-094e-4774-a482-932153fd8c59 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:03.513625 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-5235b15a-094e-4774-a482-932153fd8c59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:03.527182 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235b15a-094e-4774-a482-932153fd8c59 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:03.532503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b018c-de1e-482f-bc57-b05323598667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:03.533114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b018c-de1e-482f-bc57-b05323598667 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:03.533624 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b018c-de1e-482f-bc57-b05323598667 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:03.533895 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b018c-de1e-482f-bc57-b05323598667 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:03.534697 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b018c-de1e-482f-bc57-b05323598667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:03.536407 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b018c-de1e-482f-bc57-b05323598667 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:03.548136 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1165/2328] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:57:03.552530 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5865db-4873-4724-9090-02722e4f8274 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:03.563658 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5865db-4873-4724-9090-02722e4f8274 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:03.568440 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c882b-c158-4fc3-b089-94048829b8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:03.569094 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c882b-c158-4fc3-b089-94048829b8e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:03.569400 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c882b-c158-4fc3-b089-94048829b8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:03.569656 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c882b-c158-4fc3-b089-94048829b8e4 admin admin] PATH_INFO: `/v3/projects/f24cccc59b3d405998fcd1284b5b3ac2/users/9dc3eb6357854fc29ffa95e76c2abf96/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:03.586058 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c882b-c158-4fc3-b089-94048829b8e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f24cccc59b3d405998fcd1284b5b3ac2, user_id=9dc3eb6357854fc29ffa95e76c2abf96, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:03.588792 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c882b-c158-4fc3-b089-94048829b8e4 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:03.802663 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1164/2329] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:57:03 2022] PUT /identity/v3/projects/f24cccc59b3d405998fcd1284b5b3ac2/users/9dc3eb6357854fc29ffa95e76c2abf96/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:57:03.808191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a659e9d-01a6-4a5d-8ec7-7be2d1eb695a None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:03.808481 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a659e9d-01a6-4a5d-8ec7-7be2d1eb695a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:03.808759 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a659e9d-01a6-4a5d-8ec7-7be2d1eb695a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:03.832037 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-7a659e9d-01a6-4a5d-8ec7-7be2d1eb695a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:57:03.833370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-7a659e9d-01a6-4a5d-8ec7-7be2d1eb695a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:03.914486 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1166/2330] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:57:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:57:03.924794 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c882b-c158-4fc3-b089-94048829b8e4 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:03.926497 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-be0c882b-c158-4fc3-b089-94048829b8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:03.948222 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a659e9d-01a6-4a5d-8ec7-7be2d1eb695a None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:03.949847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-7a659e9d-01a6-4a5d-8ec7-7be2d1eb695a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:03.963958 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a659e9d-01a6-4a5d-8ec7-7be2d1eb695a None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:03.977544 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8c37c-0be7-45b3-b270-3431ff3c4712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:03.979193 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8c37c-0be7-45b3-b270-3431ff3c4712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:03.979533 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8c37c-0be7-45b3-b270-3431ff3c4712 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:03.979813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8c37c-0be7-45b3-b270-3431ff3c4712 admin admin] PATH_INFO: `/v3/projects/9f1e96fbfbff4798b8d617394f391f7e` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:03.981856 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b8c37c-0be7-45b3-b270-3431ff3c4712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f1e96fbfbff4798b8d617394f391f7e)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:03.984587 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b8c37c-0be7-45b3-b270-3431ff3c4712 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:04.002451 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c882b-c158-4fc3-b089-94048829b8e4 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:04.007955 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5618cb3-d2db-48ba-b75e-336b71e5f910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:04.009250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5618cb3-d2db-48ba-b75e-336b71e5f910 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:04.010037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5618cb3-d2db-48ba-b75e-336b71e5f910 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:04.010443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5618cb3-d2db-48ba-b75e-336b71e5f910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:04.025574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5618cb3-d2db-48ba-b75e-336b71e5f910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:04.027836 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5618cb3-d2db-48ba-b75e-336b71e5f910 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:04.045295 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1165/2331] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:57:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:57:04.138313 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-e2b8c37c-0be7-45b3-b270-3431ff3c4712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f1e96fbfbff4798b8d617394f391f7e', 'request_id': 'req-e2b8c37c-0be7-45b3-b270-3431ff3c4712'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:04.144075 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-e2b8c37c-0be7-45b3-b270-3431ff3c4712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f1e96fbfbff4798b8d617394f391f7e', 'request_id': 'req-e2b8c37c-0be7-45b3-b270-3431ff3c4712'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:04.232031 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-e2b8c37c-0be7-45b3-b270-3431ff3c4712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f1e96fbfbff4798b8d617394f391f7e', 'request_id': 'req-e2b8c37c-0be7-45b3-b270-3431ff3c4712'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:04.255960 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-e2b8c37c-0be7-45b3-b270-3431ff3c4712 admin admin] The token cache is being invalidate because project 9f1e96fbfbff4798b8d617394f391f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:57:04.255960 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-e2b8c37c-0be7-45b3-b270-3431ff3c4712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:04.257258 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-e2b8c37c-0be7-45b3-b270-3431ff3c4712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:04.259802 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1167/2332] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:57:03 2022] DELETE /identity/v3/projects/9f1e96fbfbff4798b8d617394f391f7e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:57:04.265972 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7ace2-2d9f-41d2-894b-ca317fc453aa None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:04.268999 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7ace2-2d9f-41d2-894b-ca317fc453aa None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:04.268999 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7ace2-2d9f-41d2-894b-ca317fc453aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:04.293726 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-f5e7ace2-2d9f-41d2-894b-ca317fc453aa None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:57:04.295183 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-f5e7ace2-2d9f-41d2-894b-ca317fc453aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:04.372309 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1166/2333] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:57:04.380188 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593284f6-b5da-4cec-9102-a91a5ba5d525 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:04.380476 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593284f6-b5da-4cec-9102-a91a5ba5d525 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:04.380897 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593284f6-b5da-4cec-9102-a91a5ba5d525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:04.405497 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-593284f6-b5da-4cec-9102-a91a5ba5d525 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:57:04.406778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-593284f6-b5da-4cec-9102-a91a5ba5d525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:04.415339 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1168/2334] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:57:04.419698 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7ace2-2d9f-41d2-894b-ca317fc453aa None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:04.429746 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7ace2-2d9f-41d2-894b-ca317fc453aa None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:04.435207 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8828bd-0147-45b4-8055-8151e879f267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:04.435989 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8828bd-0147-45b4-8055-8151e879f267 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:04.440362 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8828bd-0147-45b4-8055-8151e879f267 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:04.440362 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8828bd-0147-45b4-8055-8151e879f267 admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:04.440362 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8828bd-0147-45b4-8055-8151e879f267 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:57:04.440362 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8828bd-0147-45b4-8055-8151e879f267 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:04.440362 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8828bd-0147-45b4-8055-8151e879f267 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:04.456096 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1167/2335] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:57:04.457573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593284f6-b5da-4cec-9102-a91a5ba5d525 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:04.467246 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593284f6-b5da-4cec-9102-a91a5ba5d525 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:04.470085 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:04.474113 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bd060-b9d8-401a-baf2-337f74714b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:04.474726 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bd060-b9d8-401a-baf2-337f74714b48 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:04.475054 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bd060-b9d8-401a-baf2-337f74714b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:04.475341 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bd060-b9d8-401a-baf2-337f74714b48 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:04.476052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545bd060-b9d8-401a-baf2-337f74714b48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:04.478212 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545bd060-b9d8-401a-baf2-337f74714b48 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:04.590739 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1169/2336] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:57:04 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:57:04.594987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8828bd-0147-45b4-8055-8151e879f267 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:04.605925 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8828bd-0147-45b4-8055-8151e879f267 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:04.665838 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d2458-2581-48cd-976a-0219b7cff044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:04.666460 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d2458-2581-48cd-976a-0219b7cff044 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:04.666748 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d2458-2581-48cd-976a-0219b7cff044 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:04.667030 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d2458-2581-48cd-976a-0219b7cff044 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:04.668268 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d2458-2581-48cd-976a-0219b7cff044 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:04.670287 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d2458-2581-48cd-976a-0219b7cff044 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:04.784110 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:04.790306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1168/2337] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:57:04 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:57:04.794453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bd060-b9d8-401a-baf2-337f74714b48 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:04.804998 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bd060-b9d8-401a-baf2-337f74714b48 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:04.809866 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9291be-066d-46d8-812c-8f8062539fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:04.810611 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9291be-066d-46d8-812c-8f8062539fea admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:04.810901 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9291be-066d-46d8-812c-8f8062539fea admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:04.811172 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9291be-066d-46d8-812c-8f8062539fea admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:04.812022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9291be-066d-46d8-812c-8f8062539fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:04.818759 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9291be-066d-46d8-812c-8f8062539fea admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:04.825538 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1170/2338] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:57:04.829589 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d2458-2581-48cd-976a-0219b7cff044 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:04.841494 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d2458-2581-48cd-976a-0219b7cff044 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:04.846961 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e9f26-b9b2-4809-89dc-e1789804763f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:04.847631 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e9f26-b9b2-4809-89dc-e1789804763f admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:04.847914 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e9f26-b9b2-4809-89dc-e1789804763f admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:04.848189 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e9f26-b9b2-4809-89dc-e1789804763f admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:04.848901 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e9f26-b9b2-4809-89dc-e1789804763f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:04.850440 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e9f26-b9b2-4809-89dc-e1789804763f admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:04.862466 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1169/2339] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:57:04.873130 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9291be-066d-46d8-812c-8f8062539fea admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:04.883802 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9291be-066d-46d8-812c-8f8062539fea admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:04.890767 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335df82-8d5e-449b-9837-1b5b1e190a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:04.891569 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335df82-8d5e-449b-9837-1b5b1e190a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:04.891831 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335df82-8d5e-449b-9837-1b5b1e190a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:04.892108 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335df82-8d5e-449b-9837-1b5b1e190a50 admin admin] PATH_INFO: `/v3/projects/bf14b03ed7654a41a16b8383f3b5c3b2/users/85674b41e46f4a2090888831c7fd49d4/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:04.910175 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335df82-8d5e-449b-9837-1b5b1e190a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf14b03ed7654a41a16b8383f3b5c3b2, user_id=85674b41e46f4a2090888831c7fd49d4, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:04.912975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335df82-8d5e-449b-9837-1b5b1e190a50 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:05.022990 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1171/2340] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:57:04 2022] PUT /identity/v3/projects/bf14b03ed7654a41a16b8383f3b5c3b2/users/85674b41e46f4a2090888831c7fd49d4/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:57:05.093368 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aacf83-a3a0-411e-aa68-a40299932649 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:05.093654 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aacf83-a3a0-411e-aa68-a40299932649 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:05.093953 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aacf83-a3a0-411e-aa68-a40299932649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:05.125670 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-a4aacf83-a3a0-411e-aa68-a40299932649 None None] MFA Rules not processed for user `85674b41e46f4a2090888831c7fd49d4`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:57:05.126793 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a4aacf83-a3a0-411e-aa68-a40299932649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:05.208866 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1170/2341] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:57:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:57:05.221087 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335df82-8d5e-449b-9837-1b5b1e190a50 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:05.223279 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-d335df82-8d5e-449b-9837-1b5b1e190a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:05.298377 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335df82-8d5e-449b-9837-1b5b1e190a50 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:05.303972 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8e9dc-9345-4204-a22a-8f0414cdf4e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:05.305154 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8e9dc-9345-4204-a22a-8f0414cdf4e0 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:05.305154 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8e9dc-9345-4204-a22a-8f0414cdf4e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:05.305393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8e9dc-9345-4204-a22a-8f0414cdf4e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:05.317462 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8e9dc-9345-4204-a22a-8f0414cdf4e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:05.318975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8e9dc-9345-4204-a22a-8f0414cdf4e0 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:05.334344 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1172/2342] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:57:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:57:05.696662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4db14c-1897-4520-a0fd-4bb23b990bce None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:05.697560 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4db14c-1897-4520-a0fd-4bb23b990bce None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:05.698041 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4db14c-1897-4520-a0fd-4bb23b990bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:05.760133 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-0e4db14c-1897-4520-a0fd-4bb23b990bce None None] MFA Rules not processed for user `9dc3eb6357854fc29ffa95e76c2abf96`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:57:05.762144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-0e4db14c-1897-4520-a0fd-4bb23b990bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:05.867129 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1171/2343] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:57:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:57:06.013763 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8e9dc-9345-4204-a22a-8f0414cdf4e0 service cinder] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:06.023669 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8e9dc-9345-4204-a22a-8f0414cdf4e0 service cinder] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:06.031333 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca77870-8053-4187-9611-b2ed9a115ef0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:06.032056 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca77870-8053-4187-9611-b2ed9a115ef0 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:06.032336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca77870-8053-4187-9611-b2ed9a115ef0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:06.032610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca77870-8053-4187-9611-b2ed9a115ef0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:06.041861 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca77870-8053-4187-9611-b2ed9a115ef0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:06.043405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca77870-8053-4187-9611-b2ed9a115ef0 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:06.053349 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1173/2344] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:57:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:57:06.183854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:07.941978 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8740caf-5b77-4871-aaab-bab9fe128432 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:07.942753 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8740caf-5b77-4871-aaab-bab9fe128432 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:07.942753 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8740caf-5b77-4871-aaab-bab9fe128432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:07.966292 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-b8740caf-5b77-4871-aaab-bab9fe128432 None None] MFA Rules not processed for user `9dc3eb6357854fc29ffa95e76c2abf96`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:57:07.968006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b8740caf-5b77-4871-aaab-bab9fe128432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:07.985180 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1172/2345] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:57:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:57:09.049675 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca77870-8053-4187-9611-b2ed9a115ef0 service cinder] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:09.137431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca77870-8053-4187-9611-b2ed9a115ef0 service cinder] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:09.149181 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c87c3-fa14-4151-b61c-63b66a6f4f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:09.150428 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c87c3-fa14-4151-b61c-63b66a6f4f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:09.150709 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c87c3-fa14-4151-b61c-63b66a6f4f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:09.151132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c87c3-fa14-4151-b61c-63b66a6f4f04 admin admin] PATH_INFO: `/v3/users/85674b41e46f4a2090888831c7fd49d4` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:09.152683 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c87c3-fa14-4151-b61c-63b66a6f4f04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85674b41e46f4a2090888831c7fd49d4)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:09.154664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c87c3-fa14-4151-b61c-63b66a6f4f04 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:09.385381 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:09.419217 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-af5c87c3-fa14-4151-b61c-63b66a6f4f04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85674b41e46f4a2090888831c7fd49d4'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:09.513442 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-af5c87c3-fa14-4151-b61c-63b66a6f4f04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85674b41e46f4a2090888831c7fd49d4'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:09.528602 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-af5c87c3-fa14-4151-b61c-63b66a6f4f04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85674b41e46f4a2090888831c7fd49d4'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:09.548598 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-af5c87c3-fa14-4151-b61c-63b66a6f4f04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85674b41e46f4a2090888831c7fd49d4'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:09.550495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-af5c87c3-fa14-4151-b61c-63b66a6f4f04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85674b41e46f4a2090888831c7fd49d4'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:09.560907 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1174/2346] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:57:09 2022] DELETE /identity/v3/users/85674b41e46f4a2090888831c7fd49d4 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:57:09.565737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d733a-9530-4a4b-95b7-564e2eebf17a None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:09.566688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d733a-9530-4a4b-95b7-564e2eebf17a None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:09.567175 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d733a-9530-4a4b-95b7-564e2eebf17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:09.590092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-215d733a-9530-4a4b-95b7-564e2eebf17a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:57:09.591509 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-215d733a-9530-4a4b-95b7-564e2eebf17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:09.693204 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1173/2347] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:57:09.707853 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c87c3-fa14-4151-b61c-63b66a6f4f04 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:09.707853 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-af5c87c3-fa14-4151-b61c-63b66a6f4f04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:09.770891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c87c3-fa14-4151-b61c-63b66a6f4f04 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:09.774688 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4dd520-e958-4d39-9e85-99591276f242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:09.775315 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4dd520-e958-4d39-9e85-99591276f242 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:09.775623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4dd520-e958-4d39-9e85-99591276f242 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:09.775894 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4dd520-e958-4d39-9e85-99591276f242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:09.786262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4dd520-e958-4d39-9e85-99591276f242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:09.787744 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4dd520-e958-4d39-9e85-99591276f242 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:09.797828 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1175/2348] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:57:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 13:57:10.399763 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d733a-9530-4a4b-95b7-564e2eebf17a None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:10.400564 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-215d733a-9530-4a4b-95b7-564e2eebf17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:10.422387 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d733a-9530-4a4b-95b7-564e2eebf17a None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:10.428631 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3aeb5-0ad2-416e-aaae-82a3df790e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:10.429909 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3aeb5-0ad2-416e-aaae-82a3df790e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:10.430550 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3aeb5-0ad2-416e-aaae-82a3df790e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:10.430921 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3aeb5-0ad2-416e-aaae-82a3df790e69 admin admin] PATH_INFO: `/v3/projects/bf14b03ed7654a41a16b8383f3b5c3b2` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:10.442624 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3aeb5-0ad2-416e-aaae-82a3df790e69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf14b03ed7654a41a16b8383f3b5c3b2)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:10.445280 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3aeb5-0ad2-416e-aaae-82a3df790e69 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:10.711845 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-33e3aeb5-0ad2-416e-aaae-82a3df790e69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf14b03ed7654a41a16b8383f3b5c3b2', 'request_id': 'req-33e3aeb5-0ad2-416e-aaae-82a3df790e69'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:10.725597 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-33e3aeb5-0ad2-416e-aaae-82a3df790e69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf14b03ed7654a41a16b8383f3b5c3b2', 'request_id': 'req-33e3aeb5-0ad2-416e-aaae-82a3df790e69'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:10.741286 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-33e3aeb5-0ad2-416e-aaae-82a3df790e69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf14b03ed7654a41a16b8383f3b5c3b2', 'request_id': 'req-33e3aeb5-0ad2-416e-aaae-82a3df790e69'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:10.883812 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-33e3aeb5-0ad2-416e-aaae-82a3df790e69 admin admin] The token cache is being invalidate because project bf14b03ed7654a41a16b8383f3b5c3b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:57:10.883812 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-33e3aeb5-0ad2-416e-aaae-82a3df790e69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:10.883812 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-33e3aeb5-0ad2-416e-aaae-82a3df790e69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:10.883812 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1174/2349] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:57:10 2022] DELETE /identity/v3/projects/bf14b03ed7654a41a16b8383f3b5c3b2 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:57:20.859404 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=66,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:21.044447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=43,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:21.576208 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4dd520-e958-4d39-9e85-99591276f242 service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:21.577575 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-be4dd520-e958-4d39-9e85-99591276f242 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:21.646869 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4dd520-e958-4d39-9e85-99591276f242 service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:21.708686 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1be14-c027-4f91-90fc-ce8af055e650 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e675d44d2c49929feb0ec0d2c0d0eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:21.709293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1be14-c027-4f91-90fc-ce8af055e650 service placement] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:21.709572 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1be14-c027-4f91-90fc-ce8af055e650 service placement] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:21.709841 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1be14-c027-4f91-90fc-ce8af055e650 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:21.711666 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-08f1be14-c027-4f91-90fc-ce8af055e650 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:21.725658 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1be14-c027-4f91-90fc-ce8af055e650 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:21.725658 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1be14-c027-4f91-90fc-ce8af055e650 service placement] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:21.736653 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1176/2350] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:57:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:57:31.732425 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=58 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:50.955571 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3aeb5-0ad2-416e-aaae-82a3df790e69 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:50.956983 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-33e3aeb5-0ad2-416e-aaae-82a3df790e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:51.025886 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3aeb5-0ad2-416e-aaae-82a3df790e69 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:51.030555 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a9e9d-e5d2-4bb3-9ab5-5ad224a31dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:51.031195 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a9e9d-e5d2-4bb3-9ab5-5ad224a31dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:51.031493 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a9e9d-e5d2-4bb3-9ab5-5ad224a31dee admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:51.031773 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a9e9d-e5d2-4bb3-9ab5-5ad224a31dee admin admin] PATH_INFO: `/v3/users/e8efadec01e54de1a173b9162a0bf124` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:51.032911 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a9e9d-e5d2-4bb3-9ab5-5ad224a31dee admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8efadec01e54de1a173b9162a0bf124)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:51.034844 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a9e9d-e5d2-4bb3-9ab5-5ad224a31dee admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:51.245696 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-7d1a9e9d-e5d2-4bb3-9ab5-5ad224a31dee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8efadec01e54de1a173b9162a0bf124'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:51.246321 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-7d1a9e9d-e5d2-4bb3-9ab5-5ad224a31dee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8efadec01e54de1a173b9162a0bf124'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:51.259436 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-7d1a9e9d-e5d2-4bb3-9ab5-5ad224a31dee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8efadec01e54de1a173b9162a0bf124'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:51.266566 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-7d1a9e9d-e5d2-4bb3-9ab5-5ad224a31dee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8efadec01e54de1a173b9162a0bf124'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:51.351340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-7d1a9e9d-e5d2-4bb3-9ab5-5ad224a31dee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8efadec01e54de1a173b9162a0bf124'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:51.358455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1175/2351] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:57:50 2022] DELETE /identity/v3/users/e8efadec01e54de1a173b9162a0bf124 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:57:51.363978 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137d3d2-b8ca-4820-a734-ab651adc0683 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:51.364454 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137d3d2-b8ca-4820-a734-ab651adc0683 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:51.364568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137d3d2-b8ca-4820-a734-ab651adc0683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:51.384588 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-3137d3d2-b8ca-4820-a734-ab651adc0683 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:57:51.386121 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-3137d3d2-b8ca-4820-a734-ab651adc0683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:51.447289 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1177/2352] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:57:51.458895 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a9e9d-e5d2-4bb3-9ab5-5ad224a31dee admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:51.460324 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-7d1a9e9d-e5d2-4bb3-9ab5-5ad224a31dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:51.520791 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a9e9d-e5d2-4bb3-9ab5-5ad224a31dee admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:51.524442 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f238397-7ebd-40a3-88c9-325fec7e9ef0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:51.525656 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f238397-7ebd-40a3-88c9-325fec7e9ef0 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:51.525905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f238397-7ebd-40a3-88c9-325fec7e9ef0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:51.526172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f238397-7ebd-40a3-88c9-325fec7e9ef0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:51.536040 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f238397-7ebd-40a3-88c9-325fec7e9ef0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:51.537611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f238397-7ebd-40a3-88c9-325fec7e9ef0 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:51.550133 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1176/2353] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:57:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:57:51.645926 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b7a35-f67e-42bb-9c78-7849e681d7f5 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:51.649288 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b7a35-f67e-42bb-9c78-7849e681d7f5 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:51.649288 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b7a35-f67e-42bb-9c78-7849e681d7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:51.666651 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-f30b7a35-f67e-42bb-9c78-7849e681d7f5 None None] MFA Rules not processed for user `9dc3eb6357854fc29ffa95e76c2abf96`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:57:51.667914 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-f30b7a35-f67e-42bb-9c78-7849e681d7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:51.725586 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1178/2354] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:57:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:57:51.996441 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f238397-7ebd-40a3-88c9-325fec7e9ef0 service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:51.997947 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-3f238397-7ebd-40a3-88c9-325fec7e9ef0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:52.016245 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f238397-7ebd-40a3-88c9-325fec7e9ef0 service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:52.021367 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783061c5-f39a-42dc-832b-5e2aa7a8b160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:52.022039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783061c5-f39a-42dc-832b-5e2aa7a8b160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:52.022343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783061c5-f39a-42dc-832b-5e2aa7a8b160 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:52.022612 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783061c5-f39a-42dc-832b-5e2aa7a8b160 admin admin] PATH_INFO: `/v3/projects/a27248b4339540bda8bc11bf032c6f15` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:52.023956 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783061c5-f39a-42dc-832b-5e2aa7a8b160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a27248b4339540bda8bc11bf032c6f15)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:52.025949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783061c5-f39a-42dc-832b-5e2aa7a8b160 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:52.050434 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:52.155939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-783061c5-f39a-42dc-832b-5e2aa7a8b160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a27248b4339540bda8bc11bf032c6f15', 'request_id': 'req-783061c5-f39a-42dc-832b-5e2aa7a8b160'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:52.161705 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-783061c5-f39a-42dc-832b-5e2aa7a8b160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a27248b4339540bda8bc11bf032c6f15', 'request_id': 'req-783061c5-f39a-42dc-832b-5e2aa7a8b160'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:52.168654 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-783061c5-f39a-42dc-832b-5e2aa7a8b160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a27248b4339540bda8bc11bf032c6f15', 'request_id': 'req-783061c5-f39a-42dc-832b-5e2aa7a8b160'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:52.278953 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-783061c5-f39a-42dc-832b-5e2aa7a8b160 admin admin] The token cache is being invalidate because project a27248b4339540bda8bc11bf032c6f15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:57:52.279251 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-783061c5-f39a-42dc-832b-5e2aa7a8b160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:52.279948 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-783061c5-f39a-42dc-832b-5e2aa7a8b160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:57:52.281483 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1177/2355] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:57:51 2022] DELETE /identity/v3/projects/a27248b4339540bda8bc11bf032c6f15 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:58:01.718469 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=52 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:02.469999 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=17,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:23.501705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1a041-c0f6-41c2-9737-cc24805c2be0 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:23.502186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1a041-c0f6-41c2-9737-cc24805c2be0 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:23.502276 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1a041-c0f6-41c2-9737-cc24805c2be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:23.523491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-02d1a041-c0f6-41c2-9737-cc24805c2be0 None None] MFA Rules not processed for user `6f01578bf21244a5ac357e54979ffc0d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:23.524726 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-02d1a041-c0f6-41c2-9737-cc24805c2be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:23.586757 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1179/2356] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 1 13:58:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:58:23.638125 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783061c5-f39a-42dc-832b-5e2aa7a8b160 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:23.639663 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-783061c5-f39a-42dc-832b-5e2aa7a8b160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:23.734308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783061c5-f39a-42dc-832b-5e2aa7a8b160 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:23.741133 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c673776-1292-4dde-a26c-422a626d559a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bbede0f8674384bcc3028ea77eb724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:23.741778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c673776-1292-4dde-a26c-422a626d559a service swift] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:23.741996 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c673776-1292-4dde-a26c-422a626d559a service swift] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:23.742269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c673776-1292-4dde-a26c-422a626d559a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:23.754297 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c673776-1292-4dde-a26c-422a626d559a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:23.762485 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c673776-1292-4dde-a26c-422a626d559a service swift] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:23.775300 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1178/2357] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 1 13:58:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 13:58:32.885390 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c280ca-6d9d-4848-a2b5-91eead8540d9 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:32.885920 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c280ca-6d9d-4848-a2b5-91eead8540d9 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:32.885920 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c280ca-6d9d-4848-a2b5-91eead8540d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:32.912609 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-16c280ca-6d9d-4848-a2b5-91eead8540d9 None None] MFA Rules not processed for user `6f01578bf21244a5ac357e54979ffc0d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:32.914183 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-16c280ca-6d9d-4848-a2b5-91eead8540d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:32.925305 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1180/2358] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 1 13:58:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:58:32.945589 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c673776-1292-4dde-a26c-422a626d559a service swift] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:32.967124 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c673776-1292-4dde-a26c-422a626d559a service swift] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:32.975981 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb3bae-0aa4-495b-be06-ba5010c7e6aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bbede0f8674384bcc3028ea77eb724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:32.977706 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb3bae-0aa4-495b-be06-ba5010c7e6aa service swift] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:32.978764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb3bae-0aa4-495b-be06-ba5010c7e6aa service swift] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:32.979537 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb3bae-0aa4-495b-be06-ba5010c7e6aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:32.995552 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb3bae-0aa4-495b-be06-ba5010c7e6aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:33.013907 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb3bae-0aa4-495b-be06-ba5010c7e6aa service swift] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:33.027831 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1179/2359] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 1 13:58:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 13:58:38.662004 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754c293-2a13-4e17-a398-92a6e837297b None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:38.662750 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754c293-2a13-4e17-a398-92a6e837297b None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:38.662750 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754c293-2a13-4e17-a398-92a6e837297b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:38.702086 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-9754c293-2a13-4e17-a398-92a6e837297b None None] MFA Rules not processed for user `b838210ed8ba4cac973eca59c1746c7b`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:38.703755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-9754c293-2a13-4e17-a398-92a6e837297b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:38.853268 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1181/2360] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:58:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:58:42.394499 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad8c26-3f26-4482-8d5c-080e6d0b44ac None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:42.396090 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad8c26-3f26-4482-8d5c-080e6d0b44ac None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:42.396551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad8c26-3f26-4482-8d5c-080e6d0b44ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:42.418858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-6bad8c26-3f26-4482-8d5c-080e6d0b44ac None None] MFA Rules not processed for user `6f01578bf21244a5ac357e54979ffc0d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:42.421910 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-6bad8c26-3f26-4482-8d5c-080e6d0b44ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:42.430525 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1180/2361] 10.222.0.50 () {58 vars in 967 bytes} [Thu Sep 1 13:58:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:58:42.450692 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754c293-2a13-4e17-a398-92a6e837297b None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:42.468963 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754c293-2a13-4e17-a398-92a6e837297b None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:42.481302 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd818a7-eacd-41d1-bcc4-e10a230ec762 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bbede0f8674384bcc3028ea77eb724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:42.481302 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd818a7-eacd-41d1-bcc4-e10a230ec762 service swift] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:42.481302 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd818a7-eacd-41d1-bcc4-e10a230ec762 service swift] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:42.481302 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd818a7-eacd-41d1-bcc4-e10a230ec762 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:42.488731 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd818a7-eacd-41d1-bcc4-e10a230ec762 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:42.492300 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd818a7-eacd-41d1-bcc4-e10a230ec762 service swift] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:42.504654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1182/2362] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 1 13:58:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 13:58:47.580441 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad8c26-3f26-4482-8d5c-080e6d0b44ac None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:47.582514 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-6bad8c26-3f26-4482-8d5c-080e6d0b44ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:47.667011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad8c26-3f26-4482-8d5c-080e6d0b44ac None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:47.672353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007d411-4c77-475b-90bb-559862164376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:47.673063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007d411-4c77-475b-90bb-559862164376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:47.673341 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007d411-4c77-475b-90bb-559862164376 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:47.673611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007d411-4c77-475b-90bb-559862164376 admin admin] PATH_INFO: `/v3/users/9dc3eb6357854fc29ffa95e76c2abf96` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:47.674750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007d411-4c77-475b-90bb-559862164376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dc3eb6357854fc29ffa95e76c2abf96)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:47.676749 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c007d411-4c77-475b-90bb-559862164376 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:47.826764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c007d411-4c77-475b-90bb-559862164376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dc3eb6357854fc29ffa95e76c2abf96'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:58:47.827495 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c007d411-4c77-475b-90bb-559862164376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dc3eb6357854fc29ffa95e76c2abf96'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:58:47.841393 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c007d411-4c77-475b-90bb-559862164376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dc3eb6357854fc29ffa95e76c2abf96'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:58:47.848705 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:47.850603 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c007d411-4c77-475b-90bb-559862164376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dc3eb6357854fc29ffa95e76c2abf96'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:58:47.921276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c007d411-4c77-475b-90bb-559862164376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dc3eb6357854fc29ffa95e76c2abf96'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:58:47.928039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1181/2363] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:58:47 2022] DELETE /identity/v3/users/9dc3eb6357854fc29ffa95e76c2abf96 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:58:48.220548 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd818a7-eacd-41d1-bcc4-e10a230ec762 service swift] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:48.241680 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd818a7-eacd-41d1-bcc4-e10a230ec762 service swift] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:48.331557 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6aa993-8f2f-473d-b1ec-8aa1c0a7430a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:48.332216 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6aa993-8f2f-473d-b1ec-8aa1c0a7430a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:48.332491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6aa993-8f2f-473d-b1ec-8aa1c0a7430a admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:48.332965 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6aa993-8f2f-473d-b1ec-8aa1c0a7430a admin admin] PATH_INFO: `/v3/projects/f24cccc59b3d405998fcd1284b5b3ac2` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:48.336357 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6aa993-8f2f-473d-b1ec-8aa1c0a7430a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f24cccc59b3d405998fcd1284b5b3ac2)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:48.338364 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6aa993-8f2f-473d-b1ec-8aa1c0a7430a admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:48.507229 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:48.519199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-7b6aa993-8f2f-473d-b1ec-8aa1c0a7430a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f24cccc59b3d405998fcd1284b5b3ac2', 'request_id': 'req-7b6aa993-8f2f-473d-b1ec-8aa1c0a7430a'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:58:48.526058 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-7b6aa993-8f2f-473d-b1ec-8aa1c0a7430a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f24cccc59b3d405998fcd1284b5b3ac2', 'request_id': 'req-7b6aa993-8f2f-473d-b1ec-8aa1c0a7430a'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:58:48.597572 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-7b6aa993-8f2f-473d-b1ec-8aa1c0a7430a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f24cccc59b3d405998fcd1284b5b3ac2', 'request_id': 'req-7b6aa993-8f2f-473d-b1ec-8aa1c0a7430a'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:58:48.614512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-7b6aa993-8f2f-473d-b1ec-8aa1c0a7430a admin admin] The token cache is being invalidate because project f24cccc59b3d405998fcd1284b5b3ac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:58:48.614801 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-7b6aa993-8f2f-473d-b1ec-8aa1c0a7430a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:58:48.615478 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-7b6aa993-8f2f-473d-b1ec-8aa1c0a7430a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:58:48.616971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1183/2364] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:58:48 2022] DELETE /identity/v3/projects/f24cccc59b3d405998fcd1284b5b3ac2 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:58:48.621835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d415e3-2aa1-4205-ae28-32779484de0b None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:48.622310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d415e3-2aa1-4205-ae28-32779484de0b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:48.622406 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d415e3-2aa1-4205-ae28-32779484de0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:48.642594 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-32d415e3-2aa1-4205-ae28-32779484de0b None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:48.643841 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-32d415e3-2aa1-4205-ae28-32779484de0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:48.703025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1182/2365] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:58:48.769311 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b30c0c-9887-4296-9f38-9237b645bdfb None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:48.769595 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b30c0c-9887-4296-9f38-9237b645bdfb None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:48.769874 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b30c0c-9887-4296-9f38-9237b645bdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:48.791155 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-b2b30c0c-9887-4296-9f38-9237b645bdfb None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:48.792395 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b2b30c0c-9887-4296-9f38-9237b645bdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:48.800458 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1184/2366] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:58:48.805044 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d415e3-2aa1-4205-ae28-32779484de0b None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:48.815162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d415e3-2aa1-4205-ae28-32779484de0b None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:48.819940 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94858cc-5831-4e96-b9e4-d9fe9c40c7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:48.820558 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94858cc-5831-4e96-b9e4-d9fe9c40c7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:48.820861 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94858cc-5831-4e96-b9e4-d9fe9c40c7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:48.821123 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94858cc-5831-4e96-b9e4-d9fe9c40c7f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:48.821938 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94858cc-5831-4e96-b9e4-d9fe9c40c7f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:58:48.822254 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94858cc-5831-4e96-b9e4-d9fe9c40c7f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:48.823950 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94858cc-5831-4e96-b9e4-d9fe9c40c7f5 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:48.843698 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1183/2367] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 13:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:58:48.847626 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b30c0c-9887-4296-9f38-9237b645bdfb None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:48.859629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b30c0c-9887-4296-9f38-9237b645bdfb None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:48.866169 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ec7ac-a8ca-429c-a256-275205a542af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:48.866565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ec7ac-a8ca-429c-a256-275205a542af admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:48.866841 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ec7ac-a8ca-429c-a256-275205a542af admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:48.867107 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ec7ac-a8ca-429c-a256-275205a542af admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:48.867777 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ec7ac-a8ca-429c-a256-275205a542af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:48.869780 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ec7ac-a8ca-429c-a256-275205a542af admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:48.966619 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1185/2368] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 13:58:48 2022] POST /identity/v3/projects => generated 399 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:58:48.971386 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94858cc-5831-4e96-b9e4-d9fe9c40c7f5 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:48.983058 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94858cc-5831-4e96-b9e4-d9fe9c40c7f5 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:49.072607 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd4fbd-a5ff-4ca4-bf0b-75e528c8b020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:49.073244 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd4fbd-a5ff-4ca4-bf0b-75e528c8b020 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:49.073560 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd4fbd-a5ff-4ca4-bf0b-75e528c8b020 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:49.073834 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd4fbd-a5ff-4ca4-bf0b-75e528c8b020 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:49.074468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd4fbd-a5ff-4ca4-bf0b-75e528c8b020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:49.076508 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd4fbd-a5ff-4ca4-bf0b-75e528c8b020 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:49.194041 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1184/2369] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 13:58:48 2022] POST /identity/v3/users => generated 300 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:58:49.198464 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ec7ac-a8ca-429c-a256-275205a542af admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:49.209175 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ec7ac-a8ca-429c-a256-275205a542af admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:49.225295 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275d752-46a3-4146-8a64-2afea3872337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:49.225295 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275d752-46a3-4146-8a64-2afea3872337 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:49.225295 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275d752-46a3-4146-8a64-2afea3872337 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:49.225295 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275d752-46a3-4146-8a64-2afea3872337 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:49.226200 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275d752-46a3-4146-8a64-2afea3872337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:49.226200 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275d752-46a3-4146-8a64-2afea3872337 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:49.237318 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1186/2370] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 13:58:49.242128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd4fbd-a5ff-4ca4-bf0b-75e528c8b020 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:49.254423 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd4fbd-a5ff-4ca4-bf0b-75e528c8b020 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:49.272039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a669cb-757e-47d1-aada-7e13a4c48767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:49.272677 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a669cb-757e-47d1-aada-7e13a4c48767 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:49.272960 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a669cb-757e-47d1-aada-7e13a4c48767 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:49.273254 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a669cb-757e-47d1-aada-7e13a4c48767 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:49.273891 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a669cb-757e-47d1-aada-7e13a4c48767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:49.275554 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a669cb-757e-47d1-aada-7e13a4c48767 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:49.288911 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1185/2371] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 13:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 13:58:49.297347 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275d752-46a3-4146-8a64-2afea3872337 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:49.318069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275d752-46a3-4146-8a64-2afea3872337 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:49.322775 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34c2c7-eaf5-4a52-a6b4-82c55505e30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:49.323509 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34c2c7-eaf5-4a52-a6b4-82c55505e30c admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:49.323787 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34c2c7-eaf5-4a52-a6b4-82c55505e30c admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:49.324066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34c2c7-eaf5-4a52-a6b4-82c55505e30c admin admin] PATH_INFO: `/v3/projects/14d8c2541d9b4f848ffb1d1fb5f596f6/users/95a1cb13a6d84dcab04025685938ac03/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:49.341414 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34c2c7-eaf5-4a52-a6b4-82c55505e30c admin admin] RBAC: Authorizing `identity:create_grant(project_id=14d8c2541d9b4f848ffb1d1fb5f596f6, user_id=95a1cb13a6d84dcab04025685938ac03, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:49.344204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34c2c7-eaf5-4a52-a6b4-82c55505e30c admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:49.456750 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1187/2372] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 13:58:49 2022] PUT /identity/v3/projects/14d8c2541d9b4f848ffb1d1fb5f596f6/users/95a1cb13a6d84dcab04025685938ac03/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:58:49.458912 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b8e24-4566-4300-bd7e-28fb9f18f3ad None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:49.459300 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b8e24-4566-4300-bd7e-28fb9f18f3ad None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:49.459520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b8e24-4566-4300-bd7e-28fb9f18f3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:49.497926 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-f64b8e24-4566-4300-bd7e-28fb9f18f3ad None None] MFA Rules not processed for user `95a1cb13a6d84dcab04025685938ac03`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:49.499975 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-f64b8e24-4566-4300-bd7e-28fb9f18f3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:49.569486 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:49.596974 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1186/2373] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:58:49 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:58:49.611865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34c2c7-eaf5-4a52-a6b4-82c55505e30c admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:49.614845 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ee34c2c7-eaf5-4a52-a6b4-82c55505e30c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:49.693883 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34c2c7-eaf5-4a52-a6b4-82c55505e30c admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:49.697790 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21738d-d542-493f-a300-da455bae005c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:49.698413 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21738d-d542-493f-a300-da455bae005c service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:49.698695 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21738d-d542-493f-a300-da455bae005c service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:49.699011 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21738d-d542-493f-a300-da455bae005c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:49.725775 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21738d-d542-493f-a300-da455bae005c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:49.725775 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21738d-d542-493f-a300-da455bae005c service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:49.725775 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1188/2374] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:58:49 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:58:51.673013 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3d3d4-a324-4bbb-99b9-caa6c3d05d9d None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:51.674388 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3d3d4-a324-4bbb-99b9-caa6c3d05d9d None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:51.674849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3d3d4-a324-4bbb-99b9-caa6c3d05d9d None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:51.676712 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1187/2375] 10.222.0.50 () {54 vars in 921 bytes} [Thu Sep 1 13:58:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:58:51.682411 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81208d35-3146-4304-96c6-592e8a9b2724 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:51.682891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81208d35-3146-4304-96c6-592e8a9b2724 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:51.683092 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81208d35-3146-4304-96c6-592e8a9b2724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:51.719535 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-81208d35-3146-4304-96c6-592e8a9b2724 None None] MFA Rules not processed for user `2d231136bcd44d9a97efe6c257f936ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:51.721171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-81208d35-3146-4304-96c6-592e8a9b2724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:51.775463 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:51.791539 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1189/2376] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Sep 1 13:58:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:58:51.803605 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3d3d4-a324-4bbb-99b9-caa6c3d05d9d None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:51.805395 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-ddc3d3d4-a324-4bbb-99b9-caa6c3d05d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:51.876307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3d3d4-a324-4bbb-99b9-caa6c3d05d9d None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:51.881618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d21fb-1aa8-4cd4-902b-515398485d08 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc11fe25135d4bf1b1a06b8619e4a2e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:51.882227 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d21fb-1aa8-4cd4-902b-515398485d08 service glance] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:51.882512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d21fb-1aa8-4cd4-902b-515398485d08 service glance] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:51.882910 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d21fb-1aa8-4cd4-902b-515398485d08 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:51.893604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d21fb-1aa8-4cd4-902b-515398485d08 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:51.895052 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d21fb-1aa8-4cd4-902b-515398485d08 service glance] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:51.906746 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1188/2377] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:58:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:58:52.174878 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc526aa0-1a3c-4ef5-b063-dfa5d4589dd9 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:52.175167 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc526aa0-1a3c-4ef5-b063-dfa5d4589dd9 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:52.175487 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc526aa0-1a3c-4ef5-b063-dfa5d4589dd9 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:52.176835 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1190/2378] 10.222.0.50 () {54 vars in 921 bytes} [Thu Sep 1 13:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:58:52.181774 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7b8a8-70d0-4261-b427-d9e3a38c987d None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:52.182068 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7b8a8-70d0-4261-b427-d9e3a38c987d None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:52.182658 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7b8a8-70d0-4261-b427-d9e3a38c987d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:52.203387 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-87c7b8a8-70d0-4261-b427-d9e3a38c987d None None] MFA Rules not processed for user `72f0d372f6c34d1a9a990222d6b98948`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:52.204652 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-87c7b8a8-70d0-4261-b427-d9e3a38c987d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:52.278886 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1189/2379] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Sep 1 13:58:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:58:52.292347 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc526aa0-1a3c-4ef5-b063-dfa5d4589dd9 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:52.295271 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-cc526aa0-1a3c-4ef5-b063-dfa5d4589dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:52.314218 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc526aa0-1a3c-4ef5-b063-dfa5d4589dd9 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:52.319568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd98f5-5055-4fb3-b086-2c81ec359065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:52.321423 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd98f5-5055-4fb3-b086-2c81ec359065 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:52.321423 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd98f5-5055-4fb3-b086-2c81ec359065 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:52.321765 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd98f5-5055-4fb3-b086-2c81ec359065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:52.332596 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd98f5-5055-4fb3-b086-2c81ec359065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:52.334540 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd98f5-5055-4fb3-b086-2c81ec359065 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:52.347959 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1191/2380] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:58:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:58:52.483956 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959da1f-012c-4d51-a27b-c16574f6f255 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:52.484480 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959da1f-012c-4d51-a27b-c16574f6f255 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:52.489826 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959da1f-012c-4d51-a27b-c16574f6f255 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:52.489826 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1190/2381] 10.222.0.50 () {54 vars in 921 bytes} [Thu Sep 1 13:58:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:58:52.493242 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994ba01-c406-4e70-b0a8-4f2a100c60cd None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:52.493723 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994ba01-c406-4e70-b0a8-4f2a100c60cd None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:52.494425 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994ba01-c406-4e70-b0a8-4f2a100c60cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:52.520551 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-a994ba01-c406-4e70-b0a8-4f2a100c60cd None None] MFA Rules not processed for user `2d231136bcd44d9a97efe6c257f936ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:52.521819 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a994ba01-c406-4e70-b0a8-4f2a100c60cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:52.532207 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1192/2382] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Sep 1 13:58:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:58:52.543309 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959da1f-012c-4d51-a27b-c16574f6f255 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:52.554961 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959da1f-012c-4d51-a27b-c16574f6f255 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:52.558479 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cad4c-b483-47c4-97a9-bdbcae44be74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:52.559086 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cad4c-b483-47c4-97a9-bdbcae44be74 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:52.559414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cad4c-b483-47c4-97a9-bdbcae44be74 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:52.559690 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cad4c-b483-47c4-97a9-bdbcae44be74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:52.571520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cad4c-b483-47c4-97a9-bdbcae44be74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:52.575717 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cad4c-b483-47c4-97a9-bdbcae44be74 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:52.584906 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1191/2383] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:58:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:58:59.091953 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994ba01-c406-4e70-b0a8-4f2a100c60cd None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:59.165268 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994ba01-c406-4e70-b0a8-4f2a100c60cd None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:59.171443 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c058780-5a08-4ff2-852e-7b8ba62a3f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:59.172117 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c058780-5a08-4ff2-852e-7b8ba62a3f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:59.172402 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c058780-5a08-4ff2-852e-7b8ba62a3f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:59.172683 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c058780-5a08-4ff2-852e-7b8ba62a3f1c admin admin] PATH_INFO: `/v3/users/95a1cb13a6d84dcab04025685938ac03` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:59.173941 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c058780-5a08-4ff2-852e-7b8ba62a3f1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=95a1cb13a6d84dcab04025685938ac03)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:59.175967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c058780-5a08-4ff2-852e-7b8ba62a3f1c admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:59.375583 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-7c058780-5a08-4ff2-852e-7b8ba62a3f1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95a1cb13a6d84dcab04025685938ac03'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:58:59.455244 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-7c058780-5a08-4ff2-852e-7b8ba62a3f1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95a1cb13a6d84dcab04025685938ac03'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:58:59.463897 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-7c058780-5a08-4ff2-852e-7b8ba62a3f1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95a1cb13a6d84dcab04025685938ac03'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:58:59.477865 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-7c058780-5a08-4ff2-852e-7b8ba62a3f1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95a1cb13a6d84dcab04025685938ac03'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:58:59.478624 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-7c058780-5a08-4ff2-852e-7b8ba62a3f1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95a1cb13a6d84dcab04025685938ac03'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:58:59.485822 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1193/2384] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 13:58:59 2022] DELETE /identity/v3/users/95a1cb13a6d84dcab04025685938ac03 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:58:59.490864 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c00c5-047b-4bba-92c4-70706ff99dbe None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:59.491509 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c00c5-047b-4bba-92c4-70706ff99dbe None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:59.491667 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c00c5-047b-4bba-92c4-70706ff99dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:59.513328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-614c00c5-047b-4bba-92c4-70706ff99dbe None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:59.514572 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-614c00c5-047b-4bba-92c4-70706ff99dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:59.578323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1192/2385] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:58:59.588692 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c058780-5a08-4ff2-852e-7b8ba62a3f1c admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:59.590121 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-7c058780-5a08-4ff2-852e-7b8ba62a3f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:59.649320 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c058780-5a08-4ff2-852e-7b8ba62a3f1c admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:59.653333 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc8574-f653-40bb-a979-13071902d99f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:59.654027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc8574-f653-40bb-a979-13071902d99f service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:59.654304 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc8574-f653-40bb-a979-13071902d99f service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:59.654574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc8574-f653-40bb-a979-13071902d99f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:59.660898 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:59.664876 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc8574-f653-40bb-a979-13071902d99f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:59.666378 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc8574-f653-40bb-a979-13071902d99f service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:59.676588 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1194/2386] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:58:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:59:00.143153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c00c5-047b-4bba-92c4-70706ff99dbe None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:59:00.144962 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-614c00c5-047b-4bba-92c4-70706ff99dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:00.159216 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c00c5-047b-4bba-92c4-70706ff99dbe None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:59:00.164741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4cf7a9-8bff-4c9b-8b75-23018580f805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:59:00.166546 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cf7a9-8bff-4c9b-8b75-23018580f805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:00.166546 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cf7a9-8bff-4c9b-8b75-23018580f805 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:00.166546 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cf7a9-8bff-4c9b-8b75-23018580f805 admin admin] PATH_INFO: `/v3/projects/14d8c2541d9b4f848ffb1d1fb5f596f6` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:00.166829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4cf7a9-8bff-4c9b-8b75-23018580f805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14d8c2541d9b4f848ffb1d1fb5f596f6)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:59:00.169313 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4cf7a9-8bff-4c9b-8b75-23018580f805 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:59:00.201311 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:00.322041 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-4d4cf7a9-8bff-4c9b-8b75-23018580f805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14d8c2541d9b4f848ffb1d1fb5f596f6', 'request_id': 'req-4d4cf7a9-8bff-4c9b-8b75-23018580f805'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:59:00.330454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-4d4cf7a9-8bff-4c9b-8b75-23018580f805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14d8c2541d9b4f848ffb1d1fb5f596f6', 'request_id': 'req-4d4cf7a9-8bff-4c9b-8b75-23018580f805'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:59:00.337384 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-4d4cf7a9-8bff-4c9b-8b75-23018580f805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14d8c2541d9b4f848ffb1d1fb5f596f6', 'request_id': 'req-4d4cf7a9-8bff-4c9b-8b75-23018580f805'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:59:00.414597 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-4d4cf7a9-8bff-4c9b-8b75-23018580f805 admin admin] The token cache is being invalidate because project 14d8c2541d9b4f848ffb1d1fb5f596f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 13:59:00.428666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-4d4cf7a9-8bff-4c9b-8b75-23018580f805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:59:00.428666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-4d4cf7a9-8bff-4c9b-8b75-23018580f805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 13:59:00.428666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1193/2387] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 13:59:00 2022] DELETE /identity/v3/projects/14d8c2541d9b4f848ffb1d1fb5f596f6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:59:00.442057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca66b6-c7d1-4dd9-bb5e-d48175bf2d06 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:00.442657 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca66b6-c7d1-4dd9-bb5e-d48175bf2d06 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:00.442657 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca66b6-c7d1-4dd9-bb5e-d48175bf2d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:00.464227 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-aeca66b6-c7d1-4dd9-bb5e-d48175bf2d06 None None] MFA Rules not processed for user `5a441adf6eee4ba78992aafbbf02f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:00.466000 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-aeca66b6-c7d1-4dd9-bb5e-d48175bf2d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:00.526020 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1195/2388] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 13:59:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:59:04.101804 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbf66c-18b7-4dac-8151-396642aa25a1 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:04.102286 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbf66c-18b7-4dac-8151-396642aa25a1 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:04.102551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbf66c-18b7-4dac-8151-396642aa25a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:04.123909 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-79cbf66c-18b7-4dac-8151-396642aa25a1 None None] MFA Rules not processed for user `6f01578bf21244a5ac357e54979ffc0d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:04.125131 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-79cbf66c-18b7-4dac-8151-396642aa25a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:04.181429 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1194/2389] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 1 13:59:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:59:04.193501 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca66b6-c7d1-4dd9-bb5e-d48175bf2d06 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:59:04.194870 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-aeca66b6-c7d1-4dd9-bb5e-d48175bf2d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:04.263791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca66b6-c7d1-4dd9-bb5e-d48175bf2d06 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:59:04.269265 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f91fb-474d-4970-9a4d-503f64a4017c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bbede0f8674384bcc3028ea77eb724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:59:04.269875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f91fb-474d-4970-9a4d-503f64a4017c service swift] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:04.270160 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f91fb-474d-4970-9a4d-503f64a4017c service swift] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:04.270431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f91fb-474d-4970-9a4d-503f64a4017c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:04.279282 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f91fb-474d-4970-9a4d-503f64a4017c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:59:04.280899 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f91fb-474d-4970-9a4d-503f64a4017c service swift] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:59:04.288925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1196/2390] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 1 13:59:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 13:59:13.375190 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbf66c-18b7-4dac-8151-396642aa25a1 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:59:13.376552 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-79cbf66c-18b7-4dac-8151-396642aa25a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:13.436307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbf66c-18b7-4dac-8151-396642aa25a1 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:59:13.440207 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14aad0-ab5d-45c7-a4a9-5e0e4a1aa91b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:59:13.440816 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14aad0-ab5d-45c7-a4a9-5e0e4a1aa91b service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:13.441096 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14aad0-ab5d-45c7-a4a9-5e0e4a1aa91b service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:13.441375 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14aad0-ab5d-45c7-a4a9-5e0e4a1aa91b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:13.443089 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-2b14aad0-ab5d-45c7-a4a9-5e0e4a1aa91b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:13.510174 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:13.516093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b14aad0-ab5d-45c7-a4a9-5e0e4a1aa91b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:59:13.516311 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b14aad0-ab5d-45c7-a4a9-5e0e4a1aa91b service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:59:13.527425 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1195/2391] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:59:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:59:14.285690 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=60 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:14.710287 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f91fb-474d-4970-9a4d-503f64a4017c service swift] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:59:14.711936 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-f55f91fb-474d-4970-9a4d-503f64a4017c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:14.723918 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f91fb-474d-4970-9a4d-503f64a4017c service swift] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:59:14.727534 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdbb5b-1029-4905-9c01-994c5e237f18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:59:14.728124 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdbb5b-1029-4905-9c01-994c5e237f18 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:14.728404 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdbb5b-1029-4905-9c01-994c5e237f18 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:14.728678 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdbb5b-1029-4905-9c01-994c5e237f18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:14.730352 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-f5bdbb5b-1029-4905-9c01-994c5e237f18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:14.743861 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdbb5b-1029-4905-9c01-994c5e237f18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:59:14.745283 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdbb5b-1029-4905-9c01-994c5e237f18 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:59:14.757175 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1197/2392] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:59:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:59:23.634824 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:24.751860 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=6 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:31.901740 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e205b-71f6-4412-a1c8-6cf1d4a49656 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:31.902212 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e205b-71f6-4412-a1c8-6cf1d4a49656 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:31.902570 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e205b-71f6-4412-a1c8-6cf1d4a49656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:31.926487 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-128e205b-71f6-4412-a1c8-6cf1d4a49656 None None] MFA Rules not processed for user `6f01578bf21244a5ac357e54979ffc0d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:31.927728 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-128e205b-71f6-4412-a1c8-6cf1d4a49656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:31.935330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1196/2393] 10.222.0.50 () {58 vars in 967 bytes} [Thu Sep 1 13:59:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:59:31.959785 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdbb5b-1029-4905-9c01-994c5e237f18 service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:59:31.971553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdbb5b-1029-4905-9c01-994c5e237f18 service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:59:31.976607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ca6ba-5db5-4843-aefb-f0f421e5d81b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bbede0f8674384bcc3028ea77eb724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:59:31.977208 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ca6ba-5db5-4843-aefb-f0f421e5d81b service swift] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:31.977487 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ca6ba-5db5-4843-aefb-f0f421e5d81b service swift] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:31.977756 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ca6ba-5db5-4843-aefb-f0f421e5d81b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:31.987164 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ca6ba-5db5-4843-aefb-f0f421e5d81b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:59:31.988824 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ca6ba-5db5-4843-aefb-f0f421e5d81b service swift] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:59:31.997170 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1198/2394] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 1 13:59:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 13:59:41.611035 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695502a-1799-4b3b-96ea-836cf2e356e7 None None] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:41.611667 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695502a-1799-4b3b-96ea-836cf2e356e7 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:41.611768 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695502a-1799-4b3b-96ea-836cf2e356e7 None None] PATH_INFO: `/` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:41.613091 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1197/2395] 10.222.0.50 () {54 vars in 921 bytes} [Thu Sep 1 13:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:59:41.619564 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fad3d-3d7d-4463-af3a-028984e5bb5d None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:41.621173 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fad3d-3d7d-4463-af3a-028984e5bb5d None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:41.621459 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fad3d-3d7d-4463-af3a-028984e5bb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:41.648360 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-457fad3d-3d7d-4463-af3a-028984e5bb5d None None] MFA Rules not processed for user `72f0d372f6c34d1a9a990222d6b98948`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:41.649124 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-457fad3d-3d7d-4463-af3a-028984e5bb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:41.659488 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1199/2396] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Sep 1 13:59:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:59:41.673809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695502a-1799-4b3b-96ea-836cf2e356e7 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:59:41.685830 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695502a-1799-4b3b-96ea-836cf2e356e7 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:59:41.690326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7c141-9bf0-4644-84e4-bf306ed3bc79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:59:41.690922 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7c141-9bf0-4644-84e4-bf306ed3bc79 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:41.691227 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7c141-9bf0-4644-84e4-bf306ed3bc79 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:41.691539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7c141-9bf0-4644-84e4-bf306ed3bc79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:41.698832 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7c141-9bf0-4644-84e4-bf306ed3bc79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:59:41.700605 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7c141-9bf0-4644-84e4-bf306ed3bc79 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:59:41.709972 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1198/2397] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:59:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:59:41.794901 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6210d-4cf3-4496-a04d-6f71180d1e98 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:41.795190 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6210d-4cf3-4496-a04d-6f71180d1e98 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:41.795503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6210d-4cf3-4496-a04d-6f71180d1e98 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:41.797568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1200/2398] 10.222.0.50 () {54 vars in 921 bytes} [Thu Sep 1 13:59:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:59:41.802925 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67d6ee-ccd3-4535-b06a-efb28a11c484 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:41.803208 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67d6ee-ccd3-4535-b06a-efb28a11c484 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:41.803512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67d6ee-ccd3-4535-b06a-efb28a11c484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:41.823683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-0d67d6ee-ccd3-4535-b06a-efb28a11c484 None None] MFA Rules not processed for user `2d231136bcd44d9a97efe6c257f936ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:41.824919 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-0d67d6ee-ccd3-4535-b06a-efb28a11c484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:41.834311 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1199/2399] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Sep 1 13:59:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:59:41.845015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6210d-4cf3-4496-a04d-6f71180d1e98 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:59:41.856230 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6210d-4cf3-4496-a04d-6f71180d1e98 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:59:41.860704 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db58b88-449a-4ae3-982d-e547c491ab45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:59:41.861296 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db58b88-449a-4ae3-982d-e547c491ab45 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:41.861599 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db58b88-449a-4ae3-982d-e547c491ab45 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:41.861870 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db58b88-449a-4ae3-982d-e547c491ab45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:41.872260 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db58b88-449a-4ae3-982d-e547c491ab45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:59:41.873671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db58b88-449a-4ae3-982d-e547c491ab45 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:59:41.885089 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1201/2400] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:59:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:59:41.951661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67d6ee-ccd3-4535-b06a-efb28a11c484 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:59:41.953169 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-0d67d6ee-ccd3-4535-b06a-efb28a11c484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:42.025645 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67d6ee-ccd3-4535-b06a-efb28a11c484 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:59:42.031107 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050299d3-ad6d-4f8f-8b13-99f385d66d0b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e675d44d2c49929feb0ec0d2c0d0eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:59:42.031822 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050299d3-ad6d-4f8f-8b13-99f385d66d0b service placement] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:42.032105 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050299d3-ad6d-4f8f-8b13-99f385d66d0b service placement] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:42.032380 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050299d3-ad6d-4f8f-8b13-99f385d66d0b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:42.034311 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-050299d3-ad6d-4f8f-8b13-99f385d66d0b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:42.045920 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050299d3-ad6d-4f8f-8b13-99f385d66d0b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:59:42.048072 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050299d3-ad6d-4f8f-8b13-99f385d66d0b service placement] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:59:42.057968 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1200/2401] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:59:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:59:49.857088 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db58b88-449a-4ae3-982d-e547c491ab45 service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:59:49.858892 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-4db58b88-449a-4ae3-982d-e547c491ab45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:49.930394 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db58b88-449a-4ae3-982d-e547c491ab45 service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:59:49.938328 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002a896-ea57-4c59-afc8-06f03740e338 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:59:49.939024 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002a896-ea57-4c59-afc8-06f03740e338 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:49.939218 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002a896-ea57-4c59-afc8-06f03740e338 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:49.939968 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002a896-ea57-4c59-afc8-06f03740e338 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:49.943260 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-1002a896-ea57-4c59-afc8-06f03740e338 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:50.010965 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002a896-ea57-4c59-afc8-06f03740e338 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:59:50.012502 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002a896-ea57-4c59-afc8-06f03740e338 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:59:50.022785 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1202/2402] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:59:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:59:52.053738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=44 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:54.362796 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050299d3-ad6d-4f8f-8b13-99f385d66d0b service placement] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:59:54.368963 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-050299d3-ad6d-4f8f-8b13-99f385d66d0b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:54.381535 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050299d3-ad6d-4f8f-8b13-99f385d66d0b service placement] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:59:54.385220 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b69993-a94c-444b-a10b-27c1836c11ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:59:54.385835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b69993-a94c-444b-a10b-27c1836c11ec service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:54.386111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b69993-a94c-444b-a10b-27c1836c11ec service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:54.386580 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b69993-a94c-444b-a10b-27c1836c11ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:54.388397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a3b69993-a94c-444b-a10b-27c1836c11ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:54.403339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b69993-a94c-444b-a10b-27c1836c11ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:59:54.405345 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b69993-a94c-444b-a10b-27c1836c11ec service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:59:54.416138 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1201/2403] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 13:59:54 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:00:00.018280 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=63 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:02.224684 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54724102-3704-4ce1-9b0e-4cd67bbdbdd3 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:02.225453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54724102-3704-4ce1-9b0e-4cd67bbdbdd3 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:02.225453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54724102-3704-4ce1-9b0e-4cd67bbdbdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:02.246080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-54724102-3704-4ce1-9b0e-4cd67bbdbdd3 None None] MFA Rules not processed for user `e35ebc3dbc1f4f348f97041627fc68b9`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:02.247331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-54724102-3704-4ce1-9b0e-4cd67bbdbdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:02.255002 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1203/2404] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:00:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:02.575348 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b69993-a94c-444b-a10b-27c1836c11ec service cinder] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:02.585916 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b69993-a94c-444b-a10b-27c1836c11ec service cinder] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:02.589576 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858b83f-595d-48ee-a2ab-3ca1d4ac7276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:02.590178 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858b83f-595d-48ee-a2ab-3ca1d4ac7276 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:02.590459 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858b83f-595d-48ee-a2ab-3ca1d4ac7276 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:02.590726 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858b83f-595d-48ee-a2ab-3ca1d4ac7276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:02.592487 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-e858b83f-595d-48ee-a2ab-3ca1d4ac7276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:02.602464 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858b83f-595d-48ee-a2ab-3ca1d4ac7276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:02.603944 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858b83f-595d-48ee-a2ab-3ca1d4ac7276 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:02.615494 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1202/2405] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:00:03.517928 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54724102-3704-4ce1-9b0e-4cd67bbdbdd3 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:03.529373 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54724102-3704-4ce1-9b0e-4cd67bbdbdd3 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:03.534780 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bff59-2f37-4aa6-8db6-641fa3691caf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:03.535532 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bff59-2f37-4aa6-8db6-641fa3691caf service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:03.535874 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bff59-2f37-4aa6-8db6-641fa3691caf service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:03.536205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bff59-2f37-4aa6-8db6-641fa3691caf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:03.538219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-be9bff59-2f37-4aa6-8db6-641fa3691caf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:03.549328 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9bff59-2f37-4aa6-8db6-641fa3691caf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:03.551342 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9bff59-2f37-4aa6-8db6-641fa3691caf service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:03.560390 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1204/2406] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:00:04.549937 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858b83f-595d-48ee-a2ab-3ca1d4ac7276 service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:04.563333 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-e858b83f-595d-48ee-a2ab-3ca1d4ac7276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:04.570621 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858b83f-595d-48ee-a2ab-3ca1d4ac7276 service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:04.576409 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67ad6d-4bfb-4d0d-ac43-e5cf041101c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:04.577107 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67ad6d-4bfb-4d0d-ac43-e5cf041101c1 service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:04.578255 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67ad6d-4bfb-4d0d-ac43-e5cf041101c1 service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:04.578553 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67ad6d-4bfb-4d0d-ac43-e5cf041101c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:04.580466 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-2b67ad6d-4bfb-4d0d-ac43-e5cf041101c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:04.594576 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67ad6d-4bfb-4d0d-ac43-e5cf041101c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:04.596874 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67ad6d-4bfb-4d0d-ac43-e5cf041101c1 service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:04.610221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1203/2407] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:00:08.788171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368ea16-7b2f-4277-a3c7-fe00345e76b3 None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:08.789336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368ea16-7b2f-4277-a3c7-fe00345e76b3 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:08.790500 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368ea16-7b2f-4277-a3c7-fe00345e76b3 None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:08.793663 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1205/2408] 10.222.0.50 () {54 vars in 961 bytes} [Thu Sep 1 14:00:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:00:08.799345 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85511f16-59b5-4d38-8d58-1cca78b42407 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:08.801887 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85511f16-59b5-4d38-8d58-1cca78b42407 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:08.801887 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85511f16-59b5-4d38-8d58-1cca78b42407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:08.832884 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-85511f16-59b5-4d38-8d58-1cca78b42407 None None] MFA Rules not processed for user `63e675d44d2c49929feb0ec0d2c0d0eb`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:08.834589 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-85511f16-59b5-4d38-8d58-1cca78b42407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:08.851392 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1204/2409] 10.222.0.50 () {58 vars in 1058 bytes} [Thu Sep 1 14:00:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:08.860343 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368ea16-7b2f-4277-a3c7-fe00345e76b3 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:08.873941 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368ea16-7b2f-4277-a3c7-fe00345e76b3 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:08.879382 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48d89a-ff23-4e83-bd40-c40128986adb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e675d44d2c49929feb0ec0d2c0d0eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:08.880002 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48d89a-ff23-4e83-bd40-c40128986adb service placement] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:08.880283 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48d89a-ff23-4e83-bd40-c40128986adb service placement] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:08.880561 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48d89a-ff23-4e83-bd40-c40128986adb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:08.882356 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-2a48d89a-ff23-4e83-bd40-c40128986adb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:08.908315 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48d89a-ff23-4e83-bd40-c40128986adb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:08.910205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48d89a-ff23-4e83-bd40-c40128986adb service placement] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:08.921257 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1206/2410] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:00:08.937214 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85511f16-59b5-4d38-8d58-1cca78b42407 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:08.939161 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-85511f16-59b5-4d38-8d58-1cca78b42407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:09.023199 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85511f16-59b5-4d38-8d58-1cca78b42407 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:09.029828 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e29e08-6f09-42ba-9950-3b59178bf12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:09.030541 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e29e08-6f09-42ba-9950-3b59178bf12b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:09.031529 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e29e08-6f09-42ba-9950-3b59178bf12b admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:09.031815 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e29e08-6f09-42ba-9950-3b59178bf12b admin admin] PATH_INFO: `/v3/users/b838210ed8ba4cac973eca59c1746c7b` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:09.032990 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e29e08-6f09-42ba-9950-3b59178bf12b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b838210ed8ba4cac973eca59c1746c7b)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:09.036358 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e29e08-6f09-42ba-9950-3b59178bf12b admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:09.258312 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-22e29e08-6f09-42ba-9950-3b59178bf12b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b838210ed8ba4cac973eca59c1746c7b'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:09.259396 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-22e29e08-6f09-42ba-9950-3b59178bf12b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b838210ed8ba4cac973eca59c1746c7b'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:09.272837 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-22e29e08-6f09-42ba-9950-3b59178bf12b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b838210ed8ba4cac973eca59c1746c7b'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:09.280696 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-22e29e08-6f09-42ba-9950-3b59178bf12b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b838210ed8ba4cac973eca59c1746c7b'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:09.401381 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-22e29e08-6f09-42ba-9950-3b59178bf12b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b838210ed8ba4cac973eca59c1746c7b'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:09.408151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1205/2411] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:00:08 2022] DELETE /identity/v3/users/b838210ed8ba4cac973eca59c1746c7b => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:00:09.748957 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48d89a-ff23-4e83-bd40-c40128986adb service placement] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:09.760270 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48d89a-ff23-4e83-bd40-c40128986adb service placement] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:09.819464 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c37784-3f61-4dac-91b5-4e71ad10329c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:09.820163 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c37784-3f61-4dac-91b5-4e71ad10329c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:09.820364 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c37784-3f61-4dac-91b5-4e71ad10329c admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:09.820644 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c37784-3f61-4dac-91b5-4e71ad10329c admin admin] PATH_INFO: `/v3/projects/4c6e12d2b4fa462eb7cd1275d14faee0` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:09.821768 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c37784-3f61-4dac-91b5-4e71ad10329c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c6e12d2b4fa462eb7cd1275d14faee0)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:09.823713 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c37784-3f61-4dac-91b5-4e71ad10329c admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:09.986861 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b6c37784-3f61-4dac-91b5-4e71ad10329c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c6e12d2b4fa462eb7cd1275d14faee0', 'request_id': 'req-b6c37784-3f61-4dac-91b5-4e71ad10329c'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:09.993047 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b6c37784-3f61-4dac-91b5-4e71ad10329c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c6e12d2b4fa462eb7cd1275d14faee0', 'request_id': 'req-b6c37784-3f61-4dac-91b5-4e71ad10329c'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:10.060929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b6c37784-3f61-4dac-91b5-4e71ad10329c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c6e12d2b4fa462eb7cd1275d14faee0', 'request_id': 'req-b6c37784-3f61-4dac-91b5-4e71ad10329c'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:10.072703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b6c37784-3f61-4dac-91b5-4e71ad10329c admin admin] The token cache is being invalidate because project 4c6e12d2b4fa462eb7cd1275d14faee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:00:10.072993 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b6c37784-3f61-4dac-91b5-4e71ad10329c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:10.073623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b6c37784-3f61-4dac-91b5-4e71ad10329c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:10.075108 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1207/2412] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:00:09 2022] DELETE /identity/v3/projects/4c6e12d2b4fa462eb7cd1275d14faee0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:00:10.080112 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb40625-fea0-481e-b34e-4a8b8ca0973d None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:10.087807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb40625-fea0-481e-b34e-4a8b8ca0973d None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:10.087807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb40625-fea0-481e-b34e-4a8b8ca0973d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:10.101718 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-bcb40625-fea0-481e-b34e-4a8b8ca0973d None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:10.102995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-bcb40625-fea0-481e-b34e-4a8b8ca0973d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:10.136417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:10.169322 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1206/2413] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:10.177479 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f90504-6cfe-47d6-9a09-edd5e071c493 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:10.177753 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f90504-6cfe-47d6-9a09-edd5e071c493 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:10.178027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f90504-6cfe-47d6-9a09-edd5e071c493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:10.198047 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-f7f90504-6cfe-47d6-9a09-edd5e071c493 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:10.199260 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-f7f90504-6cfe-47d6-9a09-edd5e071c493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:10.209012 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1208/2414] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:10.213280 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb40625-fea0-481e-b34e-4a8b8ca0973d None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:10.224439 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb40625-fea0-481e-b34e-4a8b8ca0973d None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:10.229326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39b588-bc86-4fdb-b754-23c31cb1799a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:10.229938 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39b588-bc86-4fdb-b754-23c31cb1799a admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:10.230245 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39b588-bc86-4fdb-b754-23c31cb1799a admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:10.230993 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39b588-bc86-4fdb-b754-23c31cb1799a admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:10.232058 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39b588-bc86-4fdb-b754-23c31cb1799a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:00:10.232562 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39b588-bc86-4fdb-b754-23c31cb1799a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:10.235727 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39b588-bc86-4fdb-b754-23c31cb1799a admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:10.251871 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1207/2415] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 14:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:00:10.256029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f90504-6cfe-47d6-9a09-edd5e071c493 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:10.269376 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f90504-6cfe-47d6-9a09-edd5e071c493 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:10.274245 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f15a0-ffbf-43a0-ba0b-d2d0883aa55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:10.274859 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f15a0-ffbf-43a0-ba0b-d2d0883aa55a admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:10.275139 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f15a0-ffbf-43a0-ba0b-d2d0883aa55a admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:10.275449 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f15a0-ffbf-43a0-ba0b-d2d0883aa55a admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:10.276086 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f15a0-ffbf-43a0-ba0b-d2d0883aa55a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:10.277970 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f15a0-ffbf-43a0-ba0b-d2d0883aa55a admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:10.383081 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1209/2416] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:00:10 2022] POST /identity/v3/projects => generated 389 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:00:10.386988 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39b588-bc86-4fdb-b754-23c31cb1799a admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:10.397865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39b588-bc86-4fdb-b754-23c31cb1799a admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:10.456907 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692a789-52a0-4541-b9b5-1c7986bbff0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:10.457517 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692a789-52a0-4541-b9b5-1c7986bbff0f admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:10.457801 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692a789-52a0-4541-b9b5-1c7986bbff0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:10.458077 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692a789-52a0-4541-b9b5-1c7986bbff0f admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:10.458708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692a789-52a0-4541-b9b5-1c7986bbff0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:10.460680 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692a789-52a0-4541-b9b5-1c7986bbff0f admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:10.564289 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1208/2417] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:00:10 2022] POST /identity/v3/users => generated 295 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:00:10.568379 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f15a0-ffbf-43a0-ba0b-d2d0883aa55a admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:10.579320 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f15a0-ffbf-43a0-ba0b-d2d0883aa55a admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:10.584013 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72977fc-5318-49bc-a3fd-a9978d5b9515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:10.584607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72977fc-5318-49bc-a3fd-a9978d5b9515 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:10.584928 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72977fc-5318-49bc-a3fd-a9978d5b9515 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:10.585230 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72977fc-5318-49bc-a3fd-a9978d5b9515 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:10.585873 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72977fc-5318-49bc-a3fd-a9978d5b9515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:10.587506 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72977fc-5318-49bc-a3fd-a9978d5b9515 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:10.598175 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1210/2418] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:00:10.602364 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692a789-52a0-4541-b9b5-1c7986bbff0f admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:10.612808 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692a789-52a0-4541-b9b5-1c7986bbff0f admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:10.617471 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db12854-01a9-4e65-a2e6-6fdf80227ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:10.618069 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db12854-01a9-4e65-a2e6-6fdf80227ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:10.618355 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db12854-01a9-4e65-a2e6-6fdf80227ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:10.618635 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db12854-01a9-4e65-a2e6-6fdf80227ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:10.619349 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db12854-01a9-4e65-a2e6-6fdf80227ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:10.620993 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db12854-01a9-4e65-a2e6-6fdf80227ad9 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:10.632314 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1209/2419] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:00:10.636452 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72977fc-5318-49bc-a3fd-a9978d5b9515 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:10.647682 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72977fc-5318-49bc-a3fd-a9978d5b9515 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:10.652382 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5aa2db-9056-47d5-925b-79f1859570c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:10.653031 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5aa2db-9056-47d5-925b-79f1859570c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:10.653315 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5aa2db-9056-47d5-925b-79f1859570c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:10.653591 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5aa2db-9056-47d5-925b-79f1859570c1 admin admin] PATH_INFO: `/v3/projects/9881f7ef77694d5087183d5f4825a5fb/users/883489b813654953bffd6168ec8ab9d6/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:10.668575 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5aa2db-9056-47d5-925b-79f1859570c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9881f7ef77694d5087183d5f4825a5fb, user_id=883489b813654953bffd6168ec8ab9d6, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:10.671240 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5aa2db-9056-47d5-925b-79f1859570c1 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:10.673444 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:10.778538 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1211/2420] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:00:10 2022] PUT /identity/v3/projects/9881f7ef77694d5087183d5f4825a5fb/users/883489b813654953bffd6168ec8ab9d6/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:00:10.789183 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07df064-3519-417d-adfe-ebbba1c0fcd6 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:10.789468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07df064-3519-417d-adfe-ebbba1c0fcd6 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:10.789770 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07df064-3519-417d-adfe-ebbba1c0fcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:10.820808 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-c07df064-3519-417d-adfe-ebbba1c0fcd6 None None] MFA Rules not processed for user `883489b813654953bffd6168ec8ab9d6`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:10.823014 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c07df064-3519-417d-adfe-ebbba1c0fcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:10.901323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1210/2421] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:00:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:10.912236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5aa2db-9056-47d5-925b-79f1859570c1 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:10.914412 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ab5aa2db-9056-47d5-925b-79f1859570c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:10.977747 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5aa2db-9056-47d5-925b-79f1859570c1 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:10.981441 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c226c-9250-44af-b5c9-d7ea7de3a0be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:10.982046 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c226c-9250-44af-b5c9-d7ea7de3a0be service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:10.982320 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c226c-9250-44af-b5c9-d7ea7de3a0be service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:10.982589 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c226c-9250-44af-b5c9-d7ea7de3a0be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:10.991876 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c226c-9250-44af-b5c9-d7ea7de3a0be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:10.993253 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c226c-9250-44af-b5c9-d7ea7de3a0be service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:11.002617 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1212/2422] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:10 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:00:16.999619 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07df064-3519-417d-adfe-ebbba1c0fcd6 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:17.001128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c07df064-3519-417d-adfe-ebbba1c0fcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:17.042443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:17.087738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07df064-3519-417d-adfe-ebbba1c0fcd6 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:17.093899 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23963d6b-ac2d-4c6b-9fed-548ecab74aab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:17.095527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23963d6b-ac2d-4c6b-9fed-548ecab74aab service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:17.095527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23963d6b-ac2d-4c6b-9fed-548ecab74aab service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:17.095527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23963d6b-ac2d-4c6b-9fed-548ecab74aab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:17.096968 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-23963d6b-ac2d-4c6b-9fed-548ecab74aab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:17.109935 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23963d6b-ac2d-4c6b-9fed-548ecab74aab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:17.111586 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23963d6b-ac2d-4c6b-9fed-548ecab74aab service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:17.125045 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1211/2423] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:00:20.998073 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:INSERT=1,keystone:SELECT=28 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:27.432372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=21 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:29.306619 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c226c-9250-44af-b5c9-d7ea7de3a0be service cinder] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:29.308990 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-fd5c226c-9250-44af-b5c9-d7ea7de3a0be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:29.339938 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c226c-9250-44af-b5c9-d7ea7de3a0be service cinder] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:29.354463 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a1c8c-7a40-4ca4-9acc-625db2ccea52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:29.356315 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a1c8c-7a40-4ca4-9acc-625db2ccea52 service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:29.357074 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a1c8c-7a40-4ca4-9acc-625db2ccea52 service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:29.357868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a1c8c-7a40-4ca4-9acc-625db2ccea52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:29.362324 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-2a1a1c8c-7a40-4ca4-9acc-625db2ccea52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:29.379728 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a1c8c-7a40-4ca4-9acc-625db2ccea52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:29.382564 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a1c8c-7a40-4ca4-9acc-625db2ccea52 service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:29.396714 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1213/2424] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:00:30.030428 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23963d6b-ac2d-4c6b-9fed-548ecab74aab service nova] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:30.032530 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-23963d6b-ac2d-4c6b-9fed-548ecab74aab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:30.136468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23963d6b-ac2d-4c6b-9fed-548ecab74aab service nova] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:30.140391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde13a40-e9b4-4ca5-bb4b-5a17c2854029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:30.141192 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde13a40-e9b4-4ca5-bb4b-5a17c2854029 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:30.141621 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde13a40-e9b4-4ca5-bb4b-5a17c2854029 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:30.141980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde13a40-e9b4-4ca5-bb4b-5a17c2854029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:30.144125 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-cde13a40-e9b4-4ca5-bb4b-5a17c2854029 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:30.239200 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde13a40-e9b4-4ca5-bb4b-5a17c2854029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:30.241724 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde13a40-e9b4-4ca5-bb4b-5a17c2854029 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:30.258685 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1212/2425] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:00:32.794140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a1c8c-7a40-4ca4-9acc-625db2ccea52 service nova] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:32.819479 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a1c8c-7a40-4ca4-9acc-625db2ccea52 service nova] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:32.829403 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51262d4f-545b-4a1c-ac6b-612c10ababa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:32.831016 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51262d4f-545b-4a1c-ac6b-612c10ababa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:32.831892 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51262d4f-545b-4a1c-ac6b-612c10ababa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:32.833046 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51262d4f-545b-4a1c-ac6b-612c10ababa0 admin admin] PATH_INFO: `/v3/users/883489b813654953bffd6168ec8ab9d6` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:32.838417 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51262d4f-545b-4a1c-ac6b-612c10ababa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=883489b813654953bffd6168ec8ab9d6)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:32.843385 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51262d4f-545b-4a1c-ac6b-612c10ababa0 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:33.256188 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-51262d4f-545b-4a1c-ac6b-612c10ababa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '883489b813654953bffd6168ec8ab9d6'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:33.341358 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-51262d4f-545b-4a1c-ac6b-612c10ababa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '883489b813654953bffd6168ec8ab9d6'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:33.371843 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-51262d4f-545b-4a1c-ac6b-612c10ababa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '883489b813654953bffd6168ec8ab9d6'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:33.411209 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-51262d4f-545b-4a1c-ac6b-612c10ababa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '883489b813654953bffd6168ec8ab9d6'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:33.413097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-51262d4f-545b-4a1c-ac6b-612c10ababa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '883489b813654953bffd6168ec8ab9d6'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:33.429997 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1214/2426] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:00:32 2022] DELETE /identity/v3/users/883489b813654953bffd6168ec8ab9d6 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:00:33.435574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549503e-533a-4f82-85f8-367ff7d842f9 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:33.436905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549503e-533a-4f82-85f8-367ff7d842f9 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:33.436905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549503e-533a-4f82-85f8-367ff7d842f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:33.459422 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-8549503e-533a-4f82-85f8-367ff7d842f9 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:33.460790 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-8549503e-533a-4f82-85f8-367ff7d842f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:33.550863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1213/2427] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:00:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:33.567606 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51262d4f-545b-4a1c-ac6b-612c10ababa0 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:33.572631 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-51262d4f-545b-4a1c-ac6b-612c10ababa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:33.663379 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51262d4f-545b-4a1c-ac6b-612c10ababa0 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:33.667412 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67882bff-b5f0-4216-805e-f9176e413bef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:33.668274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67882bff-b5f0-4216-805e-f9176e413bef service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:33.668559 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67882bff-b5f0-4216-805e-f9176e413bef service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:33.668836 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67882bff-b5f0-4216-805e-f9176e413bef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:33.684424 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67882bff-b5f0-4216-805e-f9176e413bef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:33.686782 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67882bff-b5f0-4216-805e-f9176e413bef service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:33.704967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1215/2428] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:00:34.345686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549503e-533a-4f82-85f8-367ff7d842f9 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:34.347808 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-8549503e-533a-4f82-85f8-367ff7d842f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:34.367196 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549503e-533a-4f82-85f8-367ff7d842f9 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:34.375320 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449dedd-8165-452a-b1c3-b4c5874399cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:34.379127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449dedd-8165-452a-b1c3-b4c5874399cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:34.379127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449dedd-8165-452a-b1c3-b4c5874399cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:34.379127 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449dedd-8165-452a-b1c3-b4c5874399cf admin admin] PATH_INFO: `/v3/projects/9881f7ef77694d5087183d5f4825a5fb` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:34.379802 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449dedd-8165-452a-b1c3-b4c5874399cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9881f7ef77694d5087183d5f4825a5fb)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:34.383762 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449dedd-8165-452a-b1c3-b4c5874399cf admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:34.573917 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:34.578129 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-9449dedd-8165-452a-b1c3-b4c5874399cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9881f7ef77694d5087183d5f4825a5fb', 'request_id': 'req-9449dedd-8165-452a-b1c3-b4c5874399cf'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:34.586074 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-9449dedd-8165-452a-b1c3-b4c5874399cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9881f7ef77694d5087183d5f4825a5fb', 'request_id': 'req-9449dedd-8165-452a-b1c3-b4c5874399cf'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:34.595886 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-9449dedd-8165-452a-b1c3-b4c5874399cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9881f7ef77694d5087183d5f4825a5fb', 'request_id': 'req-9449dedd-8165-452a-b1c3-b4c5874399cf'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:34.685254 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-9449dedd-8165-452a-b1c3-b4c5874399cf admin admin] The token cache is being invalidate because project 9881f7ef77694d5087183d5f4825a5fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:00:34.685548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-9449dedd-8165-452a-b1c3-b4c5874399cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:34.686915 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-9449dedd-8165-452a-b1c3-b4c5874399cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:34.688837 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1214/2429] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:00:34 2022] DELETE /identity/v3/projects/9881f7ef77694d5087183d5f4825a5fb => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:00:35.979463 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67882bff-b5f0-4216-805e-f9176e413bef service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:35.981982 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-67882bff-b5f0-4216-805e-f9176e413bef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:36.005410 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67882bff-b5f0-4216-805e-f9176e413bef service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:36.109729 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d7b6a-b97c-4dae-a27d-e4eb412cd59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:36.110495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d7b6a-b97c-4dae-a27d-e4eb412cd59a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:36.110926 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d7b6a-b97c-4dae-a27d-e4eb412cd59a admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:36.111336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d7b6a-b97c-4dae-a27d-e4eb412cd59a admin admin] PATH_INFO: `/v3/users/5a441adf6eee4ba78992aafbbf02f1c8` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:36.112977 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d7b6a-b97c-4dae-a27d-e4eb412cd59a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a441adf6eee4ba78992aafbbf02f1c8)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:36.115257 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d7b6a-b97c-4dae-a27d-e4eb412cd59a admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:36.119218 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:36.372294 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-661d7b6a-b97c-4dae-a27d-e4eb412cd59a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a441adf6eee4ba78992aafbbf02f1c8'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:36.478232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-661d7b6a-b97c-4dae-a27d-e4eb412cd59a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a441adf6eee4ba78992aafbbf02f1c8'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:36.494171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-661d7b6a-b97c-4dae-a27d-e4eb412cd59a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a441adf6eee4ba78992aafbbf02f1c8'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:36.514096 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-661d7b6a-b97c-4dae-a27d-e4eb412cd59a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a441adf6eee4ba78992aafbbf02f1c8'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:36.515567 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-661d7b6a-b97c-4dae-a27d-e4eb412cd59a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a441adf6eee4ba78992aafbbf02f1c8'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:36.522843 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1216/2430] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:00:35 2022] DELETE /identity/v3/users/5a441adf6eee4ba78992aafbbf02f1c8 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:00:36.786962 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51cfa2-4b24-4aef-8575-0dda859f1c23 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:36.787696 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51cfa2-4b24-4aef-8575-0dda859f1c23 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:36.787696 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51cfa2-4b24-4aef-8575-0dda859f1c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:36.819716 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-cd51cfa2-4b24-4aef-8575-0dda859f1c23 None None] MFA Rules not processed for user `658108c26fb74eba911e249819f8b290`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:36.821876 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-cd51cfa2-4b24-4aef-8575-0dda859f1c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:36.865969 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d7b6a-b97c-4dae-a27d-e4eb412cd59a admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:36.868530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-661d7b6a-b97c-4dae-a27d-e4eb412cd59a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:36.933054 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1215/2431] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:00:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:36.965172 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d7b6a-b97c-4dae-a27d-e4eb412cd59a admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:36.970847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dca4fb-ea05-4cc2-93f1-a8de04efa90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:36.971563 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dca4fb-ea05-4cc2-93f1-a8de04efa90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:36.971842 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dca4fb-ea05-4cc2-93f1-a8de04efa90f admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:36.972204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dca4fb-ea05-4cc2-93f1-a8de04efa90f admin admin] PATH_INFO: `/v3/projects/2c45ef65901048fe8966f332a04fb6c9` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:36.973481 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dca4fb-ea05-4cc2-93f1-a8de04efa90f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c45ef65901048fe8966f332a04fb6c9)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:36.975475 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dca4fb-ea05-4cc2-93f1-a8de04efa90f admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:37.106437 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-f0dca4fb-ea05-4cc2-93f1-a8de04efa90f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c45ef65901048fe8966f332a04fb6c9', 'request_id': 'req-f0dca4fb-ea05-4cc2-93f1-a8de04efa90f'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:37.114734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-f0dca4fb-ea05-4cc2-93f1-a8de04efa90f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c45ef65901048fe8966f332a04fb6c9', 'request_id': 'req-f0dca4fb-ea05-4cc2-93f1-a8de04efa90f'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:37.198495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-f0dca4fb-ea05-4cc2-93f1-a8de04efa90f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c45ef65901048fe8966f332a04fb6c9', 'request_id': 'req-f0dca4fb-ea05-4cc2-93f1-a8de04efa90f'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:37.219970 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-f0dca4fb-ea05-4cc2-93f1-a8de04efa90f admin admin] The token cache is being invalidate because project 2c45ef65901048fe8966f332a04fb6c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:00:37.220434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-f0dca4fb-ea05-4cc2-93f1-a8de04efa90f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:37.221260 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-f0dca4fb-ea05-4cc2-93f1-a8de04efa90f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:37.223266 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1217/2432] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:00:36 2022] DELETE /identity/v3/projects/2c45ef65901048fe8966f332a04fb6c9 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:00:37.229787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a5b49-afb7-44c1-91fc-bc2931d84a8a None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:37.230066 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a5b49-afb7-44c1-91fc-bc2931d84a8a None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:37.230340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a5b49-afb7-44c1-91fc-bc2931d84a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:37.253485 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-e39a5b49-afb7-44c1-91fc-bc2931d84a8a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:37.254839 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-e39a5b49-afb7-44c1-91fc-bc2931d84a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:37.341384 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1216/2433] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:37.350753 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b857a4e-873e-46ed-a3c2-041eddb2a83c None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:37.351227 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b857a4e-873e-46ed-a3c2-041eddb2a83c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:37.351694 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b857a4e-873e-46ed-a3c2-041eddb2a83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:37.386601 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-6b857a4e-873e-46ed-a3c2-041eddb2a83c None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:37.388509 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-6b857a4e-873e-46ed-a3c2-041eddb2a83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:37.401646 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1218/2434] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:00:37.408672 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a5b49-afb7-44c1-91fc-bc2931d84a8a None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:37.426063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a5b49-afb7-44c1-91fc-bc2931d84a8a None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:37.432502 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb3fd3-7388-4e9a-a683-aa1054a16d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:37.433542 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb3fd3-7388-4e9a-a683-aa1054a16d10 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:37.434032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb3fd3-7388-4e9a-a683-aa1054a16d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:37.434509 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb3fd3-7388-4e9a-a683-aa1054a16d10 admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:37.435728 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb3fd3-7388-4e9a-a683-aa1054a16d10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:00:37.436848 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb3fd3-7388-4e9a-a683-aa1054a16d10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:37.439091 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb3fd3-7388-4e9a-a683-aa1054a16d10 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:37.460462 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1217/2435] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 14:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:00:37.464697 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b857a4e-873e-46ed-a3c2-041eddb2a83c None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:37.472621 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:37.477913 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b857a4e-873e-46ed-a3c2-041eddb2a83c None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:37.484649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea468d0-b02d-4e53-aa5d-353eb4c73ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:37.485290 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea468d0-b02d-4e53-aa5d-353eb4c73ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:37.485568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea468d0-b02d-4e53-aa5d-353eb4c73ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:37.485839 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea468d0-b02d-4e53-aa5d-353eb4c73ac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:37.486510 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea468d0-b02d-4e53-aa5d-353eb4c73ac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:37.488518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea468d0-b02d-4e53-aa5d-353eb4c73ac7 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:37.611684 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1219/2436] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:00:37 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:00:37.620536 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb3fd3-7388-4e9a-a683-aa1054a16d10 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:37.634697 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb3fd3-7388-4e9a-a683-aa1054a16d10 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:37.725004 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdd62e-6f64-480e-a8e0-f63839f46a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:37.725816 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdd62e-6f64-480e-a8e0-f63839f46a31 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:37.726223 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdd62e-6f64-480e-a8e0-f63839f46a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:37.726644 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdd62e-6f64-480e-a8e0-f63839f46a31 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:37.727880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbdd62e-6f64-480e-a8e0-f63839f46a31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:37.731716 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbdd62e-6f64-480e-a8e0-f63839f46a31 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:37.749364 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:37.868675 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1218/2437] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:00:37 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:00:37.874115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea468d0-b02d-4e53-aa5d-353eb4c73ac7 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:37.898019 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea468d0-b02d-4e53-aa5d-353eb4c73ac7 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:37.914098 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f1975-162e-4dc7-b483-cbae1cd2bbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:37.915145 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f1975-162e-4dc7-b483-cbae1cd2bbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:37.915879 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f1975-162e-4dc7-b483-cbae1cd2bbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:37.916173 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f1975-162e-4dc7-b483-cbae1cd2bbf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:37.917446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f1975-162e-4dc7-b483-cbae1cd2bbf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:37.922245 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f1975-162e-4dc7-b483-cbae1cd2bbf3 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:37.948273 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1220/2438] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:00:37.948802 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdd62e-6f64-480e-a8e0-f63839f46a31 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:37.970138 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdd62e-6f64-480e-a8e0-f63839f46a31 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:37.978258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2027c4f-f908-4579-833a-65053f5fe701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:37.979190 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2027c4f-f908-4579-833a-65053f5fe701 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:37.980039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2027c4f-f908-4579-833a-65053f5fe701 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:37.980739 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2027c4f-f908-4579-833a-65053f5fe701 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:37.981889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2027c4f-f908-4579-833a-65053f5fe701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:37.985683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2027c4f-f908-4579-833a-65053f5fe701 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:38.007818 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1219/2439] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:00:38.014698 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f1975-162e-4dc7-b483-cbae1cd2bbf3 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:38.025604 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f1975-162e-4dc7-b483-cbae1cd2bbf3 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:38.033087 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a77071-cd51-433c-88b0-f09f49479708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:38.033776 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a77071-cd51-433c-88b0-f09f49479708 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:38.034056 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a77071-cd51-433c-88b0-f09f49479708 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:38.034331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a77071-cd51-433c-88b0-f09f49479708 admin admin] PATH_INFO: `/v3/projects/b233c06742c3483080047c0bd9abea34/users/db73be5adb2d4ab8a003f55b56475e9a/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:38.053392 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a77071-cd51-433c-88b0-f09f49479708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b233c06742c3483080047c0bd9abea34, user_id=db73be5adb2d4ab8a003f55b56475e9a, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:38.056249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a77071-cd51-433c-88b0-f09f49479708 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:38.144158 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1221/2440] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:00:38 2022] PUT /identity/v3/projects/b233c06742c3483080047c0bd9abea34/users/db73be5adb2d4ab8a003f55b56475e9a/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:00:38.162925 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1db264-6fe8-4f75-94c0-45462848cbe1 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:38.163396 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1db264-6fe8-4f75-94c0-45462848cbe1 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:38.163814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1db264-6fe8-4f75-94c0-45462848cbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:38.199096 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-ce1db264-6fe8-4f75-94c0-45462848cbe1 None None] MFA Rules not processed for user `db73be5adb2d4ab8a003f55b56475e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:38.200504 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-ce1db264-6fe8-4f75-94c0-45462848cbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:38.288424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1220/2441] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:00:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:38.303907 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a77071-cd51-433c-88b0-f09f49479708 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:38.305988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b0a77071-cd51-433c-88b0-f09f49479708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:38.427234 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a77071-cd51-433c-88b0-f09f49479708 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:38.437239 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1ffee-14c0-42ce-8e63-eeeb00f5a17d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:38.438345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1ffee-14c0-42ce-8e63-eeeb00f5a17d service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:38.438816 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1ffee-14c0-42ce-8e63-eeeb00f5a17d service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:38.439202 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1ffee-14c0-42ce-8e63-eeeb00f5a17d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:38.448945 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1ffee-14c0-42ce-8e63-eeeb00f5a17d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:38.450649 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1ffee-14c0-42ce-8e63-eeeb00f5a17d service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:38.461050 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1222/2442] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:00:47.568812 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1db264-6fe8-4f75-94c0-45462848cbe1 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:47.660530 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1db264-6fe8-4f75-94c0-45462848cbe1 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:47.666345 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224a1d7-952c-4f08-b6aa-f58141c19677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:47.667236 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224a1d7-952c-4f08-b6aa-f58141c19677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:47.667697 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224a1d7-952c-4f08-b6aa-f58141c19677 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:47.668137 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224a1d7-952c-4f08-b6aa-f58141c19677 admin admin] PATH_INFO: `/v3/users/db73be5adb2d4ab8a003f55b56475e9a` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:47.669867 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8224a1d7-952c-4f08-b6aa-f58141c19677 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db73be5adb2d4ab8a003f55b56475e9a)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:47.672218 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8224a1d7-952c-4f08-b6aa-f58141c19677 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:47.954805 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-8224a1d7-952c-4f08-b6aa-f58141c19677 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db73be5adb2d4ab8a003f55b56475e9a'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:47.955594 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-8224a1d7-952c-4f08-b6aa-f58141c19677 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db73be5adb2d4ab8a003f55b56475e9a'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:47.971469 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-8224a1d7-952c-4f08-b6aa-f58141c19677 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db73be5adb2d4ab8a003f55b56475e9a'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:47.980529 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-8224a1d7-952c-4f08-b6aa-f58141c19677 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db73be5adb2d4ab8a003f55b56475e9a'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:47.984355 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:48.072074 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-8224a1d7-952c-4f08-b6aa-f58141c19677 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db73be5adb2d4ab8a003f55b56475e9a'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:48.081488 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1221/2443] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:00:47 2022] DELETE /identity/v3/users/db73be5adb2d4ab8a003f55b56475e9a => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:00:48.083960 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f6660-7ca1-499a-ad30-8fa129a71c06 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:48.084740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f6660-7ca1-499a-ad30-8fa129a71c06 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:48.084740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f6660-7ca1-499a-ad30-8fa129a71c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:48.106385 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-445f6660-7ca1-499a-ad30-8fa129a71c06 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:48.108264 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-445f6660-7ca1-499a-ad30-8fa129a71c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:48.179985 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1223/2444] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:00:48.192043 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224a1d7-952c-4f08-b6aa-f58141c19677 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:48.193579 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-8224a1d7-952c-4f08-b6aa-f58141c19677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:48.260699 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224a1d7-952c-4f08-b6aa-f58141c19677 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:48.264461 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6facf45a-b81e-4fb4-8d23-2b7c590667af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:48.265146 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facf45a-b81e-4fb4-8d23-2b7c590667af service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:48.265436 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facf45a-b81e-4fb4-8d23-2b7c590667af service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:48.265707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6facf45a-b81e-4fb4-8d23-2b7c590667af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:48.276067 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6facf45a-b81e-4fb4-8d23-2b7c590667af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:48.277566 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6facf45a-b81e-4fb4-8d23-2b7c590667af service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:48.289478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1222/2445] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:00:48.969073 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f6660-7ca1-499a-ad30-8fa129a71c06 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:48.971750 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-445f6660-7ca1-499a-ad30-8fa129a71c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:48.987900 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f6660-7ca1-499a-ad30-8fa129a71c06 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:48.993377 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba76b7-5466-4042-a5c4-f68db6beaa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:48.994188 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba76b7-5466-4042-a5c4-f68db6beaa26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:48.994689 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba76b7-5466-4042-a5c4-f68db6beaa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:48.995063 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba76b7-5466-4042-a5c4-f68db6beaa26 admin admin] PATH_INFO: `/v3/projects/b233c06742c3483080047c0bd9abea34` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:48.997745 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba76b7-5466-4042-a5c4-f68db6beaa26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b233c06742c3483080047c0bd9abea34)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:49.002498 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba76b7-5466-4042-a5c4-f68db6beaa26 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:49.183905 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:49.220578 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-5dba76b7-5466-4042-a5c4-f68db6beaa26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b233c06742c3483080047c0bd9abea34', 'request_id': 'req-5dba76b7-5466-4042-a5c4-f68db6beaa26'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:49.228937 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-5dba76b7-5466-4042-a5c4-f68db6beaa26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b233c06742c3483080047c0bd9abea34', 'request_id': 'req-5dba76b7-5466-4042-a5c4-f68db6beaa26'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:49.313281 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-5dba76b7-5466-4042-a5c4-f68db6beaa26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b233c06742c3483080047c0bd9abea34', 'request_id': 'req-5dba76b7-5466-4042-a5c4-f68db6beaa26'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:49.327760 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-5dba76b7-5466-4042-a5c4-f68db6beaa26 admin admin] The token cache is being invalidate because project b233c06742c3483080047c0bd9abea34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:00:49.328271 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-5dba76b7-5466-4042-a5c4-f68db6beaa26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:49.329397 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-5dba76b7-5466-4042-a5c4-f68db6beaa26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:49.331139 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1224/2446] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:00:48 2022] DELETE /identity/v3/projects/b233c06742c3483080047c0bd9abea34 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:00:49.336782 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d27a8-71ff-4578-a708-e3b444057e2e None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:49.337359 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d27a8-71ff-4578-a708-e3b444057e2e None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:49.337628 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d27a8-71ff-4578-a708-e3b444057e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:49.361383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-264d27a8-71ff-4578-a708-e3b444057e2e None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:49.362656 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-264d27a8-71ff-4578-a708-e3b444057e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:49.440866 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1223/2447] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:00:49.454265 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2119776-b53f-4149-9ea6-69b73162f015 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:49.454762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2119776-b53f-4149-9ea6-69b73162f015 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:49.455246 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2119776-b53f-4149-9ea6-69b73162f015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:49.477720 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-c2119776-b53f-4149-9ea6-69b73162f015 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:49.479271 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c2119776-b53f-4149-9ea6-69b73162f015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:49.489134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1225/2448] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:49.494010 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d27a8-71ff-4578-a708-e3b444057e2e None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:49.505761 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d27a8-71ff-4578-a708-e3b444057e2e None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:49.510756 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92465c32-327b-47d4-99c6-7037c3e4b92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:49.511457 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92465c32-327b-47d4-99c6-7037c3e4b92c admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:49.511767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92465c32-327b-47d4-99c6-7037c3e4b92c admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:49.512048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92465c32-327b-47d4-99c6-7037c3e4b92c admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:49.512735 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92465c32-327b-47d4-99c6-7037c3e4b92c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:00:49.513044 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92465c32-327b-47d4-99c6-7037c3e4b92c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:49.514736 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92465c32-327b-47d4-99c6-7037c3e4b92c admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:49.528776 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1224/2449] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 14:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:00:49.533776 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2119776-b53f-4149-9ea6-69b73162f015 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:49.544699 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2119776-b53f-4149-9ea6-69b73162f015 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:49.551093 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a3e68-1410-4f13-b767-7dcf12dc73c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:49.561700 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a3e68-1410-4f13-b767-7dcf12dc73c7 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:49.561700 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a3e68-1410-4f13-b767-7dcf12dc73c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:49.561700 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a3e68-1410-4f13-b767-7dcf12dc73c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:49.561700 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a3e68-1410-4f13-b767-7dcf12dc73c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:49.561700 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a3e68-1410-4f13-b767-7dcf12dc73c7 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:49.675387 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1226/2450] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:00:49 2022] POST /identity/v3/projects => generated 365 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:00:49.682007 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92465c32-327b-47d4-99c6-7037c3e4b92c admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:49.693389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92465c32-327b-47d4-99c6-7037c3e4b92c admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:49.772681 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e675fa-943d-476e-bb27-aea4621f5589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:49.773450 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e675fa-943d-476e-bb27-aea4621f5589 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:49.773913 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e675fa-943d-476e-bb27-aea4621f5589 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:49.774293 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e675fa-943d-476e-bb27-aea4621f5589 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:49.775123 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e675fa-943d-476e-bb27-aea4621f5589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:49.777458 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e675fa-943d-476e-bb27-aea4621f5589 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:49.899878 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1225/2451] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:00:49 2022] POST /identity/v3/users => generated 283 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:00:49.905244 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a3e68-1410-4f13-b767-7dcf12dc73c7 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:49.917873 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a3e68-1410-4f13-b767-7dcf12dc73c7 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:49.923502 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27564346-f20b-4d7f-9c19-a0a987d76f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:49.924142 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27564346-f20b-4d7f-9c19-a0a987d76f8f admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:49.924482 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27564346-f20b-4d7f-9c19-a0a987d76f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:49.924768 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27564346-f20b-4d7f-9c19-a0a987d76f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:49.925629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27564346-f20b-4d7f-9c19-a0a987d76f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:49.927323 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27564346-f20b-4d7f-9c19-a0a987d76f8f admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:49.939178 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1227/2452] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:00:49.951448 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e675fa-943d-476e-bb27-aea4621f5589 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:49.964878 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e675fa-943d-476e-bb27-aea4621f5589 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:49.973571 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a7b1b-77b9-46e4-a690-3a60816e7ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:49.974667 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a7b1b-77b9-46e4-a690-3a60816e7ebc admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:49.975162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a7b1b-77b9-46e4-a690-3a60816e7ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:49.975696 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a7b1b-77b9-46e4-a690-3a60816e7ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:49.976929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a7b1b-77b9-46e4-a690-3a60816e7ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:49.980097 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a7b1b-77b9-46e4-a690-3a60816e7ebc admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:50.003701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1226/2453] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:00:50.009162 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27564346-f20b-4d7f-9c19-a0a987d76f8f admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:50.020957 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27564346-f20b-4d7f-9c19-a0a987d76f8f admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:50.026509 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30f232-f044-479d-8954-53fa36fd9a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:50.027328 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30f232-f044-479d-8954-53fa36fd9a34 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:50.027729 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30f232-f044-479d-8954-53fa36fd9a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:50.028196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30f232-f044-479d-8954-53fa36fd9a34 admin admin] PATH_INFO: `/v3/projects/f8b580b093e74dc880bc028bb5b0c29a/users/d023deed9a55436b8944f26234a390e5/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:50.047912 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30f232-f044-479d-8954-53fa36fd9a34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8b580b093e74dc880bc028bb5b0c29a, user_id=d023deed9a55436b8944f26234a390e5, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:50.050895 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30f232-f044-479d-8954-53fa36fd9a34 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:50.130846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1228/2454] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:00:50 2022] PUT /identity/v3/projects/f8b580b093e74dc880bc028bb5b0c29a/users/d023deed9a55436b8944f26234a390e5/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:00:50.151622 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b835fe-4eff-43de-9371-f813d0316d17 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:50.152139 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b835fe-4eff-43de-9371-f813d0316d17 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:50.152676 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b835fe-4eff-43de-9371-f813d0316d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:50.164982 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:50.190219 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-25b835fe-4eff-43de-9371-f813d0316d17 None None] MFA Rules not processed for user `d023deed9a55436b8944f26234a390e5`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:50.191536 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-25b835fe-4eff-43de-9371-f813d0316d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:50.295940 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1227/2455] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:00:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:50.297381 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30f232-f044-479d-8954-53fa36fd9a34 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:50.403692 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30f232-f044-479d-8954-53fa36fd9a34 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:50.411197 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d716ab-a99d-4a6a-9319-ac747b3b19d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:50.412402 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d716ab-a99d-4a6a-9319-ac747b3b19d0 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:50.412889 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d716ab-a99d-4a6a-9319-ac747b3b19d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:50.413365 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d716ab-a99d-4a6a-9319-ac747b3b19d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:50.414212 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d716ab-a99d-4a6a-9319-ac747b3b19d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:50.416638 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d716ab-a99d-4a6a-9319-ac747b3b19d0 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:50.578986 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1229/2456] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:00:50 2022] POST /identity/v3/projects => generated 365 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:00:50.583683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b835fe-4eff-43de-9371-f813d0316d17 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:50.596630 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b835fe-4eff-43de-9371-f813d0316d17 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:50.664182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab88170-dd00-4fa0-8f58-69d3e76f1ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:50.665265 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab88170-dd00-4fa0-8f58-69d3e76f1ecd admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:50.665655 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab88170-dd00-4fa0-8f58-69d3e76f1ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:50.666023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab88170-dd00-4fa0-8f58-69d3e76f1ecd admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:50.666786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab88170-dd00-4fa0-8f58-69d3e76f1ecd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:50.669117 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab88170-dd00-4fa0-8f58-69d3e76f1ecd admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:50.742524 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1228/2457] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:00:50 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:00:50.748995 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d716ab-a99d-4a6a-9319-ac747b3b19d0 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:50.761331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d716ab-a99d-4a6a-9319-ac747b3b19d0 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:50.767024 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a976dd2-35e0-47fd-bf7b-105bd0f7f6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:50.767838 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a976dd2-35e0-47fd-bf7b-105bd0f7f6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:50.768117 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a976dd2-35e0-47fd-bf7b-105bd0f7f6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:50.768387 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a976dd2-35e0-47fd-bf7b-105bd0f7f6e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:50.769049 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a976dd2-35e0-47fd-bf7b-105bd0f7f6e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:50.770681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a976dd2-35e0-47fd-bf7b-105bd0f7f6e6 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:50.783271 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1230/2458] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:00:50.787999 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab88170-dd00-4fa0-8f58-69d3e76f1ecd admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:50.799576 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab88170-dd00-4fa0-8f58-69d3e76f1ecd admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:50.804872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13e47c-f6e9-407e-a3ba-86e2268f7845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:50.805561 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13e47c-f6e9-407e-a3ba-86e2268f7845 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:50.805879 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13e47c-f6e9-407e-a3ba-86e2268f7845 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:50.806156 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13e47c-f6e9-407e-a3ba-86e2268f7845 admin admin] PATH_INFO: `/v3/projects/8765bb110094419088b07bf57e9cd2da/users/33b49e2f53db41cf839ad9351ba785f2/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:50.826823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13e47c-f6e9-407e-a3ba-86e2268f7845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8765bb110094419088b07bf57e9cd2da, user_id=33b49e2f53db41cf839ad9351ba785f2, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:50.830631 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13e47c-f6e9-407e-a3ba-86e2268f7845 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:50.913326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1229/2459] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:00:50 2022] PUT /identity/v3/projects/8765bb110094419088b07bf57e9cd2da/users/33b49e2f53db41cf839ad9351ba785f2/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:00:50.920795 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a976dd2-35e0-47fd-bf7b-105bd0f7f6e6 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:50.940660 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a976dd2-35e0-47fd-bf7b-105bd0f7f6e6 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:50.987661 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:51.038344 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eace6f7-24e3-4a79-8be1-71649a8d16ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:51.038677 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eace6f7-24e3-4a79-8be1-71649a8d16ec admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:51.039056 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eace6f7-24e3-4a79-8be1-71649a8d16ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:51.039241 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eace6f7-24e3-4a79-8be1-71649a8d16ec admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:51.039969 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eace6f7-24e3-4a79-8be1-71649a8d16ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:51.041806 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eace6f7-24e3-4a79-8be1-71649a8d16ec admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:51.053816 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1231/2460] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:00:51.061482 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13e47c-f6e9-407e-a3ba-86e2268f7845 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:51.081018 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13e47c-f6e9-407e-a3ba-86e2268f7845 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:51.089533 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fca83-1091-4c65-90f5-6e51fea74800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:51.090677 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fca83-1091-4c65-90f5-6e51fea74800 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:51.091233 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fca83-1091-4c65-90f5-6e51fea74800 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:51.091781 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fca83-1091-4c65-90f5-6e51fea74800 admin admin] PATH_INFO: `/v3/projects/8765bb110094419088b07bf57e9cd2da/users/33b49e2f53db41cf839ad9351ba785f2/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:51.095653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13fca83-1091-4c65-90f5-6e51fea74800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8765bb110094419088b07bf57e9cd2da, user_id=33b49e2f53db41cf839ad9351ba785f2, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:51.101235 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13fca83-1091-4c65-90f5-6e51fea74800 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:51.122280 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1230/2461] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:00:51 2022] PUT /identity/v3/projects/8765bb110094419088b07bf57e9cd2da/users/33b49e2f53db41cf839ad9351ba785f2/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:00:51.141299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78798f-1357-4836-a223-406475afef66 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:51.141594 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78798f-1357-4836-a223-406475afef66 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:51.141840 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78798f-1357-4836-a223-406475afef66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:51.174684 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-ea78798f-1357-4836-a223-406475afef66 None None] MFA Rules not processed for user `33b49e2f53db41cf839ad9351ba785f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:51.176080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ea78798f-1357-4836-a223-406475afef66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:51.261075 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1232/2462] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:00:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:51.275043 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fca83-1091-4c65-90f5-6e51fea74800 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:51.277262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a13fca83-1091-4c65-90f5-6e51fea74800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:51.341095 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:51.349162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fca83-1091-4c65-90f5-6e51fea74800 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:51.353845 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1e8b6-f5d6-44aa-a665-3a7730344b95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:51.354939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1e8b6-f5d6-44aa-a665-3a7730344b95 service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:51.355472 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1e8b6-f5d6-44aa-a665-3a7730344b95 service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:51.355934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1e8b6-f5d6-44aa-a665-3a7730344b95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:51.373535 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1e8b6-f5d6-44aa-a665-3a7730344b95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:51.375623 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1e8b6-f5d6-44aa-a665-3a7730344b95 service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:51.388048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1231/2463] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:51 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:00:52.659509 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78798f-1357-4836-a223-406475afef66 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:52.753778 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78798f-1357-4836-a223-406475afef66 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:52.761232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa708ce6-46d5-49d8-862d-56943378b504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:52.762330 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa708ce6-46d5-49d8-862d-56943378b504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:52.762820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa708ce6-46d5-49d8-862d-56943378b504 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:52.763268 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa708ce6-46d5-49d8-862d-56943378b504 admin admin] PATH_INFO: `/v3/users/d023deed9a55436b8944f26234a390e5` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:52.765430 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa708ce6-46d5-49d8-862d-56943378b504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d023deed9a55436b8944f26234a390e5)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:52.769328 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa708ce6-46d5-49d8-862d-56943378b504 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:52.976590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-aa708ce6-46d5-49d8-862d-56943378b504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd023deed9a55436b8944f26234a390e5'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:52.980585 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:53.050331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-aa708ce6-46d5-49d8-862d-56943378b504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd023deed9a55436b8944f26234a390e5'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:53.059838 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-aa708ce6-46d5-49d8-862d-56943378b504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd023deed9a55436b8944f26234a390e5'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:53.074414 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-aa708ce6-46d5-49d8-862d-56943378b504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd023deed9a55436b8944f26234a390e5'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:53.075443 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-aa708ce6-46d5-49d8-862d-56943378b504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd023deed9a55436b8944f26234a390e5'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:53.084136 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1233/2464] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:00:52 2022] DELETE /identity/v3/users/d023deed9a55436b8944f26234a390e5 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:00:53.092641 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d5e40-6bea-4148-9840-c2d7c7a6877e None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:53.093300 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d5e40-6bea-4148-9840-c2d7c7a6877e None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:53.093662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d5e40-6bea-4148-9840-c2d7c7a6877e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:53.128139 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-336d5e40-6bea-4148-9840-c2d7c7a6877e None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:53.130193 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-336d5e40-6bea-4148-9840-c2d7c7a6877e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:53.243178 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1232/2465] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:53.255801 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa708ce6-46d5-49d8-862d-56943378b504 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:53.257654 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-aa708ce6-46d5-49d8-862d-56943378b504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:53.366528 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa708ce6-46d5-49d8-862d-56943378b504 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:53.376106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7936ce8-3e4f-46ed-8329-103cfae557e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:53.378132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7936ce8-3e4f-46ed-8329-103cfae557e8 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:53.378350 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7936ce8-3e4f-46ed-8329-103cfae557e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:53.378816 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7936ce8-3e4f-46ed-8329-103cfae557e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:53.400141 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7936ce8-3e4f-46ed-8329-103cfae557e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:53.402485 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7936ce8-3e4f-46ed-8329-103cfae557e8 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:53.426753 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1234/2466] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:00:54.261051 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d5e40-6bea-4148-9840-c2d7c7a6877e None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:54.263497 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-336d5e40-6bea-4148-9840-c2d7c7a6877e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:54.286872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d5e40-6bea-4148-9840-c2d7c7a6877e None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:54.293399 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b298751-d057-45a6-b5d8-0134de6af4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:54.294262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b298751-d057-45a6-b5d8-0134de6af4ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:54.294696 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b298751-d057-45a6-b5d8-0134de6af4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:54.295896 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b298751-d057-45a6-b5d8-0134de6af4ee admin admin] PATH_INFO: `/v3/projects/f8b580b093e74dc880bc028bb5b0c29a` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:54.297464 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b298751-d057-45a6-b5d8-0134de6af4ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8b580b093e74dc880bc028bb5b0c29a)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:54.300297 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b298751-d057-45a6-b5d8-0134de6af4ee admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:54.485194 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-0b298751-d057-45a6-b5d8-0134de6af4ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8b580b093e74dc880bc028bb5b0c29a', 'request_id': 'req-0b298751-d057-45a6-b5d8-0134de6af4ee'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:54.495094 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-0b298751-d057-45a6-b5d8-0134de6af4ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8b580b093e74dc880bc028bb5b0c29a', 'request_id': 'req-0b298751-d057-45a6-b5d8-0134de6af4ee'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:54.505270 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-0b298751-d057-45a6-b5d8-0134de6af4ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8b580b093e74dc880bc028bb5b0c29a', 'request_id': 'req-0b298751-d057-45a6-b5d8-0134de6af4ee'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:54.580875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-0b298751-d057-45a6-b5d8-0134de6af4ee admin admin] The token cache is being invalidate because project f8b580b093e74dc880bc028bb5b0c29a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:00:54.581379 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-0b298751-d057-45a6-b5d8-0134de6af4ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:54.582564 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-0b298751-d057-45a6-b5d8-0134de6af4ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:54.585349 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1233/2467] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:00:54 2022] DELETE /identity/v3/projects/f8b580b093e74dc880bc028bb5b0c29a => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:00:54.591474 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7936ce8-3e4f-46ed-8329-103cfae557e8 service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:54.607400 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7936ce8-3e4f-46ed-8329-103cfae557e8 service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:54.704271 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6331f-789b-4702-a981-996220255e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:54.705592 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6331f-789b-4702-a981-996220255e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:54.711100 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6331f-789b-4702-a981-996220255e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:54.711100 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6331f-789b-4702-a981-996220255e14 admin admin] PATH_INFO: `/v3/users/33b49e2f53db41cf839ad9351ba785f2` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:54.711100 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6331f-789b-4702-a981-996220255e14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33b49e2f53db41cf839ad9351ba785f2)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:54.713251 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6331f-789b-4702-a981-996220255e14 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:54.992675 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-8de6331f-789b-4702-a981-996220255e14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33b49e2f53db41cf839ad9351ba785f2'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:55.072412 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-8de6331f-789b-4702-a981-996220255e14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33b49e2f53db41cf839ad9351ba785f2'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:55.083295 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-8de6331f-789b-4702-a981-996220255e14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33b49e2f53db41cf839ad9351ba785f2'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:55.096206 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:55.102454 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-8de6331f-789b-4702-a981-996220255e14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33b49e2f53db41cf839ad9351ba785f2'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:55.103293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-8de6331f-789b-4702-a981-996220255e14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33b49e2f53db41cf839ad9351ba785f2'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:55.111291 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1235/2468] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:00:54 2022] DELETE /identity/v3/users/33b49e2f53db41cf839ad9351ba785f2 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:00:55.581303 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b298751-d057-45a6-b5d8-0134de6af4ee admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:55.582951 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-0b298751-d057-45a6-b5d8-0134de6af4ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:55.598572 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b298751-d057-45a6-b5d8-0134de6af4ee admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:55.668488 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59308710-d312-4f89-b26e-74d78260678a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:55.669392 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59308710-d312-4f89-b26e-74d78260678a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:55.669771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59308710-d312-4f89-b26e-74d78260678a admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:55.670129 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59308710-d312-4f89-b26e-74d78260678a admin admin] PATH_INFO: `/v3/projects/8765bb110094419088b07bf57e9cd2da` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:55.672171 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59308710-d312-4f89-b26e-74d78260678a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8765bb110094419088b07bf57e9cd2da)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:55.675035 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59308710-d312-4f89-b26e-74d78260678a admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:55.692084 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:55.850992 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-59308710-d312-4f89-b26e-74d78260678a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8765bb110094419088b07bf57e9cd2da', 'request_id': 'req-59308710-d312-4f89-b26e-74d78260678a'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:55.857056 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-59308710-d312-4f89-b26e-74d78260678a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8765bb110094419088b07bf57e9cd2da', 'request_id': 'req-59308710-d312-4f89-b26e-74d78260678a'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:55.864145 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-59308710-d312-4f89-b26e-74d78260678a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8765bb110094419088b07bf57e9cd2da', 'request_id': 'req-59308710-d312-4f89-b26e-74d78260678a'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:55.950637 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-59308710-d312-4f89-b26e-74d78260678a admin admin] The token cache is being invalidate because project 8765bb110094419088b07bf57e9cd2da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:00:55.950893 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-59308710-d312-4f89-b26e-74d78260678a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:55.952365 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-59308710-d312-4f89-b26e-74d78260678a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:00:55.954135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1234/2469] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:00:55 2022] DELETE /identity/v3/projects/8765bb110094419088b07bf57e9cd2da => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:00:55.959615 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c1803-5329-4f4e-889b-eb71e11a3898 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:55.960152 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c1803-5329-4f4e-889b-eb71e11a3898 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:55.960249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c1803-5329-4f4e-889b-eb71e11a3898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:55.981852 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-0e0c1803-5329-4f4e-889b-eb71e11a3898 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:55.983186 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-0e0c1803-5329-4f4e-889b-eb71e11a3898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:56.050001 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1236/2470] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:00:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:56.058549 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a27cb4-c504-4a65-a864-df1551a028e6 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:56.058838 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a27cb4-c504-4a65-a864-df1551a028e6 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:56.059121 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a27cb4-c504-4a65-a864-df1551a028e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:56.080991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-16a27cb4-c504-4a65-a864-df1551a028e6 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:56.082245 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-16a27cb4-c504-4a65-a864-df1551a028e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:56.090645 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1235/2471] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:56.095176 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c1803-5329-4f4e-889b-eb71e11a3898 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:56.105817 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c1803-5329-4f4e-889b-eb71e11a3898 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:56.111685 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5c03c-de0a-4f24-bd1c-cfb872a94833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:56.112318 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5c03c-de0a-4f24-bd1c-cfb872a94833 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:56.112608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5c03c-de0a-4f24-bd1c-cfb872a94833 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:56.112885 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5c03c-de0a-4f24-bd1c-cfb872a94833 admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:56.113556 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5c03c-de0a-4f24-bd1c-cfb872a94833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:00:56.113864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5c03c-de0a-4f24-bd1c-cfb872a94833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:56.115558 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5c03c-de0a-4f24-bd1c-cfb872a94833 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:56.129809 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1237/2472] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 14:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:00:56.134928 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a27cb4-c504-4a65-a864-df1551a028e6 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:56.145319 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a27cb4-c504-4a65-a864-df1551a028e6 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:56.150950 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e0212-d0a9-46d1-b56f-ad16c0eabc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:56.151620 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e0212-d0a9-46d1-b56f-ad16c0eabc18 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:56.151905 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e0212-d0a9-46d1-b56f-ad16c0eabc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:56.152179 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e0212-d0a9-46d1-b56f-ad16c0eabc18 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:56.152827 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e0212-d0a9-46d1-b56f-ad16c0eabc18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:56.154845 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e0212-d0a9-46d1-b56f-ad16c0eabc18 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:56.257408 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1236/2473] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:00:56 2022] POST /identity/v3/projects => generated 363 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:00:56.262111 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5c03c-de0a-4f24-bd1c-cfb872a94833 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:56.272931 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5c03c-de0a-4f24-bd1c-cfb872a94833 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:56.353185 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23176db6-788d-4d27-b59a-23188f4120fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:56.353840 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23176db6-788d-4d27-b59a-23188f4120fe admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:56.354166 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23176db6-788d-4d27-b59a-23188f4120fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:56.354488 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23176db6-788d-4d27-b59a-23188f4120fe admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:56.355124 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23176db6-788d-4d27-b59a-23188f4120fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:56.357213 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23176db6-788d-4d27-b59a-23188f4120fe admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:56.456567 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1238/2474] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:00:56 2022] POST /identity/v3/users => generated 282 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:00:56.461289 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e0212-d0a9-46d1-b56f-ad16c0eabc18 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:56.474217 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e0212-d0a9-46d1-b56f-ad16c0eabc18 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:56.479921 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244da633-44ab-41c2-b2a7-b2da47f4bf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:56.482549 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244da633-44ab-41c2-b2a7-b2da47f4bf60 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:56.482549 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244da633-44ab-41c2-b2a7-b2da47f4bf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:56.482549 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244da633-44ab-41c2-b2a7-b2da47f4bf60 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:56.482549 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244da633-44ab-41c2-b2a7-b2da47f4bf60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:56.485143 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244da633-44ab-41c2-b2a7-b2da47f4bf60 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:56.497772 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1237/2475] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:00:56.502679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23176db6-788d-4d27-b59a-23188f4120fe admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:56.513947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23176db6-788d-4d27-b59a-23188f4120fe admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:56.519820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6079aeb-bab8-4570-af38-e123e3a36c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:56.520671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6079aeb-bab8-4570-af38-e123e3a36c82 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:56.521071 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6079aeb-bab8-4570-af38-e123e3a36c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:56.521443 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6079aeb-bab8-4570-af38-e123e3a36c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:56.522230 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6079aeb-bab8-4570-af38-e123e3a36c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:56.524224 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6079aeb-bab8-4570-af38-e123e3a36c82 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:56.536722 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1239/2476] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:00:56.541524 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244da633-44ab-41c2-b2a7-b2da47f4bf60 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:56.553688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244da633-44ab-41c2-b2a7-b2da47f4bf60 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:56.558734 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425575e-043e-4e35-a8da-3ae9de1f0315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:56.559590 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425575e-043e-4e35-a8da-3ae9de1f0315 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:56.559921 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425575e-043e-4e35-a8da-3ae9de1f0315 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:56.560237 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425575e-043e-4e35-a8da-3ae9de1f0315 admin admin] PATH_INFO: `/v3/projects/43d07561b8da4ef8a22390b2e728fad7/users/fa98d13285cc45d8b1f19ca0a164ad87/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:56.577029 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425575e-043e-4e35-a8da-3ae9de1f0315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43d07561b8da4ef8a22390b2e728fad7, user_id=fa98d13285cc45d8b1f19ca0a164ad87, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:56.579795 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425575e-043e-4e35-a8da-3ae9de1f0315 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:56.673960 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1238/2477] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:00:56 2022] PUT /identity/v3/projects/43d07561b8da4ef8a22390b2e728fad7/users/fa98d13285cc45d8b1f19ca0a164ad87/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:00:56.686149 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdde1e-c1c8-4b4c-9477-c7e0254043d2 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:56.686423 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdde1e-c1c8-4b4c-9477-c7e0254043d2 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:56.686682 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdde1e-c1c8-4b4c-9477-c7e0254043d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:56.719135 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-2dbdde1e-c1c8-4b4c-9477-c7e0254043d2 None None] MFA Rules not processed for user `fa98d13285cc45d8b1f19ca0a164ad87`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:56.720450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-2dbdde1e-c1c8-4b4c-9477-c7e0254043d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:56.773178 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:56.797587 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1240/2478] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:00:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:56.802894 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425575e-043e-4e35-a8da-3ae9de1f0315 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:56.882442 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425575e-043e-4e35-a8da-3ae9de1f0315 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:56.887669 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e093f6-c14e-4561-8b4e-7a8858a1df6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:56.888235 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e093f6-c14e-4561-8b4e-7a8858a1df6d admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:56.888508 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e093f6-c14e-4561-8b4e-7a8858a1df6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:56.889296 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e093f6-c14e-4561-8b4e-7a8858a1df6d admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:56.889957 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e093f6-c14e-4561-8b4e-7a8858a1df6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:56.892145 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e093f6-c14e-4561-8b4e-7a8858a1df6d admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:57.047257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1239/2479] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:00:56 2022] POST /identity/v3/projects => generated 365 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:00:57.051612 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdde1e-c1c8-4b4c-9477-c7e0254043d2 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:57.062918 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdde1e-c1c8-4b4c-9477-c7e0254043d2 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:57.135838 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33666b08-9ad1-425f-9c48-b37477a3e8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:57.136481 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33666b08-9ad1-425f-9c48-b37477a3e8d0 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:57.136749 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33666b08-9ad1-425f-9c48-b37477a3e8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:57.137024 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33666b08-9ad1-425f-9c48-b37477a3e8d0 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:57.137757 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33666b08-9ad1-425f-9c48-b37477a3e8d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:57.139770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33666b08-9ad1-425f-9c48-b37477a3e8d0 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:57.261803 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1241/2480] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:00:57 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:00:57.267300 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e093f6-c14e-4561-8b4e-7a8858a1df6d admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:57.278575 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e093f6-c14e-4561-8b4e-7a8858a1df6d admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:57.283965 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04813fe0-28d4-4a99-b724-8079f4a07bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:57.284593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04813fe0-28d4-4a99-b724-8079f4a07bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:57.284871 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04813fe0-28d4-4a99-b724-8079f4a07bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:57.285142 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04813fe0-28d4-4a99-b724-8079f4a07bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:57.285810 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04813fe0-28d4-4a99-b724-8079f4a07bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:57.287575 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04813fe0-28d4-4a99-b724-8079f4a07bb2 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:57.301270 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1240/2481] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:00:57.306323 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33666b08-9ad1-425f-9c48-b37477a3e8d0 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:57.319396 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33666b08-9ad1-425f-9c48-b37477a3e8d0 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:57.327730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdf9d0-0735-4ea7-a952-ad7d5da0a3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:57.328890 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdf9d0-0735-4ea7-a952-ad7d5da0a3a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:57.329361 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdf9d0-0735-4ea7-a952-ad7d5da0a3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:57.329842 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdf9d0-0735-4ea7-a952-ad7d5da0a3a7 admin admin] PATH_INFO: `/v3/projects/4742e46f4e3c4c00a76327c858f5c9df/users/4ec60267557f41ffa416022fc38a2c50/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:57.357531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdf9d0-0735-4ea7-a952-ad7d5da0a3a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4742e46f4e3c4c00a76327c858f5c9df, user_id=4ec60267557f41ffa416022fc38a2c50, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:57.361283 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdf9d0-0735-4ea7-a952-ad7d5da0a3a7 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:57.448806 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1242/2482] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:00:57 2022] PUT /identity/v3/projects/4742e46f4e3c4c00a76327c858f5c9df/users/4ec60267557f41ffa416022fc38a2c50/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:00:57.453377 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04813fe0-28d4-4a99-b724-8079f4a07bb2 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:57.465364 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04813fe0-28d4-4a99-b724-8079f4a07bb2 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:57.475562 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:57.532356 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56bfdf-0890-40b2-b6a0-9a32f007afb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:57.532998 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56bfdf-0890-40b2-b6a0-9a32f007afb6 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:57.533263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56bfdf-0890-40b2-b6a0-9a32f007afb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:57.533522 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56bfdf-0890-40b2-b6a0-9a32f007afb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:57.534181 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56bfdf-0890-40b2-b6a0-9a32f007afb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:57.535877 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56bfdf-0890-40b2-b6a0-9a32f007afb6 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:57.549195 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1241/2483] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:00:57.553218 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdf9d0-0735-4ea7-a952-ad7d5da0a3a7 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:57.566378 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdf9d0-0735-4ea7-a952-ad7d5da0a3a7 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:57.572003 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f9fa2-1881-4207-95e1-4cd4eb228dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:57.572876 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f9fa2-1881-4207-95e1-4cd4eb228dfb admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:57.573240 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f9fa2-1881-4207-95e1-4cd4eb228dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:57.573559 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f9fa2-1881-4207-95e1-4cd4eb228dfb admin admin] PATH_INFO: `/v3/projects/4742e46f4e3c4c00a76327c858f5c9df/users/4ec60267557f41ffa416022fc38a2c50/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:57.575918 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f9fa2-1881-4207-95e1-4cd4eb228dfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4742e46f4e3c4c00a76327c858f5c9df, user_id=4ec60267557f41ffa416022fc38a2c50, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:57.578978 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f9fa2-1881-4207-95e1-4cd4eb228dfb admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:57.591974 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1243/2484] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:00:57 2022] PUT /identity/v3/projects/4742e46f4e3c4c00a76327c858f5c9df/users/4ec60267557f41ffa416022fc38a2c50/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:00:57.606189 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b035cc6-eb80-41b9-8259-ef3e8b26c277 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:57.606655 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b035cc6-eb80-41b9-8259-ef3e8b26c277 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:57.607086 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b035cc6-eb80-41b9-8259-ef3e8b26c277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:57.643176 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-2b035cc6-eb80-41b9-8259-ef3e8b26c277 None None] MFA Rules not processed for user `4ec60267557f41ffa416022fc38a2c50`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:57.644636 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-2b035cc6-eb80-41b9-8259-ef3e8b26c277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:57.733826 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1242/2485] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:00:57 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:57.747731 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f9fa2-1881-4207-95e1-4cd4eb228dfb admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:57.749840 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-cb5f9fa2-1881-4207-95e1-4cd4eb228dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:57.818919 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f9fa2-1881-4207-95e1-4cd4eb228dfb admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:57.823048 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad20d1-46ce-4dfc-96b6-0a1a7925e2e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:57.823782 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad20d1-46ce-4dfc-96b6-0a1a7925e2e5 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:57.824108 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad20d1-46ce-4dfc-96b6-0a1a7925e2e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:57.824431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad20d1-46ce-4dfc-96b6-0a1a7925e2e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:57.835927 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad20d1-46ce-4dfc-96b6-0a1a7925e2e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:57.837853 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad20d1-46ce-4dfc-96b6-0a1a7925e2e5 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:57.851992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1244/2486] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:57 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:00:58.091637 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b035cc6-eb80-41b9-8259-ef3e8b26c277 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:58.103394 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b035cc6-eb80-41b9-8259-ef3e8b26c277 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:58.107154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c20903-2214-4f5b-ab6f-abca1986eecb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:58.107851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c20903-2214-4f5b-ab6f-abca1986eecb service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:58.108130 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c20903-2214-4f5b-ab6f-abca1986eecb service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:58.108399 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c20903-2214-4f5b-ab6f-abca1986eecb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:58.213939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c20903-2214-4f5b-ab6f-abca1986eecb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:58.217009 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c20903-2214-4f5b-ab6f-abca1986eecb service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:58.235022 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1243/2487] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:01:07.849553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=77,keystone:INSERT=5 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:08.226553 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=86 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:11.159320 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad20d1-46ce-4dfc-96b6-0a1a7925e2e5 service cinder] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:11.234921 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad20d1-46ce-4dfc-96b6-0a1a7925e2e5 service cinder] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:11.239941 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdde976-dda8-42e2-b7de-bb561dd8f4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:11.240616 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdde976-dda8-42e2-b7de-bb561dd8f4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:11.240898 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdde976-dda8-42e2-b7de-bb561dd8f4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:11.241173 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdde976-dda8-42e2-b7de-bb561dd8f4fd admin admin] PATH_INFO: `/v3/users/fa98d13285cc45d8b1f19ca0a164ad87` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:11.242397 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdde976-dda8-42e2-b7de-bb561dd8f4fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa98d13285cc45d8b1f19ca0a164ad87)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:11.244500 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdde976-dda8-42e2-b7de-bb561dd8f4fd admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:11.485316 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-2bdde976-dda8-42e2-b7de-bb561dd8f4fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa98d13285cc45d8b1f19ca0a164ad87'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:11.586219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-2bdde976-dda8-42e2-b7de-bb561dd8f4fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa98d13285cc45d8b1f19ca0a164ad87'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:11.594820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-2bdde976-dda8-42e2-b7de-bb561dd8f4fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa98d13285cc45d8b1f19ca0a164ad87'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:11.610034 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-2bdde976-dda8-42e2-b7de-bb561dd8f4fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa98d13285cc45d8b1f19ca0a164ad87'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:11.610797 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-2bdde976-dda8-42e2-b7de-bb561dd8f4fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa98d13285cc45d8b1f19ca0a164ad87'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:11.617377 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1245/2488] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:01:11 2022] DELETE /identity/v3/users/fa98d13285cc45d8b1f19ca0a164ad87 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:01:11.624379 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0c84c-268b-42cb-b2fa-f11670bd9f0d None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:11.624935 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0c84c-268b-42cb-b2fa-f11670bd9f0d None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:11.625069 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0c84c-268b-42cb-b2fa-f11670bd9f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:11.647292 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-b9e0c84c-268b-42cb-b2fa-f11670bd9f0d None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:11.648881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b9e0c84c-268b-42cb-b2fa-f11670bd9f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:11.720106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1244/2489] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:01:11.730805 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdde976-dda8-42e2-b7de-bb561dd8f4fd admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:11.732548 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-2bdde976-dda8-42e2-b7de-bb561dd8f4fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:11.798598 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdde976-dda8-42e2-b7de-bb561dd8f4fd admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:11.802288 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f602e-9b4f-48c9-9ada-890476c33a48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:11.802899 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f602e-9b4f-48c9-9ada-890476c33a48 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:11.803195 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f602e-9b4f-48c9-9ada-890476c33a48 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:11.803489 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f602e-9b4f-48c9-9ada-890476c33a48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:11.814007 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f602e-9b4f-48c9-9ada-890476c33a48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:11.815491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f602e-9b4f-48c9-9ada-890476c33a48 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:11.826220 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1246/2490] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:01:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:01:12.326858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0c84c-268b-42cb-b2fa-f11670bd9f0d None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:12.328370 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b9e0c84c-268b-42cb-b2fa-f11670bd9f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:12.340810 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0c84c-268b-42cb-b2fa-f11670bd9f0d None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:12.346588 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7a642-a0c6-4910-8cb0-af60f81e5eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:12.347265 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7a642-a0c6-4910-8cb0-af60f81e5eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:12.347598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7a642-a0c6-4910-8cb0-af60f81e5eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:12.347907 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7a642-a0c6-4910-8cb0-af60f81e5eb4 admin admin] PATH_INFO: `/v3/projects/43d07561b8da4ef8a22390b2e728fad7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:12.349157 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f7a642-a0c6-4910-8cb0-af60f81e5eb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43d07561b8da4ef8a22390b2e728fad7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:12.351236 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f7a642-a0c6-4910-8cb0-af60f81e5eb4 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:12.471715 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-75f7a642-a0c6-4910-8cb0-af60f81e5eb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43d07561b8da4ef8a22390b2e728fad7', 'request_id': 'req-75f7a642-a0c6-4910-8cb0-af60f81e5eb4'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:12.480394 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-75f7a642-a0c6-4910-8cb0-af60f81e5eb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43d07561b8da4ef8a22390b2e728fad7', 'request_id': 'req-75f7a642-a0c6-4910-8cb0-af60f81e5eb4'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:12.489254 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-75f7a642-a0c6-4910-8cb0-af60f81e5eb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43d07561b8da4ef8a22390b2e728fad7', 'request_id': 'req-75f7a642-a0c6-4910-8cb0-af60f81e5eb4'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:12.592264 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-75f7a642-a0c6-4910-8cb0-af60f81e5eb4 admin admin] The token cache is being invalidate because project 43d07561b8da4ef8a22390b2e728fad7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:01:12.592523 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-75f7a642-a0c6-4910-8cb0-af60f81e5eb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:12.593685 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-75f7a642-a0c6-4910-8cb0-af60f81e5eb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:12.595595 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1245/2491] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:01:12 2022] DELETE /identity/v3/projects/43d07561b8da4ef8a22390b2e728fad7 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:01:12.600023 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f602e-9b4f-48c9-9ada-890476c33a48 service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:12.611528 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f602e-9b4f-48c9-9ada-890476c33a48 service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:12.632048 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:12.674124 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9717a5-30fb-403e-94fd-18a4f351cb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:12.674772 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9717a5-30fb-403e-94fd-18a4f351cb3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:12.675054 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9717a5-30fb-403e-94fd-18a4f351cb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:12.675329 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9717a5-30fb-403e-94fd-18a4f351cb3b admin admin] PATH_INFO: `/v3/users/4ec60267557f41ffa416022fc38a2c50` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:12.676594 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9717a5-30fb-403e-94fd-18a4f351cb3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ec60267557f41ffa416022fc38a2c50)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:12.680237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9717a5-30fb-403e-94fd-18a4f351cb3b admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:12.890083 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-6f9717a5-30fb-403e-94fd-18a4f351cb3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ec60267557f41ffa416022fc38a2c50'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:12.961870 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-6f9717a5-30fb-403e-94fd-18a4f351cb3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ec60267557f41ffa416022fc38a2c50'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:12.971052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-6f9717a5-30fb-403e-94fd-18a4f351cb3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ec60267557f41ffa416022fc38a2c50'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:12.985446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-6f9717a5-30fb-403e-94fd-18a4f351cb3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ec60267557f41ffa416022fc38a2c50'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:12.986213 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-6f9717a5-30fb-403e-94fd-18a4f351cb3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ec60267557f41ffa416022fc38a2c50'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:12.992893 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1247/2492] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:01:12 2022] DELETE /identity/v3/users/4ec60267557f41ffa416022fc38a2c50 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:01:13.524427 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7a642-a0c6-4910-8cb0-af60f81e5eb4 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:13.526180 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-75f7a642-a0c6-4910-8cb0-af60f81e5eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:13.543697 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7a642-a0c6-4910-8cb0-af60f81e5eb4 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:13.615825 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b097bf-b4e5-45ec-9ee8-a3e576e891fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:13.616490 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b097bf-b4e5-45ec-9ee8-a3e576e891fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:13.616777 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b097bf-b4e5-45ec-9ee8-a3e576e891fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:13.617120 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b097bf-b4e5-45ec-9ee8-a3e576e891fb admin admin] PATH_INFO: `/v3/projects/4742e46f4e3c4c00a76327c858f5c9df` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:13.618370 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b097bf-b4e5-45ec-9ee8-a3e576e891fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4742e46f4e3c4c00a76327c858f5c9df)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:13.620397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b097bf-b4e5-45ec-9ee8-a3e576e891fb admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:13.720778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:13.746977 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-63b097bf-b4e5-45ec-9ee8-a3e576e891fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4742e46f4e3c4c00a76327c858f5c9df', 'request_id': 'req-63b097bf-b4e5-45ec-9ee8-a3e576e891fb'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:13.757133 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-63b097bf-b4e5-45ec-9ee8-a3e576e891fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4742e46f4e3c4c00a76327c858f5c9df', 'request_id': 'req-63b097bf-b4e5-45ec-9ee8-a3e576e891fb'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:13.769281 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-63b097bf-b4e5-45ec-9ee8-a3e576e891fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4742e46f4e3c4c00a76327c858f5c9df', 'request_id': 'req-63b097bf-b4e5-45ec-9ee8-a3e576e891fb'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:13.862953 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-63b097bf-b4e5-45ec-9ee8-a3e576e891fb admin admin] The token cache is being invalidate because project 4742e46f4e3c4c00a76327c858f5c9df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:01:13.863286 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-63b097bf-b4e5-45ec-9ee8-a3e576e891fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:13.864156 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-63b097bf-b4e5-45ec-9ee8-a3e576e891fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:13.866472 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1246/2493] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:01:13 2022] DELETE /identity/v3/projects/4742e46f4e3c4c00a76327c858f5c9df => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:01:13.871178 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227525fb-f02e-4d25-b2dc-83ca24d3e8b2 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:13.871846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227525fb-f02e-4d25-b2dc-83ca24d3e8b2 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:13.871846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227525fb-f02e-4d25-b2dc-83ca24d3e8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:13.893752 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-227525fb-f02e-4d25-b2dc-83ca24d3e8b2 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:13.895064 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-227525fb-f02e-4d25-b2dc-83ca24d3e8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:13.969999 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1248/2494] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:01:13.978663 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb0c18-5fff-4900-af84-aee3d8ffd94a None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:13.979260 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb0c18-5fff-4900-af84-aee3d8ffd94a None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:13.979792 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb0c18-5fff-4900-af84-aee3d8ffd94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:14.009559 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-26fb0c18-5fff-4900-af84-aee3d8ffd94a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:14.009559 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-26fb0c18-5fff-4900-af84-aee3d8ffd94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:14.016021 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1247/2495] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:01:14.021006 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227525fb-f02e-4d25-b2dc-83ca24d3e8b2 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:14.032776 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227525fb-f02e-4d25-b2dc-83ca24d3e8b2 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:14.037770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e3df0-a5d1-41ff-92b1-702d7bcdd0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:14.038390 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e3df0-a5d1-41ff-92b1-702d7bcdd0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:14.038664 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e3df0-a5d1-41ff-92b1-702d7bcdd0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:14.038935 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e3df0-a5d1-41ff-92b1-702d7bcdd0a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:14.039637 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e3df0-a5d1-41ff-92b1-702d7bcdd0a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:01:14.039942 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e3df0-a5d1-41ff-92b1-702d7bcdd0a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:14.041590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e3df0-a5d1-41ff-92b1-702d7bcdd0a7 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:14.054948 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1249/2496] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 14:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:01:14.073401 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb0c18-5fff-4900-af84-aee3d8ffd94a None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:14.089755 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb0c18-5fff-4900-af84-aee3d8ffd94a None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:14.103930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1b041-58ed-426c-b110-3eb7aae2dc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:14.104641 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1b041-58ed-426c-b110-3eb7aae2dc6b admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:14.104921 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1b041-58ed-426c-b110-3eb7aae2dc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:14.105383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1b041-58ed-426c-b110-3eb7aae2dc6b admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:14.106367 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1b041-58ed-426c-b110-3eb7aae2dc6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:14.109626 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1b041-58ed-426c-b110-3eb7aae2dc6b admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:14.245549 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1248/2497] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:01:14 2022] POST /identity/v3/projects => generated 369 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:01:14.250484 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e3df0-a5d1-41ff-92b1-702d7bcdd0a7 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:14.273877 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e3df0-a5d1-41ff-92b1-702d7bcdd0a7 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:14.309699 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:14.345076 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c28c38-19d1-4f40-9be8-224e5683963c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:14.345748 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c28c38-19d1-4f40-9be8-224e5683963c admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:14.346025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c28c38-19d1-4f40-9be8-224e5683963c admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:14.346297 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c28c38-19d1-4f40-9be8-224e5683963c admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:14.346950 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c28c38-19d1-4f40-9be8-224e5683963c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:14.348998 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c28c38-19d1-4f40-9be8-224e5683963c admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:14.477773 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1250/2498] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:01:14 2022] POST /identity/v3/users => generated 285 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:01:14.480336 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1b041-58ed-426c-b110-3eb7aae2dc6b admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:14.497189 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1b041-58ed-426c-b110-3eb7aae2dc6b admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:14.503854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884589a4-f100-4062-a45b-013b4ae23419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:14.504583 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884589a4-f100-4062-a45b-013b4ae23419 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:14.505025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884589a4-f100-4062-a45b-013b4ae23419 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:14.505432 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884589a4-f100-4062-a45b-013b4ae23419 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:14.506281 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884589a4-f100-4062-a45b-013b4ae23419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:14.508273 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884589a4-f100-4062-a45b-013b4ae23419 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:14.526961 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1249/2499] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:01:14.527861 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c28c38-19d1-4f40-9be8-224e5683963c admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:14.537636 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c28c38-19d1-4f40-9be8-224e5683963c admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:14.543728 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafd986-efd1-42f9-8293-6b8f0bc87000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:14.544770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafd986-efd1-42f9-8293-6b8f0bc87000 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:14.545182 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafd986-efd1-42f9-8293-6b8f0bc87000 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:14.545554 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafd986-efd1-42f9-8293-6b8f0bc87000 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:14.546352 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daafd986-efd1-42f9-8293-6b8f0bc87000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:14.548410 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daafd986-efd1-42f9-8293-6b8f0bc87000 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:14.567714 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1251/2500] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:01:14.574476 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884589a4-f100-4062-a45b-013b4ae23419 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:14.591221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884589a4-f100-4062-a45b-013b4ae23419 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:14.599214 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4b938-59bc-43b6-92db-fc1e50fd9f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:14.600672 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4b938-59bc-43b6-92db-fc1e50fd9f59 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:14.601160 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4b938-59bc-43b6-92db-fc1e50fd9f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:14.601649 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4b938-59bc-43b6-92db-fc1e50fd9f59 admin admin] PATH_INFO: `/v3/projects/4a1fc017fd2542f583905280be75bbcf/users/c323727b4e6f4f48bf78d8c4bee1c4f6/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:14.633716 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4b938-59bc-43b6-92db-fc1e50fd9f59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a1fc017fd2542f583905280be75bbcf, user_id=c323727b4e6f4f48bf78d8c4bee1c4f6, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:14.639947 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4b938-59bc-43b6-92db-fc1e50fd9f59 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:14.770351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1250/2501] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:01:14 2022] PUT /identity/v3/projects/4a1fc017fd2542f583905280be75bbcf/users/c323727b4e6f4f48bf78d8c4bee1c4f6/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:01:14.782291 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dca5d-a36b-4c3b-a515-80cf256cf0c1 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:14.782504 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dca5d-a36b-4c3b-a515-80cf256cf0c1 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:14.782744 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dca5d-a36b-4c3b-a515-80cf256cf0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:14.815259 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-a97dca5d-a36b-4c3b-a515-80cf256cf0c1 None None] MFA Rules not processed for user `c323727b4e6f4f48bf78d8c4bee1c4f6`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:14.816565 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a97dca5d-a36b-4c3b-a515-80cf256cf0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:14.909247 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1252/2502] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:01:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:01:14.914802 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4b938-59bc-43b6-92db-fc1e50fd9f59 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:14.994961 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4b938-59bc-43b6-92db-fc1e50fd9f59 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:15.001150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440acb2-7df5-422a-9295-5dcbe2c256af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:15.001922 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440acb2-7df5-422a-9295-5dcbe2c256af admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:15.002207 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440acb2-7df5-422a-9295-5dcbe2c256af admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:15.002488 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440acb2-7df5-422a-9295-5dcbe2c256af admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:15.003231 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440acb2-7df5-422a-9295-5dcbe2c256af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:15.005347 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440acb2-7df5-422a-9295-5dcbe2c256af admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:15.411178 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1251/2503] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:01:14 2022] POST /identity/v3/projects => generated 369 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:01:15.415893 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97dca5d-a36b-4c3b-a515-80cf256cf0c1 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:15.428051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97dca5d-a36b-4c3b-a515-80cf256cf0c1 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:15.515711 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dd923-5455-40e2-8459-395df5daf4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:15.516376 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dd923-5455-40e2-8459-395df5daf4ef admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:15.516672 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dd923-5455-40e2-8459-395df5daf4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:15.516966 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dd923-5455-40e2-8459-395df5daf4ef admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:15.518288 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17dd923-5455-40e2-8459-395df5daf4ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:15.519844 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17dd923-5455-40e2-8459-395df5daf4ef admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:15.692584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1253/2504] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:01:15 2022] POST /identity/v3/users => generated 291 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:01:15.706142 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440acb2-7df5-422a-9295-5dcbe2c256af admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:15.712865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440acb2-7df5-422a-9295-5dcbe2c256af admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:15.719645 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d87e91-6d49-45b9-adc7-216c1ade4199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:15.720264 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d87e91-6d49-45b9-adc7-216c1ade4199 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:15.720554 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d87e91-6d49-45b9-adc7-216c1ade4199 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:15.720821 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d87e91-6d49-45b9-adc7-216c1ade4199 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:15.721661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d87e91-6d49-45b9-adc7-216c1ade4199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:15.724426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d87e91-6d49-45b9-adc7-216c1ade4199 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:15.738038 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1252/2505] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:01:15.761415 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dd923-5455-40e2-8459-395df5daf4ef admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:15.773547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dd923-5455-40e2-8459-395df5daf4ef admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:15.778385 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fff7d0-e71b-413c-b0b2-aaeb7f9e04fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:15.779709 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fff7d0-e71b-413c-b0b2-aaeb7f9e04fd admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:15.780002 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fff7d0-e71b-413c-b0b2-aaeb7f9e04fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:15.780272 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fff7d0-e71b-413c-b0b2-aaeb7f9e04fd admin admin] PATH_INFO: `/v3/projects/2d33ab3d2c794a94bd874e9518d23ceb/users/b7c3f0aabe184c41a2040ec385632643/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:15.796783 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fff7d0-e71b-413c-b0b2-aaeb7f9e04fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d33ab3d2c794a94bd874e9518d23ceb, user_id=b7c3f0aabe184c41a2040ec385632643, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:15.799599 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fff7d0-e71b-413c-b0b2-aaeb7f9e04fd admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:16.034568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1254/2506] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:01:15 2022] PUT /identity/v3/projects/2d33ab3d2c794a94bd874e9518d23ceb/users/b7c3f0aabe184c41a2040ec385632643/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:01:16.039155 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d87e91-6d49-45b9-adc7-216c1ade4199 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:16.049718 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d87e91-6d49-45b9-adc7-216c1ade4199 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:16.071171 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:16.118679 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7624a5-e47e-49dc-affb-fa63e0fa622e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:16.119786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7624a5-e47e-49dc-affb-fa63e0fa622e admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:16.120285 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7624a5-e47e-49dc-affb-fa63e0fa622e admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:16.120737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7624a5-e47e-49dc-affb-fa63e0fa622e admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:16.121755 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7624a5-e47e-49dc-affb-fa63e0fa622e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:16.124465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7624a5-e47e-49dc-affb-fa63e0fa622e admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:16.140679 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1253/2507] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:01:16.145012 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fff7d0-e71b-413c-b0b2-aaeb7f9e04fd admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:16.150851 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:16.157270 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fff7d0-e71b-413c-b0b2-aaeb7f9e04fd admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:16.162714 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8595a8-f657-4c66-aaef-419c76181ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:16.163453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8595a8-f657-4c66-aaef-419c76181ffc admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:16.163725 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8595a8-f657-4c66-aaef-419c76181ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:16.164021 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8595a8-f657-4c66-aaef-419c76181ffc admin admin] PATH_INFO: `/v3/projects/2d33ab3d2c794a94bd874e9518d23ceb/users/b7c3f0aabe184c41a2040ec385632643/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:16.166068 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8595a8-f657-4c66-aaef-419c76181ffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d33ab3d2c794a94bd874e9518d23ceb, user_id=b7c3f0aabe184c41a2040ec385632643, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:16.168832 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8595a8-f657-4c66-aaef-419c76181ffc admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:16.185625 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1255/2508] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:01:16 2022] PUT /identity/v3/projects/2d33ab3d2c794a94bd874e9518d23ceb/users/b7c3f0aabe184c41a2040ec385632643/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:01:16.205257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8125c28-14f2-41f7-bee9-da91ccdeb88e None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:16.205787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8125c28-14f2-41f7-bee9-da91ccdeb88e None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:16.206287 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8125c28-14f2-41f7-bee9-da91ccdeb88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:16.255846 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-a8125c28-14f2-41f7-bee9-da91ccdeb88e None None] MFA Rules not processed for user `b7c3f0aabe184c41a2040ec385632643`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:16.257726 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a8125c28-14f2-41f7-bee9-da91ccdeb88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:16.335978 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1254/2509] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:01:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:01:16.347854 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8595a8-f657-4c66-aaef-419c76181ffc admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:16.349667 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-dd8595a8-f657-4c66-aaef-419c76181ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:16.434256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8595a8-f657-4c66-aaef-419c76181ffc admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:16.439302 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b41086-f9ec-4feb-be50-5e643cbcc4ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:16.440008 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b41086-f9ec-4feb-be50-5e643cbcc4ec service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:16.440291 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b41086-f9ec-4feb-be50-5e643cbcc4ec service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:16.440568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b41086-f9ec-4feb-be50-5e643cbcc4ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:16.451784 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b41086-f9ec-4feb-be50-5e643cbcc4ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:16.453714 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b41086-f9ec-4feb-be50-5e643cbcc4ec service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:16.467949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1256/2510] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:01:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:01:16.606338 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8125c28-14f2-41f7-bee9-da91ccdeb88e None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:16.611153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a8125c28-14f2-41f7-bee9-da91ccdeb88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:16.621893 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8125c28-14f2-41f7-bee9-da91ccdeb88e None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:16.626306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d6299-63e2-4e3a-825e-b0f27222027f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:16.626939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d6299-63e2-4e3a-825e-b0f27222027f service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:16.627223 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d6299-63e2-4e3a-825e-b0f27222027f service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:16.627541 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d6299-63e2-4e3a-825e-b0f27222027f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:16.723203 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d6299-63e2-4e3a-825e-b0f27222027f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:16.733423 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d6299-63e2-4e3a-825e-b0f27222027f service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:16.744383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1255/2511] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:01:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:01:22.113728 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b41086-f9ec-4feb-be50-5e643cbcc4ec service cinder] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:22.177365 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b41086-f9ec-4feb-be50-5e643cbcc4ec service cinder] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:22.182201 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2baee4-674d-494f-b6a6-1affb2bd8c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:22.185847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2baee4-674d-494f-b6a6-1affb2bd8c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:22.185847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2baee4-674d-494f-b6a6-1affb2bd8c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:22.185847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2baee4-674d-494f-b6a6-1affb2bd8c35 admin admin] PATH_INFO: `/v3/users/c323727b4e6f4f48bf78d8c4bee1c4f6` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:22.185847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2baee4-674d-494f-b6a6-1affb2bd8c35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c323727b4e6f4f48bf78d8c4bee1c4f6)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:22.186901 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2baee4-674d-494f-b6a6-1affb2bd8c35 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:22.409732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-ae2baee4-674d-494f-b6a6-1affb2bd8c35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c323727b4e6f4f48bf78d8c4bee1c4f6'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:22.512256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-ae2baee4-674d-494f-b6a6-1affb2bd8c35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c323727b4e6f4f48bf78d8c4bee1c4f6'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:22.520995 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-ae2baee4-674d-494f-b6a6-1affb2bd8c35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c323727b4e6f4f48bf78d8c4bee1c4f6'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:22.536312 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-ae2baee4-674d-494f-b6a6-1affb2bd8c35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c323727b4e6f4f48bf78d8c4bee1c4f6'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:22.537348 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-ae2baee4-674d-494f-b6a6-1affb2bd8c35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c323727b4e6f4f48bf78d8c4bee1c4f6'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:22.544419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1257/2512] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:01:22 2022] DELETE /identity/v3/users/c323727b4e6f4f48bf78d8c4bee1c4f6 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:01:22.550329 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe09921-6656-44a6-a05b-18df1fd56c47 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:22.550869 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe09921-6656-44a6-a05b-18df1fd56c47 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:22.551012 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe09921-6656-44a6-a05b-18df1fd56c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:22.572294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-5fe09921-6656-44a6-a05b-18df1fd56c47 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:22.573508 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-5fe09921-6656-44a6-a05b-18df1fd56c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:22.629669 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:22.652115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1256/2513] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:01:22.662473 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2baee4-674d-494f-b6a6-1affb2bd8c35 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:22.663920 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ae2baee4-674d-494f-b6a6-1affb2bd8c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:22.678316 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:22.721710 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2baee4-674d-494f-b6a6-1affb2bd8c35 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:22.725444 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c4805-4814-47e0-a882-37b96bc82c35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:22.726051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c4805-4814-47e0-a882-37b96bc82c35 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:22.726346 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c4805-4814-47e0-a882-37b96bc82c35 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:22.726625 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c4805-4814-47e0-a882-37b96bc82c35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:22.736992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c4805-4814-47e0-a882-37b96bc82c35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:22.738547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c4805-4814-47e0-a882-37b96bc82c35 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:22.748141 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1258/2514] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:01:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:01:23.278755 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe09921-6656-44a6-a05b-18df1fd56c47 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:23.281222 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-5fe09921-6656-44a6-a05b-18df1fd56c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:23.299637 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe09921-6656-44a6-a05b-18df1fd56c47 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:23.306402 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25797216-7a82-4cf2-a39d-7bab0c01fa51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:23.307182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25797216-7a82-4cf2-a39d-7bab0c01fa51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:23.307564 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25797216-7a82-4cf2-a39d-7bab0c01fa51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:23.307901 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25797216-7a82-4cf2-a39d-7bab0c01fa51 admin admin] PATH_INFO: `/v3/projects/4a1fc017fd2542f583905280be75bbcf` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:23.309186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25797216-7a82-4cf2-a39d-7bab0c01fa51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a1fc017fd2542f583905280be75bbcf)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:23.311207 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25797216-7a82-4cf2-a39d-7bab0c01fa51 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:23.427737 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-25797216-7a82-4cf2-a39d-7bab0c01fa51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a1fc017fd2542f583905280be75bbcf', 'request_id': 'req-25797216-7a82-4cf2-a39d-7bab0c01fa51'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:23.433557 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-25797216-7a82-4cf2-a39d-7bab0c01fa51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a1fc017fd2542f583905280be75bbcf', 'request_id': 'req-25797216-7a82-4cf2-a39d-7bab0c01fa51'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:23.440971 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-25797216-7a82-4cf2-a39d-7bab0c01fa51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a1fc017fd2542f583905280be75bbcf', 'request_id': 'req-25797216-7a82-4cf2-a39d-7bab0c01fa51'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:23.532628 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-25797216-7a82-4cf2-a39d-7bab0c01fa51 admin admin] The token cache is being invalidate because project 4a1fc017fd2542f583905280be75bbcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:01:23.532919 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-25797216-7a82-4cf2-a39d-7bab0c01fa51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:23.533650 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-25797216-7a82-4cf2-a39d-7bab0c01fa51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:23.535185 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1257/2515] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:01:23 2022] DELETE /identity/v3/projects/4a1fc017fd2542f583905280be75bbcf => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:01:23.539335 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c4805-4814-47e0-a882-37b96bc82c35 service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:23.548982 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c4805-4814-47e0-a882-37b96bc82c35 service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:23.614449 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50a703-ca8f-4ea3-ba13-3981d96ec5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:23.615243 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50a703-ca8f-4ea3-ba13-3981d96ec5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:23.615697 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50a703-ca8f-4ea3-ba13-3981d96ec5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:23.616119 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50a703-ca8f-4ea3-ba13-3981d96ec5e2 admin admin] PATH_INFO: `/v3/users/b7c3f0aabe184c41a2040ec385632643` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:23.617510 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50a703-ca8f-4ea3-ba13-3981d96ec5e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7c3f0aabe184c41a2040ec385632643)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:23.619597 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50a703-ca8f-4ea3-ba13-3981d96ec5e2 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:23.882703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dd50a703-ca8f-4ea3-ba13-3981d96ec5e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7c3f0aabe184c41a2040ec385632643'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:23.969099 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dd50a703-ca8f-4ea3-ba13-3981d96ec5e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7c3f0aabe184c41a2040ec385632643'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:23.977288 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dd50a703-ca8f-4ea3-ba13-3981d96ec5e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7c3f0aabe184c41a2040ec385632643'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:23.991216 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dd50a703-ca8f-4ea3-ba13-3981d96ec5e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7c3f0aabe184c41a2040ec385632643'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:23.997299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dd50a703-ca8f-4ea3-ba13-3981d96ec5e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7c3f0aabe184c41a2040ec385632643'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:23.999156 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1259/2516] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:01:23 2022] DELETE /identity/v3/users/b7c3f0aabe184c41a2040ec385632643 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:01:24.433832 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25797216-7a82-4cf2-a39d-7bab0c01fa51 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:24.435929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-25797216-7a82-4cf2-a39d-7bab0c01fa51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:24.454727 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25797216-7a82-4cf2-a39d-7bab0c01fa51 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:24.535975 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2d304-f1ca-454a-aaae-3638cc65b4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:24.536615 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2d304-f1ca-454a-aaae-3638cc65b4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:24.536897 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2d304-f1ca-454a-aaae-3638cc65b4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:24.537170 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2d304-f1ca-454a-aaae-3638cc65b4ab admin admin] PATH_INFO: `/v3/projects/2d33ab3d2c794a94bd874e9518d23ceb` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:24.538312 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2d304-f1ca-454a-aaae-3638cc65b4ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d33ab3d2c794a94bd874e9518d23ceb)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:24.540389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2d304-f1ca-454a-aaae-3638cc65b4ab admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:24.657132 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-3dc2d304-f1ca-454a-aaae-3638cc65b4ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d33ab3d2c794a94bd874e9518d23ceb', 'request_id': 'req-3dc2d304-f1ca-454a-aaae-3638cc65b4ab'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:24.662817 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-3dc2d304-f1ca-454a-aaae-3638cc65b4ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d33ab3d2c794a94bd874e9518d23ceb', 'request_id': 'req-3dc2d304-f1ca-454a-aaae-3638cc65b4ab'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:24.669734 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-3dc2d304-f1ca-454a-aaae-3638cc65b4ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d33ab3d2c794a94bd874e9518d23ceb', 'request_id': 'req-3dc2d304-f1ca-454a-aaae-3638cc65b4ab'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:24.760306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:24.766449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-3dc2d304-f1ca-454a-aaae-3638cc65b4ab admin admin] The token cache is being invalidate because project 2d33ab3d2c794a94bd874e9518d23ceb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:01:24.766743 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-3dc2d304-f1ca-454a-aaae-3638cc65b4ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:24.767615 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-3dc2d304-f1ca-454a-aaae-3638cc65b4ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:24.769216 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1258/2517] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:01:24 2022] DELETE /identity/v3/projects/2d33ab3d2c794a94bd874e9518d23ceb => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:01:24.775353 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb936771-490e-4f02-9b44-5a1fa29729e4 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:24.782574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb936771-490e-4f02-9b44-5a1fa29729e4 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:24.782574 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb936771-490e-4f02-9b44-5a1fa29729e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:24.797158 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-cb936771-490e-4f02-9b44-5a1fa29729e4 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:24.798384 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-cb936771-490e-4f02-9b44-5a1fa29729e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:24.831709 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:24.876032 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1260/2518] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:01:24.885221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941528b-1040-44a6-8ed0-39394ec57d56 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:24.885506 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941528b-1040-44a6-8ed0-39394ec57d56 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:24.885910 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941528b-1040-44a6-8ed0-39394ec57d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:24.909493 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-c941528b-1040-44a6-8ed0-39394ec57d56 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:24.910943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c941528b-1040-44a6-8ed0-39394ec57d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:24.919135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1259/2519] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:01:24.924190 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb936771-490e-4f02-9b44-5a1fa29729e4 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:24.936807 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb936771-490e-4f02-9b44-5a1fa29729e4 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:24.941274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ba56a-6721-4fa9-871f-299e5e118809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:24.941891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ba56a-6721-4fa9-871f-299e5e118809 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:24.942184 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ba56a-6721-4fa9-871f-299e5e118809 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:24.942453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ba56a-6721-4fa9-871f-299e5e118809 admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:24.943110 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ba56a-6721-4fa9-871f-299e5e118809 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:01:24.943451 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ba56a-6721-4fa9-871f-299e5e118809 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:24.945143 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ba56a-6721-4fa9-871f-299e5e118809 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:24.958644 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1261/2520] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 14:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:01:24.963249 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941528b-1040-44a6-8ed0-39394ec57d56 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:24.973335 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941528b-1040-44a6-8ed0-39394ec57d56 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:24.980004 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90006c60-e09d-4b52-b21b-3d231e2f0294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:24.990402 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90006c60-e09d-4b52-b21b-3d231e2f0294 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:24.990402 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90006c60-e09d-4b52-b21b-3d231e2f0294 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:24.990402 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90006c60-e09d-4b52-b21b-3d231e2f0294 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:24.990402 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90006c60-e09d-4b52-b21b-3d231e2f0294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:24.990402 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90006c60-e09d-4b52-b21b-3d231e2f0294 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:25.078146 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1260/2521] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:01:24 2022] POST /identity/v3/projects => generated 359 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:01:25.082886 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ba56a-6721-4fa9-871f-299e5e118809 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:25.094431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ba56a-6721-4fa9-871f-299e5e118809 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:25.166914 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca3637-fda2-429c-83ae-22bf957c9d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:25.167976 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca3637-fda2-429c-83ae-22bf957c9d60 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:25.168483 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca3637-fda2-429c-83ae-22bf957c9d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:25.168952 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca3637-fda2-429c-83ae-22bf957c9d60 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:25.170657 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca3637-fda2-429c-83ae-22bf957c9d60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:25.174419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca3637-fda2-429c-83ae-22bf957c9d60 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:25.307006 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1262/2522] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:01:25 2022] POST /identity/v3/users => generated 280 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:01:25.311167 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90006c60-e09d-4b52-b21b-3d231e2f0294 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:25.321793 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90006c60-e09d-4b52-b21b-3d231e2f0294 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:25.326415 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599835f7-c98b-4deb-b522-63ed3e3fce9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:25.327031 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599835f7-c98b-4deb-b522-63ed3e3fce9d admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:25.327312 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599835f7-c98b-4deb-b522-63ed3e3fce9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:25.327623 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599835f7-c98b-4deb-b522-63ed3e3fce9d admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:25.328379 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599835f7-c98b-4deb-b522-63ed3e3fce9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:25.330024 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599835f7-c98b-4deb-b522-63ed3e3fce9d admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:25.340274 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1261/2523] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:01:25.344753 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca3637-fda2-429c-83ae-22bf957c9d60 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:25.355475 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca3637-fda2-429c-83ae-22bf957c9d60 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:25.361172 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a67e3-93f2-46f9-a5fd-4e363ec62cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:25.361827 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a67e3-93f2-46f9-a5fd-4e363ec62cab admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:25.362110 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a67e3-93f2-46f9-a5fd-4e363ec62cab admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:25.362380 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a67e3-93f2-46f9-a5fd-4e363ec62cab admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:25.363021 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a67e3-93f2-46f9-a5fd-4e363ec62cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:25.364650 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a67e3-93f2-46f9-a5fd-4e363ec62cab admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:25.375792 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1263/2524] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:01:25.379996 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599835f7-c98b-4deb-b522-63ed3e3fce9d admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:25.390069 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599835f7-c98b-4deb-b522-63ed3e3fce9d admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:25.394604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4e8b2-4b57-4489-93ac-c0f115075935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:25.395227 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4e8b2-4b57-4489-93ac-c0f115075935 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:25.395541 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4e8b2-4b57-4489-93ac-c0f115075935 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:25.395821 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4e8b2-4b57-4489-93ac-c0f115075935 admin admin] PATH_INFO: `/v3/projects/4c5c11edad6b46e98b09b9fcba6a2888/users/401934d9ebbd44ec907a27cdbf9ebf0f/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:25.410504 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e4e8b2-4b57-4489-93ac-c0f115075935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c5c11edad6b46e98b09b9fcba6a2888, user_id=401934d9ebbd44ec907a27cdbf9ebf0f, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:25.413195 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e4e8b2-4b57-4489-93ac-c0f115075935 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:25.507081 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1262/2525] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:01:25 2022] PUT /identity/v3/projects/4c5c11edad6b46e98b09b9fcba6a2888/users/401934d9ebbd44ec907a27cdbf9ebf0f/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:01:25.518027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f71f8a-5fdc-45a9-85a2-956cd9418e59 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:25.518316 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f71f8a-5fdc-45a9-85a2-956cd9418e59 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:25.518591 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f71f8a-5fdc-45a9-85a2-956cd9418e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:25.550235 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-d3f71f8a-5fdc-45a9-85a2-956cd9418e59 None None] MFA Rules not processed for user `401934d9ebbd44ec907a27cdbf9ebf0f`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:25.552412 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-d3f71f8a-5fdc-45a9-85a2-956cd9418e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:25.622806 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1264/2526] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:01:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:01:25.676701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4e8b2-4b57-4489-93ac-c0f115075935 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:25.678479 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-15e4e8b2-4b57-4489-93ac-c0f115075935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:25.750020 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4e8b2-4b57-4489-93ac-c0f115075935 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:25.754335 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3c415-133b-48bf-aaf1-a22d26521918 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:25.758740 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3c415-133b-48bf-aaf1-a22d26521918 service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:25.758740 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3c415-133b-48bf-aaf1-a22d26521918 service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:25.758740 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3c415-133b-48bf-aaf1-a22d26521918 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:25.770758 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3c415-133b-48bf-aaf1-a22d26521918 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:25.773394 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3c415-133b-48bf-aaf1-a22d26521918 service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:25.785221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1263/2527] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:01:25 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:01:25.807704 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f71f8a-5fdc-45a9-85a2-956cd9418e59 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:25.847396 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:25.883315 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f71f8a-5fdc-45a9-85a2-956cd9418e59 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:25.888101 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb02b2-70f2-4c48-b95b-7e737c23f3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:25.891495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb02b2-70f2-4c48-b95b-7e737c23f3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:25.891495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb02b2-70f2-4c48-b95b-7e737c23f3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:25.891495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb02b2-70f2-4c48-b95b-7e737c23f3a1 admin admin] PATH_INFO: `/v3/users/401934d9ebbd44ec907a27cdbf9ebf0f` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:25.891495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb02b2-70f2-4c48-b95b-7e737c23f3a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=401934d9ebbd44ec907a27cdbf9ebf0f)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:25.893104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb02b2-70f2-4c48-b95b-7e737c23f3a1 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:26.161549 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dbfb02b2-70f2-4c48-b95b-7e737c23f3a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '401934d9ebbd44ec907a27cdbf9ebf0f'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:26.236215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dbfb02b2-70f2-4c48-b95b-7e737c23f3a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '401934d9ebbd44ec907a27cdbf9ebf0f'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:26.244755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dbfb02b2-70f2-4c48-b95b-7e737c23f3a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '401934d9ebbd44ec907a27cdbf9ebf0f'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:26.257981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dbfb02b2-70f2-4c48-b95b-7e737c23f3a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '401934d9ebbd44ec907a27cdbf9ebf0f'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:26.258706 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dbfb02b2-70f2-4c48-b95b-7e737c23f3a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '401934d9ebbd44ec907a27cdbf9ebf0f'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:26.265689 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1265/2528] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:01:25 2022] DELETE /identity/v3/users/401934d9ebbd44ec907a27cdbf9ebf0f => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:01:26.270480 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75362293-81f6-4431-8877-eb7cb397446a None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:26.270773 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75362293-81f6-4431-8877-eb7cb397446a None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:26.271058 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75362293-81f6-4431-8877-eb7cb397446a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:26.291326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-75362293-81f6-4431-8877-eb7cb397446a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:26.292607 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-75362293-81f6-4431-8877-eb7cb397446a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:26.359923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1264/2529] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:01:26.373476 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb02b2-70f2-4c48-b95b-7e737c23f3a1 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:26.375837 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-dbfb02b2-70f2-4c48-b95b-7e737c23f3a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:26.439712 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb02b2-70f2-4c48-b95b-7e737c23f3a1 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:26.443286 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c90bb-eaf2-4780-bb72-c72203b962da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:26.443980 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c90bb-eaf2-4780-bb72-c72203b962da service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:26.444340 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c90bb-eaf2-4780-bb72-c72203b962da service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:26.444663 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c90bb-eaf2-4780-bb72-c72203b962da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:26.455146 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c90bb-eaf2-4780-bb72-c72203b962da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:26.456696 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c90bb-eaf2-4780-bb72-c72203b962da service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:26.468022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1266/2530] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:01:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:01:26.946750 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75362293-81f6-4431-8877-eb7cb397446a None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:26.948619 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-75362293-81f6-4431-8877-eb7cb397446a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:26.966719 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75362293-81f6-4431-8877-eb7cb397446a None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:26.973121 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e96de9-382b-4116-84fd-e01c04ab4a6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:26.974513 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e96de9-382b-4116-84fd-e01c04ab4a6c service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:26.974792 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e96de9-382b-4116-84fd-e01c04ab4a6c service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:26.975062 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e96de9-382b-4116-84fd-e01c04ab4a6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:26.976879 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-93e96de9-382b-4116-84fd-e01c04ab4a6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:26.986124 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c90bb-eaf2-4780-bb72-c72203b962da service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:26.993990 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-945c90bb-eaf2-4780-bb72-c72203b962da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:27.012580 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c90bb-eaf2-4780-bb72-c72203b962da service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:27.018355 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5418f-ffdb-4cfa-85df-e384991e16c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:27.019804 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5418f-ffdb-4cfa-85df-e384991e16c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:27.019804 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5418f-ffdb-4cfa-85df-e384991e16c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:27.019804 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5418f-ffdb-4cfa-85df-e384991e16c9 admin admin] PATH_INFO: `/v3/projects/4c5c11edad6b46e98b09b9fcba6a2888` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:27.021644 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5418f-ffdb-4cfa-85df-e384991e16c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c5c11edad6b46e98b09b9fcba6a2888)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:27.027949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5418f-ffdb-4cfa-85df-e384991e16c9 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:27.061749 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:27.088731 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e96de9-382b-4116-84fd-e01c04ab4a6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:27.090185 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e96de9-382b-4116-84fd-e01c04ab4a6c service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:27.100745 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1265/2531] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:01:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:01:27.214470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:27.218723 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-2fa5418f-ffdb-4cfa-85df-e384991e16c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c5c11edad6b46e98b09b9fcba6a2888', 'request_id': 'req-2fa5418f-ffdb-4cfa-85df-e384991e16c9'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:27.226061 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-2fa5418f-ffdb-4cfa-85df-e384991e16c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c5c11edad6b46e98b09b9fcba6a2888', 'request_id': 'req-2fa5418f-ffdb-4cfa-85df-e384991e16c9'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:27.290503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-2fa5418f-ffdb-4cfa-85df-e384991e16c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c5c11edad6b46e98b09b9fcba6a2888', 'request_id': 'req-2fa5418f-ffdb-4cfa-85df-e384991e16c9'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:27.317862 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-2fa5418f-ffdb-4cfa-85df-e384991e16c9 admin admin] The token cache is being invalidate because project 4c5c11edad6b46e98b09b9fcba6a2888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:01:27.318268 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-2fa5418f-ffdb-4cfa-85df-e384991e16c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:27.320636 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-2fa5418f-ffdb-4cfa-85df-e384991e16c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:27.324272 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1267/2532] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:01:26 2022] DELETE /identity/v3/projects/4c5c11edad6b46e98b09b9fcba6a2888 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:01:27.330938 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2bbff-ac78-4985-a707-4a598dc8f0aa None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:27.331215 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2bbff-ac78-4985-a707-4a598dc8f0aa None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:27.331586 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2bbff-ac78-4985-a707-4a598dc8f0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:27.360529 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-25b2bbff-ac78-4985-a707-4a598dc8f0aa None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:27.362840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-25b2bbff-ac78-4985-a707-4a598dc8f0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:27.472385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1266/2533] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:01:27.480749 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cee7f-ed3c-400f-9b8d-0b65e6f5df71 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:27.481129 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cee7f-ed3c-400f-9b8d-0b65e6f5df71 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:27.481489 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cee7f-ed3c-400f-9b8d-0b65e6f5df71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:27.505802 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-899cee7f-ed3c-400f-9b8d-0b65e6f5df71 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:27.507087 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-899cee7f-ed3c-400f-9b8d-0b65e6f5df71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:27.516461 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1268/2534] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:01:27.520923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2bbff-ac78-4985-a707-4a598dc8f0aa None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:27.531234 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2bbff-ac78-4985-a707-4a598dc8f0aa None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:27.536298 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42eeb9d-fe0b-4252-b007-0b063b33a845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:27.536926 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42eeb9d-fe0b-4252-b007-0b063b33a845 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:27.537268 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42eeb9d-fe0b-4252-b007-0b063b33a845 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:27.537465 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42eeb9d-fe0b-4252-b007-0b063b33a845 admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:27.538167 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42eeb9d-fe0b-4252-b007-0b063b33a845 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:01:27.538473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42eeb9d-fe0b-4252-b007-0b063b33a845 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:27.540169 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42eeb9d-fe0b-4252-b007-0b063b33a845 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:27.553208 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1267/2535] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 14:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 14:01:27.557942 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cee7f-ed3c-400f-9b8d-0b65e6f5df71 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:27.570123 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cee7f-ed3c-400f-9b8d-0b65e6f5df71 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:27.580590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7717bdd-a058-4d1b-993a-edc9790b9dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:27.581234 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7717bdd-a058-4d1b-993a-edc9790b9dab admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:27.581509 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7717bdd-a058-4d1b-993a-edc9790b9dab admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:27.581776 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7717bdd-a058-4d1b-993a-edc9790b9dab admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:27.582787 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7717bdd-a058-4d1b-993a-edc9790b9dab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:27.584812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7717bdd-a058-4d1b-993a-edc9790b9dab admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:27.742876 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1269/2536] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:01:27 2022] POST /identity/v3/projects => generated 375 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:01:27.744604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42eeb9d-fe0b-4252-b007-0b063b33a845 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:27.756152 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42eeb9d-fe0b-4252-b007-0b063b33a845 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:27.821336 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766dc831-c427-4a5e-aa5f-5f29cf261fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:27.822040 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766dc831-c427-4a5e-aa5f-5f29cf261fad admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:27.822321 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766dc831-c427-4a5e-aa5f-5f29cf261fad admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:27.822594 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766dc831-c427-4a5e-aa5f-5f29cf261fad admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:27.823228 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766dc831-c427-4a5e-aa5f-5f29cf261fad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:27.825316 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766dc831-c427-4a5e-aa5f-5f29cf261fad admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:27.928052 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1268/2537] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:01:27 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:01:27.932139 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7717bdd-a058-4d1b-993a-edc9790b9dab admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:27.942957 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7717bdd-a058-4d1b-993a-edc9790b9dab admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:27.948051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b4e4f-1c38-4f0a-9860-86d33fcf48a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:27.948764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b4e4f-1c38-4f0a-9860-86d33fcf48a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:27.949044 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b4e4f-1c38-4f0a-9860-86d33fcf48a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:27.949316 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b4e4f-1c38-4f0a-9860-86d33fcf48a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:27.949965 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b4e4f-1c38-4f0a-9860-86d33fcf48a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:27.951625 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b4e4f-1c38-4f0a-9860-86d33fcf48a6 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:27.965734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1270/2538] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:01:27.970944 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766dc831-c427-4a5e-aa5f-5f29cf261fad admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:27.982063 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766dc831-c427-4a5e-aa5f-5f29cf261fad admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:27.987130 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1004be-f0a1-4e3f-ad67-6a072fe59e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:27.987769 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1004be-f0a1-4e3f-ad67-6a072fe59e73 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:27.988053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1004be-f0a1-4e3f-ad67-6a072fe59e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:27.988378 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1004be-f0a1-4e3f-ad67-6a072fe59e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:27.989023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1004be-f0a1-4e3f-ad67-6a072fe59e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:27.990663 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1004be-f0a1-4e3f-ad67-6a072fe59e73 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:28.001920 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1269/2539] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:01:28.013112 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b4e4f-1c38-4f0a-9860-86d33fcf48a6 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:28.017046 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b4e4f-1c38-4f0a-9860-86d33fcf48a6 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:28.022298 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde0881-28f1-4741-99a9-f69ff72eef46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:28.023104 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde0881-28f1-4741-99a9-f69ff72eef46 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:28.023411 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde0881-28f1-4741-99a9-f69ff72eef46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:28.023686 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde0881-28f1-4741-99a9-f69ff72eef46 admin admin] PATH_INFO: `/v3/projects/dd24a26115b64b0d8878bc2bf4f11b1c/users/43073a95b4ea41c0bf6f775fd2a388bf/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:28.042454 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde0881-28f1-4741-99a9-f69ff72eef46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd24a26115b64b0d8878bc2bf4f11b1c, user_id=43073a95b4ea41c0bf6f775fd2a388bf, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:28.045538 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde0881-28f1-4741-99a9-f69ff72eef46 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:28.118652 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1271/2540] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:01:28 2022] PUT /identity/v3/projects/dd24a26115b64b0d8878bc2bf4f11b1c/users/43073a95b4ea41c0bf6f775fd2a388bf/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:01:28.189669 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1e3dd-ee05-4cda-b2a7-86259091383a None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:28.190573 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1e3dd-ee05-4cda-b2a7-86259091383a None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:28.191035 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1e3dd-ee05-4cda-b2a7-86259091383a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:28.257559 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-e6d1e3dd-ee05-4cda-b2a7-86259091383a None None] MFA Rules not processed for user `43073a95b4ea41c0bf6f775fd2a388bf`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:28.259559 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-e6d1e3dd-ee05-4cda-b2a7-86259091383a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:28.302645 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:28.350370 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1270/2541] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:01:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:01:28.355577 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde0881-28f1-4741-99a9-f69ff72eef46 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:28.455140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde0881-28f1-4741-99a9-f69ff72eef46 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:28.462807 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2a55a-d08a-44b9-8775-cb59770b7fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:28.463931 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2a55a-d08a-44b9-8775-cb59770b7fff admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:28.464406 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2a55a-d08a-44b9-8775-cb59770b7fff admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:28.464882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2a55a-d08a-44b9-8775-cb59770b7fff admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:28.465923 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab2a55a-d08a-44b9-8775-cb59770b7fff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:28.469939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab2a55a-d08a-44b9-8775-cb59770b7fff admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:28.614773 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1272/2542] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:01:28 2022] POST /identity/v3/projects => generated 373 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:01:28.617956 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1e3dd-ee05-4cda-b2a7-86259091383a None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:28.637345 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1e3dd-ee05-4cda-b2a7-86259091383a None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:28.790481 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254a705-62e7-4c16-a78b-1233449bf912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:28.791775 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254a705-62e7-4c16-a78b-1233449bf912 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:28.792399 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254a705-62e7-4c16-a78b-1233449bf912 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:28.793034 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254a705-62e7-4c16-a78b-1233449bf912 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:28.794184 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254a705-62e7-4c16-a78b-1233449bf912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:28.799995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254a705-62e7-4c16-a78b-1233449bf912 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:28.956662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1271/2543] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:01:28 2022] POST /identity/v3/users => generated 293 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:01:28.961128 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2a55a-d08a-44b9-8775-cb59770b7fff admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:28.975315 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2a55a-d08a-44b9-8775-cb59770b7fff admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:28.981543 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef311d-7383-4dbf-8e63-81e6d4a8c1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:28.982418 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef311d-7383-4dbf-8e63-81e6d4a8c1fb admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:28.982804 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef311d-7383-4dbf-8e63-81e6d4a8c1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:28.983188 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef311d-7383-4dbf-8e63-81e6d4a8c1fb admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:28.984099 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef311d-7383-4dbf-8e63-81e6d4a8c1fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:28.986366 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef311d-7383-4dbf-8e63-81e6d4a8c1fb admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:29.011405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1273/2544] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:01:29.013793 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254a705-62e7-4c16-a78b-1233449bf912 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:29.029642 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254a705-62e7-4c16-a78b-1233449bf912 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:29.037173 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3db05-89ae-4686-980e-74aff7c753af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:29.037870 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3db05-89ae-4686-980e-74aff7c753af admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:29.038435 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3db05-89ae-4686-980e-74aff7c753af admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:29.039011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3db05-89ae-4686-980e-74aff7c753af admin admin] PATH_INFO: `/v3/projects/ba8f9353e06547bd96befcc171f1b1e4/users/726d156d269344cc85c7ba1c617c7666/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:29.071946 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3db05-89ae-4686-980e-74aff7c753af admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba8f9353e06547bd96befcc171f1b1e4, user_id=726d156d269344cc85c7ba1c617c7666, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:29.076070 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3db05-89ae-4686-980e-74aff7c753af admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:29.190707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1272/2545] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:01:29 2022] PUT /identity/v3/projects/ba8f9353e06547bd96befcc171f1b1e4/users/726d156d269344cc85c7ba1c617c7666/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:01:29.196641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef311d-7383-4dbf-8e63-81e6d4a8c1fb admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:29.215878 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef311d-7383-4dbf-8e63-81e6d4a8c1fb admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:29.293413 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:29.311543 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dda235-daa6-4104-92fd-e00a2f43b579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:29.312711 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dda235-daa6-4104-92fd-e00a2f43b579 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:29.312990 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dda235-daa6-4104-92fd-e00a2f43b579 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:29.313264 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dda235-daa6-4104-92fd-e00a2f43b579 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:29.313922 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dda235-daa6-4104-92fd-e00a2f43b579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:29.315587 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dda235-daa6-4104-92fd-e00a2f43b579 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:29.326955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1274/2546] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:01:29.332130 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3db05-89ae-4686-980e-74aff7c753af admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:29.344971 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3db05-89ae-4686-980e-74aff7c753af admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:29.350895 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e626d-2e7a-4d0d-adec-cde6a01baeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:29.351629 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e626d-2e7a-4d0d-adec-cde6a01baeaa admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:29.351922 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e626d-2e7a-4d0d-adec-cde6a01baeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:29.352202 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e626d-2e7a-4d0d-adec-cde6a01baeaa admin admin] PATH_INFO: `/v3/projects/ba8f9353e06547bd96befcc171f1b1e4/users/726d156d269344cc85c7ba1c617c7666/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:29.354443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e626d-2e7a-4d0d-adec-cde6a01baeaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba8f9353e06547bd96befcc171f1b1e4, user_id=726d156d269344cc85c7ba1c617c7666, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:29.357335 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e626d-2e7a-4d0d-adec-cde6a01baeaa admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:29.371023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1273/2547] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:01:29 2022] PUT /identity/v3/projects/ba8f9353e06547bd96befcc171f1b1e4/users/726d156d269344cc85c7ba1c617c7666/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:01:29.384459 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464142c9-0b52-4e4c-a410-4eba508dc2a6 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:29.384925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464142c9-0b52-4e4c-a410-4eba508dc2a6 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:29.389183 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464142c9-0b52-4e4c-a410-4eba508dc2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:29.425015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-464142c9-0b52-4e4c-a410-4eba508dc2a6 None None] MFA Rules not processed for user `726d156d269344cc85c7ba1c617c7666`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:29.426391 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-464142c9-0b52-4e4c-a410-4eba508dc2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:29.530975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1275/2548] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:01:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:01:29.545338 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e626d-2e7a-4d0d-adec-cde6a01baeaa admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:29.548784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-8a8e626d-2e7a-4d0d-adec-cde6a01baeaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:29.657028 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e626d-2e7a-4d0d-adec-cde6a01baeaa admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:29.663816 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190abbbd-c721-4d8b-be03-aec818f7924c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:29.664833 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190abbbd-c721-4d8b-be03-aec818f7924c service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:29.664833 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190abbbd-c721-4d8b-be03-aec818f7924c service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:29.665117 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190abbbd-c721-4d8b-be03-aec818f7924c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:29.709124 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:29.728404 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190abbbd-c721-4d8b-be03-aec818f7924c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:29.730205 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190abbbd-c721-4d8b-be03-aec818f7924c service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:29.741648 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1274/2549] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:01:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:01:29.784402 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464142c9-0b52-4e4c-a410-4eba508dc2a6 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:29.787132 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-464142c9-0b52-4e4c-a410-4eba508dc2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:29.880582 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464142c9-0b52-4e4c-a410-4eba508dc2a6 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:29.887836 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4afa0-d869-49fa-8f4e-a78ed0a5bb21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:29.888597 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4afa0-d869-49fa-8f4e-a78ed0a5bb21 service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:29.889011 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4afa0-d869-49fa-8f4e-a78ed0a5bb21 service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:29.889401 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4afa0-d869-49fa-8f4e-a78ed0a5bb21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:29.891844 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-d4f4afa0-d869-49fa-8f4e-a78ed0a5bb21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:30.006480 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4afa0-d869-49fa-8f4e-a78ed0a5bb21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:30.012794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4afa0-d869-49fa-8f4e-a78ed0a5bb21 service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:30.027200 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1276/2550] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:01:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:01:33.322210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190abbbd-c721-4d8b-be03-aec818f7924c service cinder] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:33.440463 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190abbbd-c721-4d8b-be03-aec818f7924c service cinder] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:33.447765 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c423675-26e9-4e1e-9385-480b7b6841a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:33.448559 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c423675-26e9-4e1e-9385-480b7b6841a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:33.448884 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c423675-26e9-4e1e-9385-480b7b6841a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:33.449205 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c423675-26e9-4e1e-9385-480b7b6841a3 admin admin] PATH_INFO: `/v3/users/43073a95b4ea41c0bf6f775fd2a388bf` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:33.450656 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c423675-26e9-4e1e-9385-480b7b6841a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43073a95b4ea41c0bf6f775fd2a388bf)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:33.453732 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c423675-26e9-4e1e-9385-480b7b6841a3 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:33.805891 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-4c423675-26e9-4e1e-9385-480b7b6841a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43073a95b4ea41c0bf6f775fd2a388bf'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:33.807145 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-4c423675-26e9-4e1e-9385-480b7b6841a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43073a95b4ea41c0bf6f775fd2a388bf'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:33.825394 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-4c423675-26e9-4e1e-9385-480b7b6841a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43073a95b4ea41c0bf6f775fd2a388bf'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:33.851220 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-4c423675-26e9-4e1e-9385-480b7b6841a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43073a95b4ea41c0bf6f775fd2a388bf'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:33.992611 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-4c423675-26e9-4e1e-9385-480b7b6841a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43073a95b4ea41c0bf6f775fd2a388bf'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:34.001406 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1275/2551] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:01:33 2022] DELETE /identity/v3/users/43073a95b4ea41c0bf6f775fd2a388bf => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:01:34.006137 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe85546-4830-4008-ab84-bec265ff62d6 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:34.007516 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe85546-4830-4008-ab84-bec265ff62d6 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:34.007813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe85546-4830-4008-ab84-bec265ff62d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:34.019995 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:34.037133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-3fe85546-4830-4008-ab84-bec265ff62d6 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:34.039408 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-3fe85546-4830-4008-ab84-bec265ff62d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:34.115389 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1277/2552] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:01:34.133931 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c423675-26e9-4e1e-9385-480b7b6841a3 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:34.136350 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-4c423675-26e9-4e1e-9385-480b7b6841a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:34.216186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c423675-26e9-4e1e-9385-480b7b6841a3 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:34.220917 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25952f56-cd1e-4e17-a751-a3d1cee463aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:34.222471 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25952f56-cd1e-4e17-a751-a3d1cee463aa service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:34.222471 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25952f56-cd1e-4e17-a751-a3d1cee463aa service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:34.222471 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25952f56-cd1e-4e17-a751-a3d1cee463aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:34.232346 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25952f56-cd1e-4e17-a751-a3d1cee463aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:34.234913 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25952f56-cd1e-4e17-a751-a3d1cee463aa service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:34.240811 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:34.246987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1276/2553] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:01:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:01:34.527955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe85546-4830-4008-ab84-bec265ff62d6 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:34.530954 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-3fe85546-4830-4008-ab84-bec265ff62d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:34.557627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe85546-4830-4008-ab84-bec265ff62d6 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:34.564053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685ee8a-52c5-459f-933f-5546f4f8fcb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:34.565688 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685ee8a-52c5-459f-933f-5546f4f8fcb0 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:34.565688 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685ee8a-52c5-459f-933f-5546f4f8fcb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:34.565688 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685ee8a-52c5-459f-933f-5546f4f8fcb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:34.568005 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-e685ee8a-52c5-459f-933f-5546f4f8fcb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:34.590590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685ee8a-52c5-459f-933f-5546f4f8fcb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:34.590590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685ee8a-52c5-459f-933f-5546f4f8fcb0 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:34.598533 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1278/2554] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:01:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:01:35.038546 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25952f56-cd1e-4e17-a751-a3d1cee463aa service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:35.040572 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-25952f56-cd1e-4e17-a751-a3d1cee463aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:35.066072 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25952f56-cd1e-4e17-a751-a3d1cee463aa service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:35.074846 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365ec5f-bf40-449f-832d-6d3fa4838c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:35.079386 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365ec5f-bf40-449f-832d-6d3fa4838c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:35.079386 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365ec5f-bf40-449f-832d-6d3fa4838c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:35.079631 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365ec5f-bf40-449f-832d-6d3fa4838c18 admin admin] PATH_INFO: `/v3/projects/dd24a26115b64b0d8878bc2bf4f11b1c` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:35.081822 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365ec5f-bf40-449f-832d-6d3fa4838c18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd24a26115b64b0d8878bc2bf4f11b1c)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:35.085997 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365ec5f-bf40-449f-832d-6d3fa4838c18 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:35.242825 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-1365ec5f-bf40-449f-832d-6d3fa4838c18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd24a26115b64b0d8878bc2bf4f11b1c', 'request_id': 'req-1365ec5f-bf40-449f-832d-6d3fa4838c18'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:35.255061 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-1365ec5f-bf40-449f-832d-6d3fa4838c18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd24a26115b64b0d8878bc2bf4f11b1c', 'request_id': 'req-1365ec5f-bf40-449f-832d-6d3fa4838c18'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:35.267447 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-1365ec5f-bf40-449f-832d-6d3fa4838c18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd24a26115b64b0d8878bc2bf4f11b1c', 'request_id': 'req-1365ec5f-bf40-449f-832d-6d3fa4838c18'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:35.361310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-1365ec5f-bf40-449f-832d-6d3fa4838c18 admin admin] The token cache is being invalidate because project dd24a26115b64b0d8878bc2bf4f11b1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:01:35.361950 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-1365ec5f-bf40-449f-832d-6d3fa4838c18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:35.363078 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-1365ec5f-bf40-449f-832d-6d3fa4838c18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:35.367066 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1277/2555] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:01:35 2022] DELETE /identity/v3/projects/dd24a26115b64b0d8878bc2bf4f11b1c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:01:35.374482 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685ee8a-52c5-459f-933f-5546f4f8fcb0 service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:35.393968 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685ee8a-52c5-459f-933f-5546f4f8fcb0 service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:35.478136 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0f515-5e2f-4b00-95b7-d6a730eed215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:35.479145 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0f515-5e2f-4b00-95b7-d6a730eed215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:35.479145 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0f515-5e2f-4b00-95b7-d6a730eed215 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:35.479393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0f515-5e2f-4b00-95b7-d6a730eed215 admin admin] PATH_INFO: `/v3/users/726d156d269344cc85c7ba1c617c7666` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:35.480450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0f515-5e2f-4b00-95b7-d6a730eed215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=726d156d269344cc85c7ba1c617c7666)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:35.482507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0f515-5e2f-4b00-95b7-d6a730eed215 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:35.781185 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-37d0f515-5e2f-4b00-95b7-d6a730eed215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '726d156d269344cc85c7ba1c617c7666'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:35.918207 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-37d0f515-5e2f-4b00-95b7-d6a730eed215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '726d156d269344cc85c7ba1c617c7666'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:35.935602 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-37d0f515-5e2f-4b00-95b7-d6a730eed215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '726d156d269344cc85c7ba1c617c7666'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:35.954677 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-37d0f515-5e2f-4b00-95b7-d6a730eed215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '726d156d269344cc85c7ba1c617c7666'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:35.955670 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-37d0f515-5e2f-4b00-95b7-d6a730eed215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '726d156d269344cc85c7ba1c617c7666'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:35.971260 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1279/2556] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:01:35 2022] DELETE /identity/v3/users/726d156d269344cc85c7ba1c617c7666 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:01:36.694327 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365ec5f-bf40-449f-832d-6d3fa4838c18 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:36.697134 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-1365ec5f-bf40-449f-832d-6d3fa4838c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:36.730004 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365ec5f-bf40-449f-832d-6d3fa4838c18 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:36.859076 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab9212-a7f5-4913-a5df-c0a33cafa144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:36.860528 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab9212-a7f5-4913-a5df-c0a33cafa144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:36.861238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab9212-a7f5-4913-a5df-c0a33cafa144 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:36.861734 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab9212-a7f5-4913-a5df-c0a33cafa144 admin admin] PATH_INFO: `/v3/projects/ba8f9353e06547bd96befcc171f1b1e4` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:36.865368 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab9212-a7f5-4913-a5df-c0a33cafa144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba8f9353e06547bd96befcc171f1b1e4)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:36.870544 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab9212-a7f5-4913-a5df-c0a33cafa144 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:37.095721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c9ab9212-a7f5-4913-a5df-c0a33cafa144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba8f9353e06547bd96befcc171f1b1e4', 'request_id': 'req-c9ab9212-a7f5-4913-a5df-c0a33cafa144'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:37.105855 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c9ab9212-a7f5-4913-a5df-c0a33cafa144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba8f9353e06547bd96befcc171f1b1e4', 'request_id': 'req-c9ab9212-a7f5-4913-a5df-c0a33cafa144'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:37.114635 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c9ab9212-a7f5-4913-a5df-c0a33cafa144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba8f9353e06547bd96befcc171f1b1e4', 'request_id': 'req-c9ab9212-a7f5-4913-a5df-c0a33cafa144'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:37.222218 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c9ab9212-a7f5-4913-a5df-c0a33cafa144 admin admin] The token cache is being invalidate because project ba8f9353e06547bd96befcc171f1b1e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:01:37.222504 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c9ab9212-a7f5-4913-a5df-c0a33cafa144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:37.223300 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c9ab9212-a7f5-4913-a5df-c0a33cafa144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:37.225588 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1278/2557] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:01:36 2022] DELETE /identity/v3/projects/ba8f9353e06547bd96befcc171f1b1e4 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:01:37.232340 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b16401-97fc-47b2-ac5e-d9562a536611 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:37.233410 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b16401-97fc-47b2-ac5e-d9562a536611 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:37.233842 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b16401-97fc-47b2-ac5e-d9562a536611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:37.256667 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-d8b16401-97fc-47b2-ac5e-d9562a536611 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:37.258219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-d8b16401-97fc-47b2-ac5e-d9562a536611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:37.269536 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:37.386758 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1280/2558] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:01:37.396410 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af12f8-a819-42c7-848d-dc8cf97e597f None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:37.397158 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af12f8-a819-42c7-848d-dc8cf97e597f None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:37.397695 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af12f8-a819-42c7-848d-dc8cf97e597f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:37.440748 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-b2af12f8-a819-42c7-848d-dc8cf97e597f None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:37.442135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b2af12f8-a819-42c7-848d-dc8cf97e597f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:37.453470 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1279/2559] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:01:37.459446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b16401-97fc-47b2-ac5e-d9562a536611 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:37.473261 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b16401-97fc-47b2-ac5e-d9562a536611 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:37.480589 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a540301-7b52-46c5-b6bb-b6ce79d34013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:37.481215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a540301-7b52-46c5-b6bb-b6ce79d34013 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:37.481507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a540301-7b52-46c5-b6bb-b6ce79d34013 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:37.481762 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a540301-7b52-46c5-b6bb-b6ce79d34013 admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:37.482421 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a540301-7b52-46c5-b6bb-b6ce79d34013 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:01:37.483227 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a540301-7b52-46c5-b6bb-b6ce79d34013 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:37.487838 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a540301-7b52-46c5-b6bb-b6ce79d34013 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:37.502085 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1281/2560] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 14:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 14:01:37.506773 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af12f8-a819-42c7-848d-dc8cf97e597f None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:37.516672 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af12f8-a819-42c7-848d-dc8cf97e597f None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:37.522450 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40149d-20a2-421d-a043-504c65685c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:37.523098 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40149d-20a2-421d-a043-504c65685c17 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:37.523410 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40149d-20a2-421d-a043-504c65685c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:37.523690 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40149d-20a2-421d-a043-504c65685c17 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:37.524328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c40149d-20a2-421d-a043-504c65685c17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:37.526316 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c40149d-20a2-421d-a043-504c65685c17 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:37.531630 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:37.655069 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1280/2561] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:01:37 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:01:37.660992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a540301-7b52-46c5-b6bb-b6ce79d34013 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:37.672013 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a540301-7b52-46c5-b6bb-b6ce79d34013 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:37.809167 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4063b-85dc-4b70-9ed7-a60bc2153612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:37.810101 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4063b-85dc-4b70-9ed7-a60bc2153612 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:37.810384 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4063b-85dc-4b70-9ed7-a60bc2153612 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:37.810655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4063b-85dc-4b70-9ed7-a60bc2153612 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:37.811345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4063b-85dc-4b70-9ed7-a60bc2153612 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:37.814129 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4063b-85dc-4b70-9ed7-a60bc2153612 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:37.939606 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1282/2562] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:01:37 2022] POST /identity/v3/users => generated 287 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:01:37.941151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40149d-20a2-421d-a043-504c65685c17 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:37.964638 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40149d-20a2-421d-a043-504c65685c17 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:37.975584 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66041f95-48de-4e78-9488-37b785290ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:37.976676 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66041f95-48de-4e78-9488-37b785290ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:37.977197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66041f95-48de-4e78-9488-37b785290ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:37.977666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66041f95-48de-4e78-9488-37b785290ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:37.978865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66041f95-48de-4e78-9488-37b785290ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:37.982952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66041f95-48de-4e78-9488-37b785290ef2 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:38.017624 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1281/2563] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:01:38.022617 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4063b-85dc-4b70-9ed7-a60bc2153612 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:38.039239 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4063b-85dc-4b70-9ed7-a60bc2153612 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:38.062110 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a9e1e-dc8d-4a4b-b782-5a1665a1e67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:38.062895 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a9e1e-dc8d-4a4b-b782-5a1665a1e67f admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:38.065056 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a9e1e-dc8d-4a4b-b782-5a1665a1e67f admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:38.065679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a9e1e-dc8d-4a4b-b782-5a1665a1e67f admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:38.068079 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a9e1e-dc8d-4a4b-b782-5a1665a1e67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:38.069885 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a9e1e-dc8d-4a4b-b782-5a1665a1e67f admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:38.104806 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1283/2564] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:01:38.106397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66041f95-48de-4e78-9488-37b785290ef2 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:38.122024 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66041f95-48de-4e78-9488-37b785290ef2 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:38.128563 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec34ec6-0dd3-45e4-a82b-e22cf2fbc3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:38.129325 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec34ec6-0dd3-45e4-a82b-e22cf2fbc3fc admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:38.130214 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec34ec6-0dd3-45e4-a82b-e22cf2fbc3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:38.130214 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec34ec6-0dd3-45e4-a82b-e22cf2fbc3fc admin admin] PATH_INFO: `/v3/projects/e8489f8438e848e096d82516e5c17ee5/users/25778bfb2311462bace331acb24786bc/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:38.161173 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec34ec6-0dd3-45e4-a82b-e22cf2fbc3fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8489f8438e848e096d82516e5c17ee5, user_id=25778bfb2311462bace331acb24786bc, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:38.165898 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec34ec6-0dd3-45e4-a82b-e22cf2fbc3fc admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:38.280219 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1282/2565] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:01:38 2022] PUT /identity/v3/projects/e8489f8438e848e096d82516e5c17ee5/users/25778bfb2311462bace331acb24786bc/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:01:38.299579 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91d426-8c13-4190-b9a2-ccdaf36e4dd4 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:38.300495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91d426-8c13-4190-b9a2-ccdaf36e4dd4 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:38.300839 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91d426-8c13-4190-b9a2-ccdaf36e4dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:38.368054 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-8d91d426-8c13-4190-b9a2-ccdaf36e4dd4 None None] MFA Rules not processed for user `25778bfb2311462bace331acb24786bc`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:38.369590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-8d91d426-8c13-4190-b9a2-ccdaf36e4dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:38.464583 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1284/2566] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:01:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:01:38.481631 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec34ec6-0dd3-45e4-a82b-e22cf2fbc3fc admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:38.485805 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-5ec34ec6-0dd3-45e4-a82b-e22cf2fbc3fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:38.606770 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec34ec6-0dd3-45e4-a82b-e22cf2fbc3fc admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:38.620579 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bd1e7-ced1-421e-ad67-5a3d53aa59e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:38.621287 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bd1e7-ced1-421e-ad67-5a3d53aa59e8 service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:38.621574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bd1e7-ced1-421e-ad67-5a3d53aa59e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:38.621852 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bd1e7-ced1-421e-ad67-5a3d53aa59e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:38.641952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bd1e7-ced1-421e-ad67-5a3d53aa59e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:38.644039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bd1e7-ced1-421e-ad67-5a3d53aa59e8 service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:38.675989 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1283/2567] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:01:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:01:44.907122 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91d426-8c13-4190-b9a2-ccdaf36e4dd4 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:44.909560 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-8d91d426-8c13-4190-b9a2-ccdaf36e4dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:44.916333 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:45.016402 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91d426-8c13-4190-b9a2-ccdaf36e4dd4 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:45.026595 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fae66-b718-4c8b-a7f8-fead01c2838d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e675d44d2c49929feb0ec0d2c0d0eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:45.026595 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fae66-b718-4c8b-a7f8-fead01c2838d service placement] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:45.026595 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fae66-b718-4c8b-a7f8-fead01c2838d service placement] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:45.026595 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fae66-b718-4c8b-a7f8-fead01c2838d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:45.029117 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-471fae66-b718-4c8b-a7f8-fead01c2838d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:45.042135 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471fae66-b718-4c8b-a7f8-fead01c2838d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:45.043981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471fae66-b718-4c8b-a7f8-fead01c2838d service placement] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:45.055606 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1285/2568] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:01:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:01:45.102402 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bd1e7-ced1-421e-ad67-5a3d53aa59e8 service cinder] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:45.104467 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-0f3bd1e7-ced1-421e-ad67-5a3d53aa59e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:45.202719 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bd1e7-ced1-421e-ad67-5a3d53aa59e8 service cinder] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:45.214169 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282aa9e4-b86f-4d02-a312-f054210b07d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:45.214924 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282aa9e4-b86f-4d02-a312-f054210b07d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:45.215210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282aa9e4-b86f-4d02-a312-f054210b07d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:45.215723 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282aa9e4-b86f-4d02-a312-f054210b07d2 admin admin] PATH_INFO: `/v3/users/3043eb81894f4525ac2d153da8bd3e2d` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:45.217385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282aa9e4-b86f-4d02-a312-f054210b07d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3043eb81894f4525ac2d153da8bd3e2d)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:45.219663 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282aa9e4-b86f-4d02-a312-f054210b07d2 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:45.435494 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-282aa9e4-b86f-4d02-a312-f054210b07d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3043eb81894f4525ac2d153da8bd3e2d'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:45.436081 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-282aa9e4-b86f-4d02-a312-f054210b07d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3043eb81894f4525ac2d153da8bd3e2d'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:45.442328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:45.450175 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-282aa9e4-b86f-4d02-a312-f054210b07d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3043eb81894f4525ac2d153da8bd3e2d'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:45.456890 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-282aa9e4-b86f-4d02-a312-f054210b07d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3043eb81894f4525ac2d153da8bd3e2d'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:45.565331 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-282aa9e4-b86f-4d02-a312-f054210b07d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3043eb81894f4525ac2d153da8bd3e2d'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:45.568579 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1284/2569] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:01:45 2022] DELETE /identity/v3/users/3043eb81894f4525ac2d153da8bd3e2d => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:01:45.786085 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fae66-b718-4c8b-a7f8-fead01c2838d service placement] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:45.787562 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-471fae66-b718-4c8b-a7f8-fead01c2838d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:45.863285 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fae66-b718-4c8b-a7f8-fead01c2838d service placement] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:45.914337 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282aa9e4-b86f-4d02-a312-f054210b07d2 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:45.916772 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-282aa9e4-b86f-4d02-a312-f054210b07d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:45.943344 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398290e-73fe-4d6b-9125-4af27d43f298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:45.944084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398290e-73fe-4d6b-9125-4af27d43f298 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:45.944442 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398290e-73fe-4d6b-9125-4af27d43f298 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:45.944891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398290e-73fe-4d6b-9125-4af27d43f298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:45.946903 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-5398290e-73fe-4d6b-9125-4af27d43f298 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:46.024452 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282aa9e4-b86f-4d02-a312-f054210b07d2 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:46.029501 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505389e-b7f8-4689-bfba-e0dbf2f583b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:46.030747 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505389e-b7f8-4689-bfba-e0dbf2f583b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:46.031038 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505389e-b7f8-4689-bfba-e0dbf2f583b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:46.031707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505389e-b7f8-4689-bfba-e0dbf2f583b0 admin admin] PATH_INFO: `/v3/projects/872714a31bdf46ddad040f1bc4b659da` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:46.032990 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6505389e-b7f8-4689-bfba-e0dbf2f583b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=872714a31bdf46ddad040f1bc4b659da)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:46.035211 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6505389e-b7f8-4689-bfba-e0dbf2f583b0 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:46.046272 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398290e-73fe-4d6b-9125-4af27d43f298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:46.048421 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398290e-73fe-4d6b-9125-4af27d43f298 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:46.055402 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:46.061761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1286/2570] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:01:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:01:46.339131 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-6505389e-b7f8-4689-bfba-e0dbf2f583b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '872714a31bdf46ddad040f1bc4b659da', 'request_id': 'req-6505389e-b7f8-4689-bfba-e0dbf2f583b0'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:46.350716 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-6505389e-b7f8-4689-bfba-e0dbf2f583b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '872714a31bdf46ddad040f1bc4b659da', 'request_id': 'req-6505389e-b7f8-4689-bfba-e0dbf2f583b0'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:46.358817 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-6505389e-b7f8-4689-bfba-e0dbf2f583b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '872714a31bdf46ddad040f1bc4b659da', 'request_id': 'req-6505389e-b7f8-4689-bfba-e0dbf2f583b0'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:46.437709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-6505389e-b7f8-4689-bfba-e0dbf2f583b0 admin admin] The token cache is being invalidate because project 872714a31bdf46ddad040f1bc4b659da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:01:46.438030 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-6505389e-b7f8-4689-bfba-e0dbf2f583b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:46.438915 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-6505389e-b7f8-4689-bfba-e0dbf2f583b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:46.440520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1285/2571] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:01:45 2022] DELETE /identity/v3/projects/872714a31bdf46ddad040f1bc4b659da => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:01:46.444732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398290e-73fe-4d6b-9125-4af27d43f298 service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:46.458335 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398290e-73fe-4d6b-9125-4af27d43f298 service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:46.548947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e3d14-6490-4532-a918-cbd65fc8ac79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:46.549758 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e3d14-6490-4532-a918-cbd65fc8ac79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:46.550061 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e3d14-6490-4532-a918-cbd65fc8ac79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:46.550338 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e3d14-6490-4532-a918-cbd65fc8ac79 admin admin] PATH_INFO: `/v3/users/1a69b859cc0c41e0aaae8bbce7d58d89` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:46.551860 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e3d14-6490-4532-a918-cbd65fc8ac79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a69b859cc0c41e0aaae8bbce7d58d89)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:46.553815 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e3d14-6490-4532-a918-cbd65fc8ac79 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:46.762102 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-2e0e3d14-6490-4532-a918-cbd65fc8ac79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a69b859cc0c41e0aaae8bbce7d58d89'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:46.877460 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-2e0e3d14-6490-4532-a918-cbd65fc8ac79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a69b859cc0c41e0aaae8bbce7d58d89'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:46.887743 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-2e0e3d14-6490-4532-a918-cbd65fc8ac79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a69b859cc0c41e0aaae8bbce7d58d89'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:46.900592 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-2e0e3d14-6490-4532-a918-cbd65fc8ac79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a69b859cc0c41e0aaae8bbce7d58d89'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:46.901620 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-2e0e3d14-6490-4532-a918-cbd65fc8ac79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a69b859cc0c41e0aaae8bbce7d58d89'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:46.912714 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1287/2572] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:01:46 2022] DELETE /identity/v3/users/1a69b859cc0c41e0aaae8bbce7d58d89 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:01:47.296186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505389e-b7f8-4689-bfba-e0dbf2f583b0 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:47.301485 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-6505389e-b7f8-4689-bfba-e0dbf2f583b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:47.371107 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505389e-b7f8-4689-bfba-e0dbf2f583b0 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:47.458444 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a931e4-b35d-46fe-9dd7-f7b5f5675f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:47.459151 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a931e4-b35d-46fe-9dd7-f7b5f5675f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:47.459674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a931e4-b35d-46fe-9dd7-f7b5f5675f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:47.460050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a931e4-b35d-46fe-9dd7-f7b5f5675f24 admin admin] PATH_INFO: `/v3/projects/6c80f23011f04608902d314b8d462128` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:47.461384 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a931e4-b35d-46fe-9dd7-f7b5f5675f24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c80f23011f04608902d314b8d462128)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:47.463724 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a931e4-b35d-46fe-9dd7-f7b5f5675f24 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:47.467098 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:47.575714 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98786c3-718c-4784-88a1-d8641a334a70 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:47.576255 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98786c3-718c-4784-88a1-d8641a334a70 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:47.576628 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98786c3-718c-4784-88a1-d8641a334a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:47.598175 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-75a931e4-b35d-46fe-9dd7-f7b5f5675f24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c80f23011f04608902d314b8d462128', 'request_id': 'req-75a931e4-b35d-46fe-9dd7-f7b5f5675f24'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:47.605530 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-75a931e4-b35d-46fe-9dd7-f7b5f5675f24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c80f23011f04608902d314b8d462128', 'request_id': 'req-75a931e4-b35d-46fe-9dd7-f7b5f5675f24'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:47.613635 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-75a931e4-b35d-46fe-9dd7-f7b5f5675f24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c80f23011f04608902d314b8d462128', 'request_id': 'req-75a931e4-b35d-46fe-9dd7-f7b5f5675f24'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:47.627102 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-c98786c3-718c-4784-88a1-d8641a334a70 None None] MFA Rules not processed for user `6f01578bf21244a5ac357e54979ffc0d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:47.628471 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c98786c3-718c-4784-88a1-d8641a334a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:47.683276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-75a931e4-b35d-46fe-9dd7-f7b5f5675f24 admin admin] The token cache is being invalidate because project 6c80f23011f04608902d314b8d462128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:01:47.683622 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-75a931e4-b35d-46fe-9dd7-f7b5f5675f24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:47.684393 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-75a931e4-b35d-46fe-9dd7-f7b5f5675f24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:47.687346 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1286/2573] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:01:47 2022] DELETE /identity/v3/projects/6c80f23011f04608902d314b8d462128 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:01:47.726149 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1288/2574] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 1 14:01:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:01:47.967060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a931e4-b35d-46fe-9dd7-f7b5f5675f24 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:47.969222 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-75a931e4-b35d-46fe-9dd7-f7b5f5675f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:48.066988 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a931e4-b35d-46fe-9dd7-f7b5f5675f24 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:48.072233 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cb360-7048-4967-bd31-e25fef2ca70c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bbede0f8674384bcc3028ea77eb724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:48.072855 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cb360-7048-4967-bd31-e25fef2ca70c service swift] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:48.073311 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cb360-7048-4967-bd31-e25fef2ca70c service swift] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:48.073438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cb360-7048-4967-bd31-e25fef2ca70c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:48.082556 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790cb360-7048-4967-bd31-e25fef2ca70c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:48.084870 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790cb360-7048-4967-bd31-e25fef2ca70c service swift] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:48.094438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1287/2575] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 1 14:01:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 14:01:51.113977 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98786c3-718c-4784-88a1-d8641a334a70 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:51.115577 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c98786c3-718c-4784-88a1-d8641a334a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:51.165479 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:51.239955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98786c3-718c-4784-88a1-d8641a334a70 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:51.246201 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d020c-7a36-4cb6-ab51-fdbb2965ac01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:51.246853 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d020c-7a36-4cb6-ab51-fdbb2965ac01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:51.255448 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d020c-7a36-4cb6-ab51-fdbb2965ac01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:51.255448 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d020c-7a36-4cb6-ab51-fdbb2965ac01 admin admin] PATH_INFO: `/v3/users/e35ebc3dbc1f4f348f97041627fc68b9` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:51.255448 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d020c-7a36-4cb6-ab51-fdbb2965ac01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e35ebc3dbc1f4f348f97041627fc68b9)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:51.255448 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d020c-7a36-4cb6-ab51-fdbb2965ac01 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:51.482654 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cb360-7048-4967-bd31-e25fef2ca70c service swift] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:51.484802 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-790cb360-7048-4967-bd31-e25fef2ca70c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:51.499476 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cb360-7048-4967-bd31-e25fef2ca70c service swift] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:51.503998 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6acc0f-cdaa-4ea6-a788-d17c5b6ce939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:51.504621 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6acc0f-cdaa-4ea6-a788-d17c5b6ce939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:51.504899 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6acc0f-cdaa-4ea6-a788-d17c5b6ce939 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:51.505173 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6acc0f-cdaa-4ea6-a788-d17c5b6ce939 admin admin] PATH_INFO: `/v3/users/25778bfb2311462bace331acb24786bc` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:51.506289 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6acc0f-cdaa-4ea6-a788-d17c5b6ce939 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25778bfb2311462bace331acb24786bc)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:51.508242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6acc0f-cdaa-4ea6-a788-d17c5b6ce939 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:51.991333 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-420d020c-7a36-4cb6-ab51-fdbb2965ac01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e35ebc3dbc1f4f348f97041627fc68b9'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:52.141376 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-420d020c-7a36-4cb6-ab51-fdbb2965ac01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e35ebc3dbc1f4f348f97041627fc68b9'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:52.149210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-2b6acc0f-cdaa-4ea6-a788-d17c5b6ce939 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25778bfb2311462bace331acb24786bc'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:52.150219 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-2b6acc0f-cdaa-4ea6-a788-d17c5b6ce939 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25778bfb2311462bace331acb24786bc'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:52.150455 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-420d020c-7a36-4cb6-ab51-fdbb2965ac01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e35ebc3dbc1f4f348f97041627fc68b9'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:52.165131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-420d020c-7a36-4cb6-ab51-fdbb2965ac01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e35ebc3dbc1f4f348f97041627fc68b9'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:52.165385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-2b6acc0f-cdaa-4ea6-a788-d17c5b6ce939 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25778bfb2311462bace331acb24786bc'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:52.166014 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-420d020c-7a36-4cb6-ab51-fdbb2965ac01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e35ebc3dbc1f4f348f97041627fc68b9'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:52.172846 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-2b6acc0f-cdaa-4ea6-a788-d17c5b6ce939 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25778bfb2311462bace331acb24786bc'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:52.173506 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1289/2576] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:01:51 2022] DELETE /identity/v3/users/e35ebc3dbc1f4f348f97041627fc68b9 => generated 0 bytes in 1060 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:01:52.175941 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:52.294509 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-2b6acc0f-cdaa-4ea6-a788-d17c5b6ce939 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25778bfb2311462bace331acb24786bc'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:52.317083 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1288/2577] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:01:51 2022] DELETE /identity/v3/users/25778bfb2311462bace331acb24786bc => generated 0 bytes in 832 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:01:52.318884 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80dd85-58b6-4648-aa91-8c1b20ce05b1 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:52.319343 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80dd85-58b6-4648-aa91-8c1b20ce05b1 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:52.319651 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80dd85-58b6-4648-aa91-8c1b20ce05b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:52.349938 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-ea80dd85-58b6-4648-aa91-8c1b20ce05b1 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:52.352154 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ea80dd85-58b6-4648-aa91-8c1b20ce05b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:52.480463 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1290/2578] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:01:52.481598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6acc0f-cdaa-4ea6-a788-d17c5b6ce939 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:52.487471 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-2b6acc0f-cdaa-4ea6-a788-d17c5b6ce939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:52.634422 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80dd85-58b6-4648-aa91-8c1b20ce05b1 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:52.636330 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ea80dd85-58b6-4648-aa91-8c1b20ce05b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:52.686916 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80dd85-58b6-4648-aa91-8c1b20ce05b1 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:52.706319 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e7e98-6cd6-4cfc-945a-2f7cd845f960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:52.711538 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e7e98-6cd6-4cfc-945a-2f7cd845f960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:52.711538 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e7e98-6cd6-4cfc-945a-2f7cd845f960 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:52.711538 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e7e98-6cd6-4cfc-945a-2f7cd845f960 admin admin] PATH_INFO: `/v3/projects/b0d00b24399a40d2b070bfd90e73f407` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:52.712193 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e7e98-6cd6-4cfc-945a-2f7cd845f960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0d00b24399a40d2b070bfd90e73f407)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:52.712699 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6acc0f-cdaa-4ea6-a788-d17c5b6ce939 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:52.714632 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e7e98-6cd6-4cfc-945a-2f7cd845f960 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:52.716873 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b6352-aa64-4f1c-b168-cbdbd577bfe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:52.717612 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b6352-aa64-4f1c-b168-cbdbd577bfe6 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:52.721459 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b6352-aa64-4f1c-b168-cbdbd577bfe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:52.721902 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b6352-aa64-4f1c-b168-cbdbd577bfe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:52.734925 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b6352-aa64-4f1c-b168-cbdbd577bfe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:52.736670 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b6352-aa64-4f1c-b168-cbdbd577bfe6 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:52.750353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1289/2579] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:01:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:01:52.892055 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:52.901369 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-759e7e98-6cd6-4cfc-945a-2f7cd845f960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0d00b24399a40d2b070bfd90e73f407', 'request_id': 'req-759e7e98-6cd6-4cfc-945a-2f7cd845f960'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:52.910551 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-759e7e98-6cd6-4cfc-945a-2f7cd845f960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0d00b24399a40d2b070bfd90e73f407', 'request_id': 'req-759e7e98-6cd6-4cfc-945a-2f7cd845f960'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:52.986218 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-759e7e98-6cd6-4cfc-945a-2f7cd845f960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0d00b24399a40d2b070bfd90e73f407', 'request_id': 'req-759e7e98-6cd6-4cfc-945a-2f7cd845f960'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:53.002196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-759e7e98-6cd6-4cfc-945a-2f7cd845f960 admin admin] The token cache is being invalidate because project b0d00b24399a40d2b070bfd90e73f407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:01:53.002655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-759e7e98-6cd6-4cfc-945a-2f7cd845f960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:53.003525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-759e7e98-6cd6-4cfc-945a-2f7cd845f960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:53.005875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1291/2580] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:01:52 2022] DELETE /identity/v3/projects/b0d00b24399a40d2b070bfd90e73f407 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:01:53.012655 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfbd12-b11b-4b23-9740-be70564dad3d None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:53.013209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfbd12-b11b-4b23-9740-be70564dad3d None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:53.013944 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfbd12-b11b-4b23-9740-be70564dad3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:53.060699 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-28cfbd12-b11b-4b23-9740-be70564dad3d None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:53.065975 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-28cfbd12-b11b-4b23-9740-be70564dad3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:53.171835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1290/2581] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:01:53.185277 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac1d19-174b-44da-b6e9-b85edb43767f None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:53.191644 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac1d19-174b-44da-b6e9-b85edb43767f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:53.191644 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac1d19-174b-44da-b6e9-b85edb43767f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:53.225852 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-eaac1d19-174b-44da-b6e9-b85edb43767f None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:53.228169 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-eaac1d19-174b-44da-b6e9-b85edb43767f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:53.251784 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1292/2582] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:01:53.254744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfbd12-b11b-4b23-9740-be70564dad3d None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:53.271388 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfbd12-b11b-4b23-9740-be70564dad3d None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:53.278846 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a4031-3e70-4c6d-8034-73ebedf23214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:53.280361 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a4031-3e70-4c6d-8034-73ebedf23214 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:53.280840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a4031-3e70-4c6d-8034-73ebedf23214 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:53.281239 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a4031-3e70-4c6d-8034-73ebedf23214 admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:53.282307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a4031-3e70-4c6d-8034-73ebedf23214 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:01:53.282791 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a4031-3e70-4c6d-8034-73ebedf23214 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:53.285507 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a4031-3e70-4c6d-8034-73ebedf23214 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:53.310173 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1291/2583] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 14:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:01:53.317297 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac1d19-174b-44da-b6e9-b85edb43767f None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:53.349390 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac1d19-174b-44da-b6e9-b85edb43767f None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:53.359310 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abf0df-c509-4b59-b11f-4318fc739273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:53.360493 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abf0df-c509-4b59-b11f-4318fc739273 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:53.360973 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abf0df-c509-4b59-b11f-4318fc739273 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:53.361910 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abf0df-c509-4b59-b11f-4318fc739273 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:53.363670 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abf0df-c509-4b59-b11f-4318fc739273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:53.368258 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abf0df-c509-4b59-b11f-4318fc739273 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:53.377334 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a4031-3e70-4c6d-8034-73ebedf23214 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:53.383768 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-4d7a4031-3e70-4c6d-8034-73ebedf23214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:53.421568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a4031-3e70-4c6d-8034-73ebedf23214 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:53.431634 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972eed94-c454-470e-8b00-c91b8d3dc3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:53.432867 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eed94-c454-470e-8b00-c91b8d3dc3c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:53.433290 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eed94-c454-470e-8b00-c91b8d3dc3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:53.434079 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eed94-c454-470e-8b00-c91b8d3dc3c0 admin admin] PATH_INFO: `/v3/projects/e8489f8438e848e096d82516e5c17ee5` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:53.439088 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972eed94-c454-470e-8b00-c91b8d3dc3c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8489f8438e848e096d82516e5c17ee5)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:53.442541 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972eed94-c454-470e-8b00-c91b8d3dc3c0 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:53.519614 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1293/2584] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:01:53 2022] POST /identity/v3/projects => generated 369 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:01:53.521000 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abf0df-c509-4b59-b11f-4318fc739273 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:53.640269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-972eed94-c454-470e-8b00-c91b8d3dc3c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8489f8438e848e096d82516e5c17ee5', 'request_id': 'req-972eed94-c454-470e-8b00-c91b8d3dc3c0'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:53.666693 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-972eed94-c454-470e-8b00-c91b8d3dc3c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8489f8438e848e096d82516e5c17ee5', 'request_id': 'req-972eed94-c454-470e-8b00-c91b8d3dc3c0'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:53.685336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abf0df-c509-4b59-b11f-4318fc739273 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:53.695918 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-972eed94-c454-470e-8b00-c91b8d3dc3c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8489f8438e848e096d82516e5c17ee5', 'request_id': 'req-972eed94-c454-470e-8b00-c91b8d3dc3c0'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:53.807350 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4902fe0-b2ab-4859-bef6-d9ef6fe6f2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:53.809093 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4902fe0-b2ab-4859-bef6-d9ef6fe6f2e1 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:53.809824 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4902fe0-b2ab-4859-bef6-d9ef6fe6f2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:53.811182 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4902fe0-b2ab-4859-bef6-d9ef6fe6f2e1 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:53.812608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4902fe0-b2ab-4859-bef6-d9ef6fe6f2e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:53.831911 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-972eed94-c454-470e-8b00-c91b8d3dc3c0 admin admin] The token cache is being invalidate because project e8489f8438e848e096d82516e5c17ee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:01:53.832585 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-972eed94-c454-470e-8b00-c91b8d3dc3c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:53.833770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4902fe0-b2ab-4859-bef6-d9ef6fe6f2e1 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:53.836318 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-972eed94-c454-470e-8b00-c91b8d3dc3c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:01:53.839757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1292/2585] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:01:53 2022] DELETE /identity/v3/projects/e8489f8438e848e096d82516e5c17ee5 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:01:53.847676 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7902f08-8fab-4715-8ea6-206eabf98ab3 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:53.848212 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7902f08-8fab-4715-8ea6-206eabf98ab3 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:53.848683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7902f08-8fab-4715-8ea6-206eabf98ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:53.877890 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:53.885261 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-b7902f08-8fab-4715-8ea6-206eabf98ab3 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:53.887190 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b7902f08-8fab-4715-8ea6-206eabf98ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:53.897569 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1293/2586] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:01:53.915853 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69336f9f-e399-4e1c-ab54-062e83ecbc86 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:53.916149 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69336f9f-e399-4e1c-ab54-062e83ecbc86 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:53.916436 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69336f9f-e399-4e1c-ab54-062e83ecbc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:53.943807 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-69336f9f-e399-4e1c-ab54-062e83ecbc86 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:53.945280 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-69336f9f-e399-4e1c-ab54-062e83ecbc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:53.960010 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1294/2587] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:01:53.966339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69336f9f-e399-4e1c-ab54-062e83ecbc86 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:53.983765 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69336f9f-e399-4e1c-ab54-062e83ecbc86 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:53.991855 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1294/2588] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:01:53 2022] POST /identity/v3/users => generated 285 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:01:53.992326 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080262ab-b4be-416b-b1c4-52ffff36f8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:53.993069 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080262ab-b4be-416b-b1c4-52ffff36f8be admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:53.993495 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080262ab-b4be-416b-b1c4-52ffff36f8be admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:53.993776 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080262ab-b4be-416b-b1c4-52ffff36f8be admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:53.994742 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080262ab-b4be-416b-b1c4-52ffff36f8be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:01:53.995010 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4902fe0-b2ab-4859-bef6-d9ef6fe6f2e1 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:53.995186 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080262ab-b4be-416b-b1c4-52ffff36f8be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:53.997591 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a4902fe0-b2ab-4859-bef6-d9ef6fe6f2e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:53.998322 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080262ab-b4be-416b-b1c4-52ffff36f8be admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:54.018936 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1295/2589] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 14:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 14:01:54.022023 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4902fe0-b2ab-4859-bef6-d9ef6fe6f2e1 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:54.030364 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080262ab-b4be-416b-b1c4-52ffff36f8be admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:54.033739 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fa64e-e40d-4fe9-b888-d4f1e68d2c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:54.034512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fa64e-e40d-4fe9-b888-d4f1e68d2c9d admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:54.034924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fa64e-e40d-4fe9-b888-d4f1e68d2c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:54.035350 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fa64e-e40d-4fe9-b888-d4f1e68d2c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:54.036372 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00fa64e-e40d-4fe9-b888-d4f1e68d2c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:54.040837 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00fa64e-e40d-4fe9-b888-d4f1e68d2c9d admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:54.047573 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080262ab-b4be-416b-b1c4-52ffff36f8be admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:54.062755 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070205b-b57d-4e18-b187-0ed25a35ff6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:54.063959 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070205b-b57d-4e18-b187-0ed25a35ff6c admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:54.064271 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070205b-b57d-4e18-b187-0ed25a35ff6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:54.064550 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070205b-b57d-4e18-b187-0ed25a35ff6c admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:54.065199 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070205b-b57d-4e18-b187-0ed25a35ff6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:54.069737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1295/2590] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:01:54.069917 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070205b-b57d-4e18-b187-0ed25a35ff6c admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:54.070794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fa64e-e40d-4fe9-b888-d4f1e68d2c9d admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:54.093109 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fa64e-e40d-4fe9-b888-d4f1e68d2c9d admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:54.103135 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd232e-b8d9-415d-9367-29c669a0727f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:54.103987 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd232e-b8d9-415d-9367-29c669a0727f admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:54.104395 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd232e-b8d9-415d-9367-29c669a0727f admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:54.104732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd232e-b8d9-415d-9367-29c669a0727f admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:54.105535 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd232e-b8d9-415d-9367-29c669a0727f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:54.107282 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd232e-b8d9-415d-9367-29c669a0727f admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:54.123705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1296/2591] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:01:54.129136 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd232e-b8d9-415d-9367-29c669a0727f admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:54.151703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd232e-b8d9-415d-9367-29c669a0727f admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:54.164426 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc208ec0-aa41-4945-a0e4-1e1ca8202f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:54.165742 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc208ec0-aa41-4945-a0e4-1e1ca8202f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:54.166310 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc208ec0-aa41-4945-a0e4-1e1ca8202f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:54.166912 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc208ec0-aa41-4945-a0e4-1e1ca8202f83 admin admin] PATH_INFO: `/v3/projects/c2b45cee67854a2ea38b2575c58380f5/users/dc2244b277494c00b4ea4cc7c0c8c6cb/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:54.191352 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:54.198247 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc208ec0-aa41-4945-a0e4-1e1ca8202f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2b45cee67854a2ea38b2575c58380f5, user_id=dc2244b277494c00b4ea4cc7c0c8c6cb, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:54.201261 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1296/2592] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:01:54 2022] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:01:54.207008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070205b-b57d-4e18-b187-0ed25a35ff6c admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:54.207997 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc208ec0-aa41-4945-a0e4-1e1ca8202f83 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:54.300143 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070205b-b57d-4e18-b187-0ed25a35ff6c admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:54.308335 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b58a4-a138-4a68-abbd-dd956eb23bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:54.309447 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b58a4-a138-4a68-abbd-dd956eb23bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:54.310314 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b58a4-a138-4a68-abbd-dd956eb23bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:54.311557 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b58a4-a138-4a68-abbd-dd956eb23bb4 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:54.311788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b58a4-a138-4a68-abbd-dd956eb23bb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:54.315466 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b58a4-a138-4a68-abbd-dd956eb23bb4 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:54.335142 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1297/2593] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:01:54 2022] PUT /identity/v3/projects/c2b45cee67854a2ea38b2575c58380f5/users/dc2244b277494c00b4ea4cc7c0c8c6cb/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:01:54.338228 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701b283-de3e-4fbd-a755-74c56879ba49 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:54.338595 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701b283-de3e-4fbd-a755-74c56879ba49 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:54.338945 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701b283-de3e-4fbd-a755-74c56879ba49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:54.373766 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-3701b283-de3e-4fbd-a755-74c56879ba49 None None] MFA Rules not processed for user `dc2244b277494c00b4ea4cc7c0c8c6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:54.375143 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-3701b283-de3e-4fbd-a755-74c56879ba49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:54.417223 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1297/2594] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:01:54 2022] POST /identity/v3/users => generated 288 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:01:54.421070 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b58a4-a138-4a68-abbd-dd956eb23bb4 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:54.434507 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b58a4-a138-4a68-abbd-dd956eb23bb4 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:54.460861 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1298/2595] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:01:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:01:54.461937 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701b283-de3e-4fbd-a755-74c56879ba49 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:54.514183 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b9e82-7e01-447b-ae4e-4fd24660d20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:54.515617 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b9e82-7e01-447b-ae4e-4fd24660d20a admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:54.517608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b9e82-7e01-447b-ae4e-4fd24660d20a admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:54.517806 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b9e82-7e01-447b-ae4e-4fd24660d20a admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:54.518593 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b9e82-7e01-447b-ae4e-4fd24660d20a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:54.520475 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b9e82-7e01-447b-ae4e-4fd24660d20a admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:54.533166 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1298/2596] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:01:54.536929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b9e82-7e01-447b-ae4e-4fd24660d20a admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:54.551875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b9e82-7e01-447b-ae4e-4fd24660d20a admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:54.557265 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc88f5c-9bb0-4d11-ba19-78790c58a78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:54.557974 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc88f5c-9bb0-4d11-ba19-78790c58a78e admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:54.559131 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc88f5c-9bb0-4d11-ba19-78790c58a78e admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:54.559131 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc88f5c-9bb0-4d11-ba19-78790c58a78e admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:54.559663 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc88f5c-9bb0-4d11-ba19-78790c58a78e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:54.562077 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc88f5c-9bb0-4d11-ba19-78790c58a78e admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:54.571292 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701b283-de3e-4fbd-a755-74c56879ba49 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:54.583443 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8cebc-c97b-41f7-9b85-63e5d694f7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:54.584510 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8cebc-c97b-41f7-9b85-63e5d694f7d7 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:54.584721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1299/2597] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:01:54.585247 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8cebc-c97b-41f7-9b85-63e5d694f7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:54.585533 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8cebc-c97b-41f7-9b85-63e5d694f7d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:54.586228 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8cebc-c97b-41f7-9b85-63e5d694f7d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:54.588316 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8cebc-c97b-41f7-9b85-63e5d694f7d7 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:54.588740 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc88f5c-9bb0-4d11-ba19-78790c58a78e admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:54.601524 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc88f5c-9bb0-4d11-ba19-78790c58a78e admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:54.608639 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4981e-748b-4fa9-b6cd-8b305dff5e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:54.609772 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4981e-748b-4fa9-b6cd-8b305dff5e46 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:54.610527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4981e-748b-4fa9-b6cd-8b305dff5e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:54.610937 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4981e-748b-4fa9-b6cd-8b305dff5e46 admin admin] PATH_INFO: `/v3/projects/d5f855115eba40748db48675c0a6e4f1/users/7f99cc2b4bc34d67aa65b16ad8b47f1a/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:54.633542 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4981e-748b-4fa9-b6cd-8b305dff5e46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5f855115eba40748db48675c0a6e4f1, user_id=7f99cc2b4bc34d67aa65b16ad8b47f1a, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:54.636466 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4981e-748b-4fa9-b6cd-8b305dff5e46 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:54.702220 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1299/2598] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:01:54 2022] POST /identity/v3/projects => generated 369 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:01:54.707886 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8cebc-c97b-41f7-9b85-63e5d694f7d7 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:54.734193 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1300/2599] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:01:54 2022] PUT /identity/v3/projects/d5f855115eba40748db48675c0a6e4f1/users/7f99cc2b4bc34d67aa65b16ad8b47f1a/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:01:54.748215 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff20b1-b7b6-407c-8af2-a24a9c7b18db None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:54.749144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff20b1-b7b6-407c-8af2-a24a9c7b18db None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:54.749554 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff20b1-b7b6-407c-8af2-a24a9c7b18db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:54.773712 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:54.783985 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-84ff20b1-b7b6-407c-8af2-a24a9c7b18db None None] MFA Rules not processed for user `7f99cc2b4bc34d67aa65b16ad8b47f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:54.785741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-84ff20b1-b7b6-407c-8af2-a24a9c7b18db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:54.808413 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8cebc-c97b-41f7-9b85-63e5d694f7d7 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:54.820672 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:54.891177 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1301/2600] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:01:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:01:54.904907 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff20b1-b7b6-407c-8af2-a24a9c7b18db None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:54.906473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-84ff20b1-b7b6-407c-8af2-a24a9c7b18db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:54.935016 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559be7f-f9ec-4aa6-b4f7-a4202ab9d37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:54.937046 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559be7f-f9ec-4aa6-b4f7-a4202ab9d37d admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:54.937796 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559be7f-f9ec-4aa6-b4f7-a4202ab9d37d admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:54.938862 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559be7f-f9ec-4aa6-b4f7-a4202ab9d37d admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:54.940489 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559be7f-f9ec-4aa6-b4f7-a4202ab9d37d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:54.946270 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559be7f-f9ec-4aa6-b4f7-a4202ab9d37d admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:55.004715 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff20b1-b7b6-407c-8af2-a24a9c7b18db None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:55.009618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c089f4f-2ae7-4d3f-a9ba-07ece81a34d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:55.010486 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c089f4f-2ae7-4d3f-a9ba-07ece81a34d4 service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:55.010998 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c089f4f-2ae7-4d3f-a9ba-07ece81a34d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:55.011523 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c089f4f-2ae7-4d3f-a9ba-07ece81a34d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:55.024361 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c089f4f-2ae7-4d3f-a9ba-07ece81a34d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:55.026117 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c089f4f-2ae7-4d3f-a9ba-07ece81a34d4 service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:55.048941 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1302/2601] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:01:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:01:55.118928 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1300/2602] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:01:54 2022] POST /identity/v3/users => generated 291 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:01:55.119150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c089f4f-2ae7-4d3f-a9ba-07ece81a34d4 service cinder] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:55.135414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c089f4f-2ae7-4d3f-a9ba-07ece81a34d4 service cinder] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:55.147213 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14bf6f-0033-4986-9173-625c96045c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:55.148487 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14bf6f-0033-4986-9173-625c96045c8c admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:55.149007 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14bf6f-0033-4986-9173-625c96045c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:55.149372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14bf6f-0033-4986-9173-625c96045c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:55.150193 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d14bf6f-0033-4986-9173-625c96045c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:55.152325 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d14bf6f-0033-4986-9173-625c96045c8c admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:55.174290 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1303/2603] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:01:55.176659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559be7f-f9ec-4aa6-b4f7-a4202ab9d37d admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:55.189093 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559be7f-f9ec-4aa6-b4f7-a4202ab9d37d admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:55.197055 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001f1b1-f1e6-4c72-b88f-99c96e6d7f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:55.199850 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001f1b1-f1e6-4c72-b88f-99c96e6d7f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:55.200374 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001f1b1-f1e6-4c72-b88f-99c96e6d7f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:55.204512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001f1b1-f1e6-4c72-b88f-99c96e6d7f8b admin admin] PATH_INFO: `/v3/projects/17ac8a0821404269af4fea86be68ea4a/users/349e54ccedff4509a0d4e468bc1ddb78/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:55.234958 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001f1b1-f1e6-4c72-b88f-99c96e6d7f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=17ac8a0821404269af4fea86be68ea4a, user_id=349e54ccedff4509a0d4e468bc1ddb78, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:55.238629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001f1b1-f1e6-4c72-b88f-99c96e6d7f8b admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:55.365148 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1301/2604] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:01:55 2022] PUT /identity/v3/projects/17ac8a0821404269af4fea86be68ea4a/users/349e54ccedff4509a0d4e468bc1ddb78/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:01:55.369536 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14bf6f-0033-4986-9173-625c96045c8c admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:55.381209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14bf6f-0033-4986-9173-625c96045c8c admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:55.475408 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f23b71-32c3-4c62-92ad-118969d1e532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:55.477512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f23b71-32c3-4c62-92ad-118969d1e532 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:55.478020 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f23b71-32c3-4c62-92ad-118969d1e532 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:55.478613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f23b71-32c3-4c62-92ad-118969d1e532 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:55.480047 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f23b71-32c3-4c62-92ad-118969d1e532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:55.483548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f23b71-32c3-4c62-92ad-118969d1e532 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:55.499553 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1304/2605] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:01:55.504316 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001f1b1-f1e6-4c72-b88f-99c96e6d7f8b admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:55.515131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001f1b1-f1e6-4c72-b88f-99c96e6d7f8b admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:55.542931 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbc854-9f3d-44dd-b358-51a3932306f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:55.542931 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbc854-9f3d-44dd-b358-51a3932306f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:55.542931 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbc854-9f3d-44dd-b358-51a3932306f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:55.542931 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbc854-9f3d-44dd-b358-51a3932306f8 admin admin] PATH_INFO: `/v3/projects/17ac8a0821404269af4fea86be68ea4a/users/349e54ccedff4509a0d4e468bc1ddb78/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:55.543384 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbc854-9f3d-44dd-b358-51a3932306f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17ac8a0821404269af4fea86be68ea4a, user_id=349e54ccedff4509a0d4e468bc1ddb78, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:55.543384 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbc854-9f3d-44dd-b358-51a3932306f8 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:55.543384 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1302/2606] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:01:55 2022] PUT /identity/v3/projects/17ac8a0821404269af4fea86be68ea4a/users/349e54ccedff4509a0d4e468bc1ddb78/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:01:55.552786 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba311ed-9bf2-4d16-b09a-42cf47b4e649 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:55.553073 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba311ed-9bf2-4d16-b09a-42cf47b4e649 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:55.553353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba311ed-9bf2-4d16-b09a-42cf47b4e649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:55.584854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-fba311ed-9bf2-4d16-b09a-42cf47b4e649 None None] MFA Rules not processed for user `349e54ccedff4509a0d4e468bc1ddb78`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:55.586085 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-fba311ed-9bf2-4d16-b09a-42cf47b4e649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:55.604568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:55.703143 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1305/2607] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:01:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:01:55.717070 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbc854-9f3d-44dd-b358-51a3932306f8 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:55.719734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-63dbc854-9f3d-44dd-b358-51a3932306f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:55.797418 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbc854-9f3d-44dd-b358-51a3932306f8 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:55.802640 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d05b3d-04d9-4ff1-b3a6-2d1fbd0e818d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:55.803538 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d05b3d-04d9-4ff1-b3a6-2d1fbd0e818d service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:55.803850 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d05b3d-04d9-4ff1-b3a6-2d1fbd0e818d service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:55.804125 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d05b3d-04d9-4ff1-b3a6-2d1fbd0e818d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:55.813758 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d05b3d-04d9-4ff1-b3a6-2d1fbd0e818d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:55.815345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d05b3d-04d9-4ff1-b3a6-2d1fbd0e818d service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:55.825534 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1303/2608] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:01:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:01:57.447518 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151690b2-7880-42a7-9340-9d522d39060a None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:57.448446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151690b2-7880-42a7-9340-9d522d39060a None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:57.448908 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151690b2-7880-42a7-9340-9d522d39060a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:57.479789 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-151690b2-7880-42a7-9340-9d522d39060a None None] MFA Rules not processed for user `7f99cc2b4bc34d67aa65b16ad8b47f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:57.481518 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-151690b2-7880-42a7-9340-9d522d39060a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:57.570446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1306/2609] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:01:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:00.008605 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d05b3d-04d9-4ff1-b3a6-2d1fbd0e818d service cinder] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:00.085761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d05b3d-04d9-4ff1-b3a6-2d1fbd0e818d service cinder] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:00.092453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ff819-9dcd-4b84-8f9a-ac31e97ef15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:00.093123 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ff819-9dcd-4b84-8f9a-ac31e97ef15c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:00.093403 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ff819-9dcd-4b84-8f9a-ac31e97ef15c admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:00.093734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ff819-9dcd-4b84-8f9a-ac31e97ef15c admin admin] PATH_INFO: `/v3/users/dc2244b277494c00b4ea4cc7c0c8c6cb` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:00.094921 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ff819-9dcd-4b84-8f9a-ac31e97ef15c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc2244b277494c00b4ea4cc7c0c8c6cb)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:00.096883 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ff819-9dcd-4b84-8f9a-ac31e97ef15c admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:00.108088 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:00.315704 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-0f4ff819-9dcd-4b84-8f9a-ac31e97ef15c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc2244b277494c00b4ea4cc7c0c8c6cb'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:00.459227 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-0f4ff819-9dcd-4b84-8f9a-ac31e97ef15c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc2244b277494c00b4ea4cc7c0c8c6cb'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:00.470031 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-0f4ff819-9dcd-4b84-8f9a-ac31e97ef15c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc2244b277494c00b4ea4cc7c0c8c6cb'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:00.505590 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-0f4ff819-9dcd-4b84-8f9a-ac31e97ef15c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc2244b277494c00b4ea4cc7c0c8c6cb'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:00.506873 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-0f4ff819-9dcd-4b84-8f9a-ac31e97ef15c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc2244b277494c00b4ea4cc7c0c8c6cb'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:00.517387 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1304/2610] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:02:00 2022] DELETE /identity/v3/users/dc2244b277494c00b4ea4cc7c0c8c6cb => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:02:00.520688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a651fc4-78b6-47ad-b0c7-278866a4c6a4 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:00.521997 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a651fc4-78b6-47ad-b0c7-278866a4c6a4 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:00.522534 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a651fc4-78b6-47ad-b0c7-278866a4c6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:00.550347 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-4a651fc4-78b6-47ad-b0c7-278866a4c6a4 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:00.552041 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-4a651fc4-78b6-47ad-b0c7-278866a4c6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:00.667562 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1307/2611] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:00.687432 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ff819-9dcd-4b84-8f9a-ac31e97ef15c admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:00.687432 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-0f4ff819-9dcd-4b84-8f9a-ac31e97ef15c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:00.779237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ff819-9dcd-4b84-8f9a-ac31e97ef15c admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:00.784208 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd553d2-0a49-43be-9ac6-c8f2bb3c31fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:00.784834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd553d2-0a49-43be-9ac6-c8f2bb3c31fd service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:00.785115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd553d2-0a49-43be-9ac6-c8f2bb3c31fd service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:00.785386 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd553d2-0a49-43be-9ac6-c8f2bb3c31fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:00.795964 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd553d2-0a49-43be-9ac6-c8f2bb3c31fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:00.797419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd553d2-0a49-43be-9ac6-c8f2bb3c31fd service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:00.809945 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1305/2612] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:02:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:02:01.393702 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a651fc4-78b6-47ad-b0c7-278866a4c6a4 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:01.396719 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-4a651fc4-78b6-47ad-b0c7-278866a4c6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:01.417209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a651fc4-78b6-47ad-b0c7-278866a4c6a4 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:01.422976 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97dc3eb-1616-464c-802e-ffb96e24ecd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:01.423679 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dc3eb-1616-464c-802e-ffb96e24ecd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:01.423962 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dc3eb-1616-464c-802e-ffb96e24ecd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:01.424313 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dc3eb-1616-464c-802e-ffb96e24ecd3 admin admin] PATH_INFO: `/v3/projects/c2b45cee67854a2ea38b2575c58380f5` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:01.425548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97dc3eb-1616-464c-802e-ffb96e24ecd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2b45cee67854a2ea38b2575c58380f5)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:01.427619 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97dc3eb-1616-464c-802e-ffb96e24ecd3 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:01.543614 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f97dc3eb-1616-464c-802e-ffb96e24ecd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2b45cee67854a2ea38b2575c58380f5', 'request_id': 'req-f97dc3eb-1616-464c-802e-ffb96e24ecd3'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:01.545989 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:01.551911 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f97dc3eb-1616-464c-802e-ffb96e24ecd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2b45cee67854a2ea38b2575c58380f5', 'request_id': 'req-f97dc3eb-1616-464c-802e-ffb96e24ecd3'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:01.559321 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f97dc3eb-1616-464c-802e-ffb96e24ecd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2b45cee67854a2ea38b2575c58380f5', 'request_id': 'req-f97dc3eb-1616-464c-802e-ffb96e24ecd3'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:01.638021 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f97dc3eb-1616-464c-802e-ffb96e24ecd3 admin admin] The token cache is being invalidate because project c2b45cee67854a2ea38b2575c58380f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:02:01.638315 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f97dc3eb-1616-464c-802e-ffb96e24ecd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:01.639594 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-f97dc3eb-1616-464c-802e-ffb96e24ecd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:01.641233 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1308/2613] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:02:01 2022] DELETE /identity/v3/projects/c2b45cee67854a2ea38b2575c58380f5 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:02:01.645541 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd553d2-0a49-43be-9ac6-c8f2bb3c31fd service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:01.656469 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd553d2-0a49-43be-9ac6-c8f2bb3c31fd service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:01.718772 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafcd17-c206-47c6-89e6-72222e258494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:01.719447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafcd17-c206-47c6-89e6-72222e258494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:01.719730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafcd17-c206-47c6-89e6-72222e258494 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:01.720004 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafcd17-c206-47c6-89e6-72222e258494 admin admin] PATH_INFO: `/v3/users/349e54ccedff4509a0d4e468bc1ddb78` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:01.721173 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfafcd17-c206-47c6-89e6-72222e258494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=349e54ccedff4509a0d4e468bc1ddb78)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:01.723232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfafcd17-c206-47c6-89e6-72222e258494 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:02.023420 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:02.047106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dfafcd17-c206-47c6-89e6-72222e258494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '349e54ccedff4509a0d4e468bc1ddb78'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:02.140961 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dfafcd17-c206-47c6-89e6-72222e258494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '349e54ccedff4509a0d4e468bc1ddb78'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:02.157222 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dfafcd17-c206-47c6-89e6-72222e258494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '349e54ccedff4509a0d4e468bc1ddb78'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:02.186481 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dfafcd17-c206-47c6-89e6-72222e258494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '349e54ccedff4509a0d4e468bc1ddb78'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:02.187374 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dfafcd17-c206-47c6-89e6-72222e258494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '349e54ccedff4509a0d4e468bc1ddb78'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:02.198913 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1306/2614] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:02:01 2022] DELETE /identity/v3/users/349e54ccedff4509a0d4e468bc1ddb78 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:02:03.099879 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97dc3eb-1616-464c-802e-ffb96e24ecd3 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:03.102103 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-f97dc3eb-1616-464c-802e-ffb96e24ecd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:03.117346 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97dc3eb-1616-464c-802e-ffb96e24ecd3 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:03.207058 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad56f90-1515-453b-8431-6c3250f42a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:03.208196 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad56f90-1515-453b-8431-6c3250f42a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:03.208685 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad56f90-1515-453b-8431-6c3250f42a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:03.209207 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad56f90-1515-453b-8431-6c3250f42a80 admin admin] PATH_INFO: `/v3/projects/17ac8a0821404269af4fea86be68ea4a` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:03.211540 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad56f90-1515-453b-8431-6c3250f42a80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17ac8a0821404269af4fea86be68ea4a)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:03.215046 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad56f90-1515-453b-8431-6c3250f42a80 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:03.365100 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-dad56f90-1515-453b-8431-6c3250f42a80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17ac8a0821404269af4fea86be68ea4a', 'request_id': 'req-dad56f90-1515-453b-8431-6c3250f42a80'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:03.374654 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-dad56f90-1515-453b-8431-6c3250f42a80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17ac8a0821404269af4fea86be68ea4a', 'request_id': 'req-dad56f90-1515-453b-8431-6c3250f42a80'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:03.382115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-dad56f90-1515-453b-8431-6c3250f42a80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17ac8a0821404269af4fea86be68ea4a', 'request_id': 'req-dad56f90-1515-453b-8431-6c3250f42a80'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:03.477594 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-dad56f90-1515-453b-8431-6c3250f42a80 admin admin] The token cache is being invalidate because project 17ac8a0821404269af4fea86be68ea4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:02:03.481494 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-dad56f90-1515-453b-8431-6c3250f42a80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:03.481494 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-dad56f90-1515-453b-8431-6c3250f42a80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:03.481494 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1309/2615] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:02:03 2022] DELETE /identity/v3/projects/17ac8a0821404269af4fea86be68ea4a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:02:03.486245 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079bc4d-d5ab-4cdf-a851-7ef52e3420e9 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:03.486823 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079bc4d-d5ab-4cdf-a851-7ef52e3420e9 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:03.486953 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079bc4d-d5ab-4cdf-a851-7ef52e3420e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:03.511151 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-7079bc4d-d5ab-4cdf-a851-7ef52e3420e9 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:03.512716 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-7079bc4d-d5ab-4cdf-a851-7ef52e3420e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:03.595061 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1307/2616] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:03.605417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180f87f-eb4a-474b-910c-9e5dccbde07f None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:03.605752 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180f87f-eb4a-474b-910c-9e5dccbde07f None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:03.606077 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180f87f-eb4a-474b-910c-9e5dccbde07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:03.629760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-8180f87f-eb4a-474b-910c-9e5dccbde07f None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:03.631181 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-8180f87f-eb4a-474b-910c-9e5dccbde07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:03.640314 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1310/2617] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:03.645630 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079bc4d-d5ab-4cdf-a851-7ef52e3420e9 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:03.657947 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079bc4d-d5ab-4cdf-a851-7ef52e3420e9 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:03.662934 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1af4a-3120-4986-9360-f8a3b7540a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:03.663588 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1af4a-3120-4986-9360-f8a3b7540a98 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:03.663867 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1af4a-3120-4986-9360-f8a3b7540a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:03.668342 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1af4a-3120-4986-9360-f8a3b7540a98 admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:03.668342 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1af4a-3120-4986-9360-f8a3b7540a98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:02:03.668342 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1af4a-3120-4986-9360-f8a3b7540a98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:03.668342 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1af4a-3120-4986-9360-f8a3b7540a98 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:03.682209 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1308/2618] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 14:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:02:03.686997 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180f87f-eb4a-474b-910c-9e5dccbde07f None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:03.697287 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180f87f-eb4a-474b-910c-9e5dccbde07f None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:03.702311 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d24f4-2ed1-4f2f-9404-c45f04204165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:03.702930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d24f4-2ed1-4f2f-9404-c45f04204165 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:03.703501 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d24f4-2ed1-4f2f-9404-c45f04204165 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:03.703501 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d24f4-2ed1-4f2f-9404-c45f04204165 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:03.704149 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d24f4-2ed1-4f2f-9404-c45f04204165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:03.706168 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d24f4-2ed1-4f2f-9404-c45f04204165 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:03.822903 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1311/2619] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:02:03 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:02:03.827205 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1af4a-3120-4986-9360-f8a3b7540a98 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:03.839142 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1af4a-3120-4986-9360-f8a3b7540a98 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:03.914966 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c75e6-ae2d-4c64-a94e-43a71de9eee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:03.915910 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c75e6-ae2d-4c64-a94e-43a71de9eee5 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:03.916473 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c75e6-ae2d-4c64-a94e-43a71de9eee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:03.916975 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c75e6-ae2d-4c64-a94e-43a71de9eee5 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:03.917934 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c75e6-ae2d-4c64-a94e-43a71de9eee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:03.927595 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c75e6-ae2d-4c64-a94e-43a71de9eee5 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:04.085615 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1309/2620] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:02:03 2022] POST /identity/v3/users => generated 294 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:02:04.091250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d24f4-2ed1-4f2f-9404-c45f04204165 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:04.103113 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d24f4-2ed1-4f2f-9404-c45f04204165 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:04.108238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3f855-9b3c-46b2-b60b-68007d65f70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:04.108855 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3f855-9b3c-46b2-b60b-68007d65f70e admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:04.109141 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3f855-9b3c-46b2-b60b-68007d65f70e admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:04.109407 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3f855-9b3c-46b2-b60b-68007d65f70e admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:04.110111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3f855-9b3c-46b2-b60b-68007d65f70e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:04.112097 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3f855-9b3c-46b2-b60b-68007d65f70e admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:04.123847 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1312/2621] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:02:04.128605 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c75e6-ae2d-4c64-a94e-43a71de9eee5 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:04.143113 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c75e6-ae2d-4c64-a94e-43a71de9eee5 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:04.150841 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166af9dc-fba2-4a03-a732-957f0f505390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:04.151956 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166af9dc-fba2-4a03-a732-957f0f505390 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:04.152339 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166af9dc-fba2-4a03-a732-957f0f505390 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:04.152787 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166af9dc-fba2-4a03-a732-957f0f505390 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:04.153886 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166af9dc-fba2-4a03-a732-957f0f505390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:04.156434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166af9dc-fba2-4a03-a732-957f0f505390 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:04.180111 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1310/2622] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:02:04.185729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3f855-9b3c-46b2-b60b-68007d65f70e admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:04.199796 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3f855-9b3c-46b2-b60b-68007d65f70e admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:04.205343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d5f03-541c-4766-a4d0-e0ebdc785986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:04.206015 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d5f03-541c-4766-a4d0-e0ebdc785986 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:04.206294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d5f03-541c-4766-a4d0-e0ebdc785986 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:04.206569 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d5f03-541c-4766-a4d0-e0ebdc785986 admin admin] PATH_INFO: `/v3/projects/711cade737f846a4ad8641f8dc37e73a/users/4768ee61e2bd412cb0527cd60ee9dfd8/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:04.226124 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d5f03-541c-4766-a4d0-e0ebdc785986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=711cade737f846a4ad8641f8dc37e73a, user_id=4768ee61e2bd412cb0527cd60ee9dfd8, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:04.229568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d5f03-541c-4766-a4d0-e0ebdc785986 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:04.335276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1313/2623] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:02:04 2022] PUT /identity/v3/projects/711cade737f846a4ad8641f8dc37e73a/users/4768ee61e2bd412cb0527cd60ee9dfd8/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:02:04.346568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fa8cf-5f56-4176-9be9-f805694c8fc8 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:04.346787 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fa8cf-5f56-4176-9be9-f805694c8fc8 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:04.347017 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fa8cf-5f56-4176-9be9-f805694c8fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:04.374066 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:04.377285 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-957fa8cf-5f56-4176-9be9-f805694c8fc8 None None] MFA Rules not processed for user `4768ee61e2bd412cb0527cd60ee9dfd8`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:04.378510 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-957fa8cf-5f56-4176-9be9-f805694c8fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:04.450985 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1311/2624] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:02:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:04.456463 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d5f03-541c-4766-a4d0-e0ebdc785986 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:04.465922 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:04.527247 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d5f03-541c-4766-a4d0-e0ebdc785986 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:04.532081 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb362ecb-fe1b-4dd7-a3f0-adde9a6f0820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:04.532742 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb362ecb-fe1b-4dd7-a3f0-adde9a6f0820 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:04.533023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb362ecb-fe1b-4dd7-a3f0-adde9a6f0820 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:04.533294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb362ecb-fe1b-4dd7-a3f0-adde9a6f0820 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:04.533932 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb362ecb-fe1b-4dd7-a3f0-adde9a6f0820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:04.535999 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb362ecb-fe1b-4dd7-a3f0-adde9a6f0820 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:04.637534 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1314/2625] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:02:04 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:02:04.643720 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fa8cf-5f56-4176-9be9-f805694c8fc8 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:04.659577 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fa8cf-5f56-4176-9be9-f805694c8fc8 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:04.730909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c93f39-34a1-4cb6-aaf1-e94194233eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:04.731755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c93f39-34a1-4cb6-aaf1-e94194233eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:04.732119 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c93f39-34a1-4cb6-aaf1-e94194233eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:04.733075 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c93f39-34a1-4cb6-aaf1-e94194233eb0 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:04.733916 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c93f39-34a1-4cb6-aaf1-e94194233eb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:04.736781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c93f39-34a1-4cb6-aaf1-e94194233eb0 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:05.000540 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1312/2626] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:02:04 2022] POST /identity/v3/users => generated 293 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:02:05.004936 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb362ecb-fe1b-4dd7-a3f0-adde9a6f0820 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:05.015956 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb362ecb-fe1b-4dd7-a3f0-adde9a6f0820 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:05.026597 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782fefe5-4cf8-44e7-b837-b38aab3d9b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:05.027422 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fefe5-4cf8-44e7-b837-b38aab3d9b47 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:05.027711 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fefe5-4cf8-44e7-b837-b38aab3d9b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:05.028021 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fefe5-4cf8-44e7-b837-b38aab3d9b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:05.028702 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782fefe5-4cf8-44e7-b837-b38aab3d9b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:05.030931 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782fefe5-4cf8-44e7-b837-b38aab3d9b47 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:05.043691 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1315/2627] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:02:05.049791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c93f39-34a1-4cb6-aaf1-e94194233eb0 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:05.062786 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c93f39-34a1-4cb6-aaf1-e94194233eb0 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:05.069841 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431b581-ca2e-4dc2-bb5b-e8f2200a46ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:05.070516 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431b581-ca2e-4dc2-bb5b-e8f2200a46ba admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:05.070826 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431b581-ca2e-4dc2-bb5b-e8f2200a46ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:05.071125 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431b581-ca2e-4dc2-bb5b-e8f2200a46ba admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:05.072236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431b581-ca2e-4dc2-bb5b-e8f2200a46ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:05.074115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431b581-ca2e-4dc2-bb5b-e8f2200a46ba admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:05.091864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1313/2628] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:02:05.093904 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782fefe5-4cf8-44e7-b837-b38aab3d9b47 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:05.108831 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782fefe5-4cf8-44e7-b837-b38aab3d9b47 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:05.118487 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cf3e0-cd07-427a-8129-d81b17878ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:05.119656 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cf3e0-cd07-427a-8129-d81b17878ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:05.120441 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cf3e0-cd07-427a-8129-d81b17878ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:05.120946 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cf3e0-cd07-427a-8129-d81b17878ee4 admin admin] PATH_INFO: `/v3/projects/44a98099122a478b935d729b66fe814f/users/b30c8102d75a4095891dd3894f13f1db/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:05.144200 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9cf3e0-cd07-427a-8129-d81b17878ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44a98099122a478b935d729b66fe814f, user_id=b30c8102d75a4095891dd3894f13f1db, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:05.149966 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9cf3e0-cd07-427a-8129-d81b17878ee4 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:05.226936 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1316/2629] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:02:05 2022] PUT /identity/v3/projects/44a98099122a478b935d729b66fe814f/users/b30c8102d75a4095891dd3894f13f1db/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:02:05.238533 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0309632-9518-4de5-b1eb-3e9863436594 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:05.244064 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0309632-9518-4de5-b1eb-3e9863436594 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:05.244064 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0309632-9518-4de5-b1eb-3e9863436594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:05.278636 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-a0309632-9518-4de5-b1eb-3e9863436594 None None] MFA Rules not processed for user `b30c8102d75a4095891dd3894f13f1db`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:05.280445 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a0309632-9518-4de5-b1eb-3e9863436594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:05.386436 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1314/2630] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:02:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:02:05.388399 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cf3e0-cd07-427a-8129-d81b17878ee4 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:05.483152 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cf3e0-cd07-427a-8129-d81b17878ee4 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:05.489370 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed2813-c513-4d43-825b-581e940c6e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:05.489995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed2813-c513-4d43-825b-581e940c6e91 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:05.490275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed2813-c513-4d43-825b-581e940c6e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:05.490551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed2813-c513-4d43-825b-581e940c6e91 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:05.491194 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed2813-c513-4d43-825b-581e940c6e91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:05.493199 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed2813-c513-4d43-825b-581e940c6e91 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:05.599970 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1317/2631] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:02:05 2022] POST /identity/v3/projects => generated 387 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:02:05.605047 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0309632-9518-4de5-b1eb-3e9863436594 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:05.616366 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0309632-9518-4de5-b1eb-3e9863436594 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:05.625006 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:05.687423 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d82a3-aef8-4268-a09e-f9a1c0b13290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:05.688491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d82a3-aef8-4268-a09e-f9a1c0b13290 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:05.689168 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d82a3-aef8-4268-a09e-f9a1c0b13290 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:05.689669 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d82a3-aef8-4268-a09e-f9a1c0b13290 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:05.691163 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d82a3-aef8-4268-a09e-f9a1c0b13290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:05.694932 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d82a3-aef8-4268-a09e-f9a1c0b13290 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:05.870497 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1315/2632] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:02:05 2022] POST /identity/v3/users => generated 300 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:02:05.871887 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed2813-c513-4d43-825b-581e940c6e91 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:05.885205 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed2813-c513-4d43-825b-581e940c6e91 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:05.891229 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256dbec8-51e3-4984-8771-dc0997a05c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:05.891976 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256dbec8-51e3-4984-8771-dc0997a05c8f admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:05.892246 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256dbec8-51e3-4984-8771-dc0997a05c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:05.892522 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256dbec8-51e3-4984-8771-dc0997a05c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:05.893230 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256dbec8-51e3-4984-8771-dc0997a05c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:05.894858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256dbec8-51e3-4984-8771-dc0997a05c8f admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:05.912723 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1318/2633] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:02:05.915533 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d82a3-aef8-4268-a09e-f9a1c0b13290 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:05.925877 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d82a3-aef8-4268-a09e-f9a1c0b13290 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:05.934036 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f8c3f-09be-49cf-ad63-daa28616a2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:05.936337 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f8c3f-09be-49cf-ad63-daa28616a2b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:05.937133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f8c3f-09be-49cf-ad63-daa28616a2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:05.937811 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f8c3f-09be-49cf-ad63-daa28616a2b3 admin admin] PATH_INFO: `/v3/projects/06d7f2fd29e24b9d94e580799b0444fa/users/9eeec5d90f4b4194a389442c612589e9/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:05.969491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f8c3f-09be-49cf-ad63-daa28616a2b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d7f2fd29e24b9d94e580799b0444fa, user_id=9eeec5d90f4b4194a389442c612589e9, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:05.974870 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f8c3f-09be-49cf-ad63-daa28616a2b3 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:06.062415 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1316/2634] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:02:05 2022] PUT /identity/v3/projects/06d7f2fd29e24b9d94e580799b0444fa/users/9eeec5d90f4b4194a389442c612589e9/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:02:06.068814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256dbec8-51e3-4984-8771-dc0997a05c8f admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:06.080695 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256dbec8-51e3-4984-8771-dc0997a05c8f admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:06.126404 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:06.171283 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072c130-e6e4-491f-9a0d-934dd19ed9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:06.171955 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072c130-e6e4-491f-9a0d-934dd19ed9ec admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:06.172230 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072c130-e6e4-491f-9a0d-934dd19ed9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:06.172517 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072c130-e6e4-491f-9a0d-934dd19ed9ec admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:06.173327 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072c130-e6e4-491f-9a0d-934dd19ed9ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:06.174990 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072c130-e6e4-491f-9a0d-934dd19ed9ec admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:06.186957 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1319/2635] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:02:06.193057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f8c3f-09be-49cf-ad63-daa28616a2b3 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:06.212680 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f8c3f-09be-49cf-ad63-daa28616a2b3 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:06.219923 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d41626-d971-449e-8bf6-3b24816000be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:06.220838 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d41626-d971-449e-8bf6-3b24816000be admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:06.221284 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d41626-d971-449e-8bf6-3b24816000be admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:06.221659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d41626-d971-449e-8bf6-3b24816000be admin admin] PATH_INFO: `/v3/projects/06d7f2fd29e24b9d94e580799b0444fa/users/9eeec5d90f4b4194a389442c612589e9/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:06.225032 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d41626-d971-449e-8bf6-3b24816000be admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d7f2fd29e24b9d94e580799b0444fa, user_id=9eeec5d90f4b4194a389442c612589e9, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:06.227969 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d41626-d971-449e-8bf6-3b24816000be admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:06.245057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1317/2636] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:02:06 2022] PUT /identity/v3/projects/06d7f2fd29e24b9d94e580799b0444fa/users/9eeec5d90f4b4194a389442c612589e9/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:02:06.257890 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb435ccb-69d3-4f53-be19-f58965432d62 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:06.258573 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb435ccb-69d3-4f53-be19-f58965432d62 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:06.259068 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb435ccb-69d3-4f53-be19-f58965432d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:06.292001 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-fb435ccb-69d3-4f53-be19-f58965432d62 None None] MFA Rules not processed for user `9eeec5d90f4b4194a389442c612589e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:06.293234 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-fb435ccb-69d3-4f53-be19-f58965432d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:06.376929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1320/2637] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:02:06 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:06.387783 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d41626-d971-449e-8bf6-3b24816000be admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:06.389534 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-76d41626-d971-449e-8bf6-3b24816000be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:06.469478 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d41626-d971-449e-8bf6-3b24816000be admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:06.473610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c259f6-d75f-4de3-969e-a1447430af2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:06.474243 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c259f6-d75f-4de3-969e-a1447430af2d service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:06.474594 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c259f6-d75f-4de3-969e-a1447430af2d service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:06.474802 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c259f6-d75f-4de3-969e-a1447430af2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:06.490196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c259f6-d75f-4de3-969e-a1447430af2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:06.495539 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c259f6-d75f-4de3-969e-a1447430af2d service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:06.522921 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1318/2638] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:02:06 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:02:08.080408 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb435ccb-69d3-4f53-be19-f58965432d62 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:08.081894 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-fb435ccb-69d3-4f53-be19-f58965432d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:08.094372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb435ccb-69d3-4f53-be19-f58965432d62 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:08.097969 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adba181-2750-43c2-819e-34d9901504e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:08.098653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adba181-2750-43c2-819e-34d9901504e4 service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:08.098941 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adba181-2750-43c2-819e-34d9901504e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:08.099212 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adba181-2750-43c2-819e-34d9901504e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:08.171153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adba181-2750-43c2-819e-34d9901504e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:08.173895 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adba181-2750-43c2-819e-34d9901504e4 service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:08.189168 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1321/2639] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:02:08 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:02:09.370162 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca73df6-61a0-43f7-a580-77f12523e6ce None None] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:09.371044 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca73df6-61a0-43f7-a580-77f12523e6ce None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:09.371044 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca73df6-61a0-43f7-a580-77f12523e6ce None None] PATH_INFO: `/` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:09.372265 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1319/2640] 10.222.0.50 () {54 vars in 921 bytes} [Thu Sep 1 14:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:02:09.382556 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190c3c2-db33-45cf-985e-0fe353c81e29 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:09.383426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190c3c2-db33-45cf-985e-0fe353c81e29 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:09.383426 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190c3c2-db33-45cf-985e-0fe353c81e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:09.405304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-5190c3c2-db33-45cf-985e-0fe353c81e29 None None] MFA Rules not processed for user `2d231136bcd44d9a97efe6c257f936ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:09.406584 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-5190c3c2-db33-45cf-985e-0fe353c81e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:09.475450 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:09.503026 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1322/2641] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Sep 1 14:02:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:02:09.514948 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca73df6-61a0-43f7-a580-77f12523e6ce None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:09.517056 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-5ca73df6-61a0-43f7-a580-77f12523e6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:09.583504 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca73df6-61a0-43f7-a580-77f12523e6ce None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:09.587084 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50e0b6-724c-4776-88c7-cdc3990b4d47 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc11fe25135d4bf1b1a06b8619e4a2e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:09.587732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50e0b6-724c-4776-88c7-cdc3990b4d47 service glance] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:09.588014 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50e0b6-724c-4776-88c7-cdc3990b4d47 service glance] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:09.588289 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50e0b6-724c-4776-88c7-cdc3990b4d47 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:09.599685 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50e0b6-724c-4776-88c7-cdc3990b4d47 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:09.601134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50e0b6-724c-4776-88c7-cdc3990b4d47 service glance] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:09.613967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1320/2642] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:02:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:02:13.269232 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704546b-b797-4b08-a459-5d718a83d647 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:13.269835 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704546b-b797-4b08-a459-5d718a83d647 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:13.269927 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704546b-b797-4b08-a459-5d718a83d647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:13.302503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-1704546b-b797-4b08-a459-5d718a83d647 None None] MFA Rules not processed for user `6f01578bf21244a5ac357e54979ffc0d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:13.304352 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-1704546b-b797-4b08-a459-5d718a83d647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:13.426374 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1323/2643] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 1 14:02:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:13.439921 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50e0b6-724c-4776-88c7-cdc3990b4d47 service glance] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:13.442283 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ce50e0b6-724c-4776-88c7-cdc3990b4d47 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:13.463667 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:13.618932 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50e0b6-724c-4776-88c7-cdc3990b4d47 service glance] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:13.629917 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb19de5-4067-4e29-9ca4-9e04d0f35e84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bbede0f8674384bcc3028ea77eb724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:13.631968 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb19de5-4067-4e29-9ca4-9e04d0f35e84 service swift] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:13.632272 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb19de5-4067-4e29-9ca4-9e04d0f35e84 service swift] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:13.632536 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb19de5-4067-4e29-9ca4-9e04d0f35e84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:13.632863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704546b-b797-4b08-a459-5d718a83d647 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:13.644869 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb19de5-4067-4e29-9ca4-9e04d0f35e84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:13.646016 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb19de5-4067-4e29-9ca4-9e04d0f35e84 service swift] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:13.651661 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704546b-b797-4b08-a459-5d718a83d647 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:13.660033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc0b9c-a3b2-4e12-83ce-188a1717d5f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:13.660737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1321/2644] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 1 14:02:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 14:02:13.661631 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc0b9c-a3b2-4e12-83ce-188a1717d5f5 service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:13.665180 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc0b9c-a3b2-4e12-83ce-188a1717d5f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:13.665180 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc0b9c-a3b2-4e12-83ce-188a1717d5f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:13.744122 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc0b9c-a3b2-4e12-83ce-188a1717d5f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:13.745567 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc0b9c-a3b2-4e12-83ce-188a1717d5f5 service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:13.756115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1324/2645] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:02:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:02:18.997080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb19de5-4067-4e29-9ca4-9e04d0f35e84 service swift] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:19.150602 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb19de5-4067-4e29-9ca4-9e04d0f35e84 service swift] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:19.165206 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed45a4d-e774-42c2-816c-7cec8d5ac49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:19.168843 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed45a4d-e774-42c2-816c-7cec8d5ac49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:19.168843 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed45a4d-e774-42c2-816c-7cec8d5ac49e admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:19.168843 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed45a4d-e774-42c2-816c-7cec8d5ac49e admin admin] PATH_INFO: `/v3/users/4768ee61e2bd412cb0527cd60ee9dfd8` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:19.168843 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed45a4d-e774-42c2-816c-7cec8d5ac49e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4768ee61e2bd412cb0527cd60ee9dfd8)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:19.170738 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed45a4d-e774-42c2-816c-7cec8d5ac49e admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:19.416356 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-4ed45a4d-e774-42c2-816c-7cec8d5ac49e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4768ee61e2bd412cb0527cd60ee9dfd8'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:19.426453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:19.518266 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-4ed45a4d-e774-42c2-816c-7cec8d5ac49e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4768ee61e2bd412cb0527cd60ee9dfd8'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:19.530015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-4ed45a4d-e774-42c2-816c-7cec8d5ac49e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4768ee61e2bd412cb0527cd60ee9dfd8'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:19.548312 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-4ed45a4d-e774-42c2-816c-7cec8d5ac49e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4768ee61e2bd412cb0527cd60ee9dfd8'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:19.549670 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-4ed45a4d-e774-42c2-816c-7cec8d5ac49e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4768ee61e2bd412cb0527cd60ee9dfd8'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:19.563323 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1322/2646] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:02:18 2022] DELETE /identity/v3/users/4768ee61e2bd412cb0527cd60ee9dfd8 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:02:19.566301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e705e-d5c4-4fba-9a41-59c2d67252a4 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:19.566872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e705e-d5c4-4fba-9a41-59c2d67252a4 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:19.567277 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e705e-d5c4-4fba-9a41-59c2d67252a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:19.662363 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-437e705e-d5c4-4fba-9a41-59c2d67252a4 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:19.666095 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-437e705e-d5c4-4fba-9a41-59c2d67252a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:19.725377 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:19.787221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1325/2647] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:19.795218 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed45a4d-e774-42c2-816c-7cec8d5ac49e admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:19.797040 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-4ed45a4d-e774-42c2-816c-7cec8d5ac49e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:19.885155 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed45a4d-e774-42c2-816c-7cec8d5ac49e admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:19.889960 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce31aa-6d23-4f3b-bcb7-5573781714de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:19.890581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce31aa-6d23-4f3b-bcb7-5573781714de service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:19.890859 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce31aa-6d23-4f3b-bcb7-5573781714de service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:19.891126 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce31aa-6d23-4f3b-bcb7-5573781714de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:19.908909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce31aa-6d23-4f3b-bcb7-5573781714de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:19.912466 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce31aa-6d23-4f3b-bcb7-5573781714de service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:19.926825 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1323/2648] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:02:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:02:20.635719 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e705e-d5c4-4fba-9a41-59c2d67252a4 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:20.639311 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-437e705e-d5c4-4fba-9a41-59c2d67252a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:20.663925 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e705e-d5c4-4fba-9a41-59c2d67252a4 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:20.672665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4d79a-e512-4e1f-b3c6-cf9de3a452e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:20.673472 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4d79a-e512-4e1f-b3c6-cf9de3a452e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:20.674876 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4d79a-e512-4e1f-b3c6-cf9de3a452e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:20.675173 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4d79a-e512-4e1f-b3c6-cf9de3a452e3 admin admin] PATH_INFO: `/v3/projects/711cade737f846a4ad8641f8dc37e73a` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:20.678531 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4d79a-e512-4e1f-b3c6-cf9de3a452e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=711cade737f846a4ad8641f8dc37e73a)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:20.680679 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4d79a-e512-4e1f-b3c6-cf9de3a452e3 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:20.892689 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-5ad4d79a-e512-4e1f-b3c6-cf9de3a452e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '711cade737f846a4ad8641f8dc37e73a', 'request_id': 'req-5ad4d79a-e512-4e1f-b3c6-cf9de3a452e3'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:20.902549 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-5ad4d79a-e512-4e1f-b3c6-cf9de3a452e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '711cade737f846a4ad8641f8dc37e73a', 'request_id': 'req-5ad4d79a-e512-4e1f-b3c6-cf9de3a452e3'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:20.940854 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-5ad4d79a-e512-4e1f-b3c6-cf9de3a452e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '711cade737f846a4ad8641f8dc37e73a', 'request_id': 'req-5ad4d79a-e512-4e1f-b3c6-cf9de3a452e3'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:21.026350 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-5ad4d79a-e512-4e1f-b3c6-cf9de3a452e3 admin admin] The token cache is being invalidate because project 711cade737f846a4ad8641f8dc37e73a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:02:21.026623 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-5ad4d79a-e512-4e1f-b3c6-cf9de3a452e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:21.027445 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-5ad4d79a-e512-4e1f-b3c6-cf9de3a452e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:21.029507 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1326/2649] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:02:20 2022] DELETE /identity/v3/projects/711cade737f846a4ad8641f8dc37e73a => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:02:21.034192 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce31aa-6d23-4f3b-bcb7-5573781714de service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:21.047967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce31aa-6d23-4f3b-bcb7-5573781714de service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:21.120375 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb41dc-a245-4127-a9eb-7952f4074951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:21.121175 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb41dc-a245-4127-a9eb-7952f4074951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:21.121522 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb41dc-a245-4127-a9eb-7952f4074951 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:21.121864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb41dc-a245-4127-a9eb-7952f4074951 admin admin] PATH_INFO: `/v3/users/b30c8102d75a4095891dd3894f13f1db` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:21.123230 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb41dc-a245-4127-a9eb-7952f4074951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b30c8102d75a4095891dd3894f13f1db)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:21.125559 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb41dc-a245-4127-a9eb-7952f4074951 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:21.941628 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a2cb41dc-a245-4127-a9eb-7952f4074951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b30c8102d75a4095891dd3894f13f1db'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:22.027266 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a2cb41dc-a245-4127-a9eb-7952f4074951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b30c8102d75a4095891dd3894f13f1db'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:22.044345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a2cb41dc-a245-4127-a9eb-7952f4074951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b30c8102d75a4095891dd3894f13f1db'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:22.069724 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:22.080568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a2cb41dc-a245-4127-a9eb-7952f4074951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b30c8102d75a4095891dd3894f13f1db'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:22.081465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a2cb41dc-a245-4127-a9eb-7952f4074951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b30c8102d75a4095891dd3894f13f1db'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:22.094319 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1324/2650] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:02:21 2022] DELETE /identity/v3/users/b30c8102d75a4095891dd3894f13f1db => generated 0 bytes in 1061 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:02:22.713653 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4d79a-e512-4e1f-b3c6-cf9de3a452e3 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:22.717636 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-5ad4d79a-e512-4e1f-b3c6-cf9de3a452e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:22.753699 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4d79a-e512-4e1f-b3c6-cf9de3a452e3 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:22.846642 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ef5cf-1a9e-4c58-b831-d8c5dd02d8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:22.847320 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ef5cf-1a9e-4c58-b831-d8c5dd02d8ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:22.847624 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ef5cf-1a9e-4c58-b831-d8c5dd02d8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:22.847897 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ef5cf-1a9e-4c58-b831-d8c5dd02d8ff admin admin] PATH_INFO: `/v3/projects/44a98099122a478b935d729b66fe814f` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:22.849215 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ef5cf-1a9e-4c58-b831-d8c5dd02d8ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=44a98099122a478b935d729b66fe814f)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:22.851654 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ef5cf-1a9e-4c58-b831-d8c5dd02d8ff admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:22.978232 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-3e2ef5cf-1a9e-4c58-b831-d8c5dd02d8ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44a98099122a478b935d729b66fe814f', 'request_id': 'req-3e2ef5cf-1a9e-4c58-b831-d8c5dd02d8ff'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:22.989015 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-3e2ef5cf-1a9e-4c58-b831-d8c5dd02d8ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44a98099122a478b935d729b66fe814f', 'request_id': 'req-3e2ef5cf-1a9e-4c58-b831-d8c5dd02d8ff'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:22.991199 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:23.003126 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-3e2ef5cf-1a9e-4c58-b831-d8c5dd02d8ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44a98099122a478b935d729b66fe814f', 'request_id': 'req-3e2ef5cf-1a9e-4c58-b831-d8c5dd02d8ff'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:23.094350 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-3e2ef5cf-1a9e-4c58-b831-d8c5dd02d8ff admin admin] The token cache is being invalidate because project 44a98099122a478b935d729b66fe814f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:02:23.094642 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-3e2ef5cf-1a9e-4c58-b831-d8c5dd02d8ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:23.095300 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-3e2ef5cf-1a9e-4c58-b831-d8c5dd02d8ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:23.096839 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1327/2651] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:02:22 2022] DELETE /identity/v3/projects/44a98099122a478b935d729b66fe814f => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:02:23.101462 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb41dc-a245-4127-a9eb-7952f4074951 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:23.103081 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a2cb41dc-a245-4127-a9eb-7952f4074951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:23.117324 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb41dc-a245-4127-a9eb-7952f4074951 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:23.188070 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6daef9a-65ba-482d-9ca4-ecdef95c861a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:23.189148 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daef9a-65ba-482d-9ca4-ecdef95c861a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:23.189660 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daef9a-65ba-482d-9ca4-ecdef95c861a admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:23.190145 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daef9a-65ba-482d-9ca4-ecdef95c861a admin admin] PATH_INFO: `/v3/users/9eeec5d90f4b4194a389442c612589e9` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:23.192255 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6daef9a-65ba-482d-9ca4-ecdef95c861a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eeec5d90f4b4194a389442c612589e9)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:23.195982 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6daef9a-65ba-482d-9ca4-ecdef95c861a admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:23.475957 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-f6daef9a-65ba-482d-9ca4-ecdef95c861a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eeec5d90f4b4194a389442c612589e9'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:23.601635 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-f6daef9a-65ba-482d-9ca4-ecdef95c861a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eeec5d90f4b4194a389442c612589e9'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:23.611575 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-f6daef9a-65ba-482d-9ca4-ecdef95c861a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eeec5d90f4b4194a389442c612589e9'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:23.628017 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-f6daef9a-65ba-482d-9ca4-ecdef95c861a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eeec5d90f4b4194a389442c612589e9'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:23.629128 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-f6daef9a-65ba-482d-9ca4-ecdef95c861a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eeec5d90f4b4194a389442c612589e9'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:23.637039 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1325/2652] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:02:23 2022] DELETE /identity/v3/users/9eeec5d90f4b4194a389442c612589e9 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:02:24.201346 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ef5cf-1a9e-4c58-b831-d8c5dd02d8ff admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:24.202934 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-3e2ef5cf-1a9e-4c58-b831-d8c5dd02d8ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:24.219950 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ef5cf-1a9e-4c58-b831-d8c5dd02d8ff admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:24.298564 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7649c-cf0b-4483-9fb3-579687c8b2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:24.299381 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7649c-cf0b-4483-9fb3-579687c8b2a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:24.299720 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7649c-cf0b-4483-9fb3-579687c8b2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:24.300035 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7649c-cf0b-4483-9fb3-579687c8b2a3 admin admin] PATH_INFO: `/v3/projects/06d7f2fd29e24b9d94e580799b0444fa` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:24.301461 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c7649c-cf0b-4483-9fb3-579687c8b2a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06d7f2fd29e24b9d94e580799b0444fa)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:24.303525 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c7649c-cf0b-4483-9fb3-579687c8b2a3 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:24.426710 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-35c7649c-cf0b-4483-9fb3-579687c8b2a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06d7f2fd29e24b9d94e580799b0444fa', 'request_id': 'req-35c7649c-cf0b-4483-9fb3-579687c8b2a3'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:24.432706 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-35c7649c-cf0b-4483-9fb3-579687c8b2a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06d7f2fd29e24b9d94e580799b0444fa', 'request_id': 'req-35c7649c-cf0b-4483-9fb3-579687c8b2a3'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:24.438820 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-35c7649c-cf0b-4483-9fb3-579687c8b2a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06d7f2fd29e24b9d94e580799b0444fa', 'request_id': 'req-35c7649c-cf0b-4483-9fb3-579687c8b2a3'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:24.523613 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-35c7649c-cf0b-4483-9fb3-579687c8b2a3 admin admin] The token cache is being invalidate because project 06d7f2fd29e24b9d94e580799b0444fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:02:24.524120 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-35c7649c-cf0b-4483-9fb3-579687c8b2a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:24.525048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-35c7649c-cf0b-4483-9fb3-579687c8b2a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:24.526629 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1328/2653] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:02:24 2022] DELETE /identity/v3/projects/06d7f2fd29e24b9d94e580799b0444fa => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:02:24.532795 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa3a98-19ad-4984-b98d-a030aa64d727 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:24.533529 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa3a98-19ad-4984-b98d-a030aa64d727 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:24.533529 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa3a98-19ad-4984-b98d-a030aa64d727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:24.590249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-2ffa3a98-19ad-4984-b98d-a030aa64d727 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:24.591572 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-2ffa3a98-19ad-4984-b98d-a030aa64d727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:24.656274 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:24.693682 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1326/2654] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:24.705813 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3a801-eb32-4231-8403-468e2c116400 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:24.706473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3a801-eb32-4231-8403-468e2c116400 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:24.707310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3a801-eb32-4231-8403-468e2c116400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:24.856056 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-0ee3a801-eb32-4231-8403-468e2c116400 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:24.857321 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-0ee3a801-eb32-4231-8403-468e2c116400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:24.865903 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1329/2655] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:02:24.870550 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa3a98-19ad-4984-b98d-a030aa64d727 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:24.882817 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa3a98-19ad-4984-b98d-a030aa64d727 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:24.887942 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433907c6-096d-4642-889a-1c8e033df03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:24.889182 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433907c6-096d-4642-889a-1c8e033df03a admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:24.889459 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433907c6-096d-4642-889a-1c8e033df03a admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:24.889823 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433907c6-096d-4642-889a-1c8e033df03a admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:24.890503 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433907c6-096d-4642-889a-1c8e033df03a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:02:24.890803 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433907c6-096d-4642-889a-1c8e033df03a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:24.892593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433907c6-096d-4642-889a-1c8e033df03a admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:24.915615 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1327/2656] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 14:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 14:02:24.922509 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3a801-eb32-4231-8403-468e2c116400 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:24.932520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3a801-eb32-4231-8403-468e2c116400 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:24.938252 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bab8c-5b78-4872-a6dc-a617f9efc617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:24.938851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bab8c-5b78-4872-a6dc-a617f9efc617 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:24.939131 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bab8c-5b78-4872-a6dc-a617f9efc617 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:24.939434 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bab8c-5b78-4872-a6dc-a617f9efc617 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:24.940107 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674bab8c-5b78-4872-a6dc-a617f9efc617 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:24.942056 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674bab8c-5b78-4872-a6dc-a617f9efc617 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:25.042973 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1330/2657] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:02:24 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:02:25.048056 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433907c6-096d-4642-889a-1c8e033df03a admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:25.059035 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433907c6-096d-4642-889a-1c8e033df03a admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:25.129091 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2fc9b-20e0-4393-adbf-22e4c2173f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:25.129718 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2fc9b-20e0-4393-adbf-22e4c2173f75 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:25.129994 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2fc9b-20e0-4393-adbf-22e4c2173f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:25.130272 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2fc9b-20e0-4393-adbf-22e4c2173f75 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:25.130926 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2fc9b-20e0-4393-adbf-22e4c2173f75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:25.132948 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2fc9b-20e0-4393-adbf-22e4c2173f75 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:25.238486 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1328/2658] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:02:25 2022] POST /identity/v3/users => generated 290 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:02:25.243053 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bab8c-5b78-4872-a6dc-a617f9efc617 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:25.254974 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bab8c-5b78-4872-a6dc-a617f9efc617 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:25.259918 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15bf43-8aae-4a8e-b3ee-b20d8e57d993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:25.260586 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15bf43-8aae-4a8e-b3ee-b20d8e57d993 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:25.260865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15bf43-8aae-4a8e-b3ee-b20d8e57d993 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:25.261145 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15bf43-8aae-4a8e-b3ee-b20d8e57d993 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:25.261823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15bf43-8aae-4a8e-b3ee-b20d8e57d993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:25.263553 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15bf43-8aae-4a8e-b3ee-b20d8e57d993 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:25.274741 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1331/2659] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:02:25.279777 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2fc9b-20e0-4393-adbf-22e4c2173f75 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:25.290552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2fc9b-20e0-4393-adbf-22e4c2173f75 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:25.296286 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97f737-1c17-4e99-b211-17e5a0a4faff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:25.296846 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97f737-1c17-4e99-b211-17e5a0a4faff admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:25.297127 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97f737-1c17-4e99-b211-17e5a0a4faff admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:25.297403 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97f737-1c17-4e99-b211-17e5a0a4faff admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:25.298199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97f737-1c17-4e99-b211-17e5a0a4faff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:25.299862 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97f737-1c17-4e99-b211-17e5a0a4faff admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:25.311998 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1329/2660] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:02:25.316915 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15bf43-8aae-4a8e-b3ee-b20d8e57d993 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:25.327205 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15bf43-8aae-4a8e-b3ee-b20d8e57d993 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:25.331838 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0cb18f-35f9-48f3-bfd6-32db9e889f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:25.332489 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cb18f-35f9-48f3-bfd6-32db9e889f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:25.332770 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cb18f-35f9-48f3-bfd6-32db9e889f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:25.333043 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cb18f-35f9-48f3-bfd6-32db9e889f97 admin admin] PATH_INFO: `/v3/projects/daaeeebbbab44171913e33912d093130/users/14ac101278a246d2b1db3972545e049b/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:25.350396 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0cb18f-35f9-48f3-bfd6-32db9e889f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daaeeebbbab44171913e33912d093130, user_id=14ac101278a246d2b1db3972545e049b, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:25.353170 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0cb18f-35f9-48f3-bfd6-32db9e889f97 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:25.481427 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1332/2661] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:02:25 2022] PUT /identity/v3/projects/daaeeebbbab44171913e33912d093130/users/14ac101278a246d2b1db3972545e049b/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:02:25.494013 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd1eeb-b8b3-41c6-a411-2c26720e7f38 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:25.494827 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd1eeb-b8b3-41c6-a411-2c26720e7f38 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:25.495419 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd1eeb-b8b3-41c6-a411-2c26720e7f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:25.525582 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-2efd1eeb-b8b3-41c6-a411-2c26720e7f38 None None] MFA Rules not processed for user `14ac101278a246d2b1db3972545e049b`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:25.529502 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-2efd1eeb-b8b3-41c6-a411-2c26720e7f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:25.605003 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1330/2662] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:02:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:25.610430 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0cb18f-35f9-48f3-bfd6-32db9e889f97 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:25.625037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:25.723322 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0cb18f-35f9-48f3-bfd6-32db9e889f97 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:25.730503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebefda-394c-4def-9ecd-9943c2f49a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:25.731625 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebefda-394c-4def-9ecd-9943c2f49a94 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:25.732396 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebefda-394c-4def-9ecd-9943c2f49a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:25.733145 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebefda-394c-4def-9ecd-9943c2f49a94 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:25.734418 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ebefda-394c-4def-9ecd-9943c2f49a94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:25.739389 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ebefda-394c-4def-9ecd-9943c2f49a94 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:25.901136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1333/2663] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:02:25 2022] POST /identity/v3/projects => generated 381 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:02:25.903013 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd1eeb-b8b3-41c6-a411-2c26720e7f38 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:25.915275 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd1eeb-b8b3-41c6-a411-2c26720e7f38 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:26.000242 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:26.029232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcdd27-b6fd-443c-8cd6-d59157eceb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:26.030231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcdd27-b6fd-443c-8cd6-d59157eceb71 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:26.032803 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcdd27-b6fd-443c-8cd6-d59157eceb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:26.032803 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcdd27-b6fd-443c-8cd6-d59157eceb71 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:26.032803 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcdd27-b6fd-443c-8cd6-d59157eceb71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:26.033681 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcdd27-b6fd-443c-8cd6-d59157eceb71 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:26.147080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1331/2664] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:02:25 2022] POST /identity/v3/users => generated 297 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:02:26.151184 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebefda-394c-4def-9ecd-9943c2f49a94 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:26.170087 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebefda-394c-4def-9ecd-9943c2f49a94 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:26.181284 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d15f01-c6a5-40c5-a11a-ad94af123b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:26.182076 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d15f01-c6a5-40c5-a11a-ad94af123b77 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:26.182470 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d15f01-c6a5-40c5-a11a-ad94af123b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:26.182850 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d15f01-c6a5-40c5-a11a-ad94af123b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:26.192103 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d15f01-c6a5-40c5-a11a-ad94af123b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:26.192103 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d15f01-c6a5-40c5-a11a-ad94af123b77 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:26.208924 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1334/2665] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:02:26.209256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcdd27-b6fd-443c-8cd6-d59157eceb71 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:26.222212 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcdd27-b6fd-443c-8cd6-d59157eceb71 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:26.229694 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf75f0d-6b44-48c7-8b81-07a20d2bcc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:26.231069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf75f0d-6b44-48c7-8b81-07a20d2bcc94 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:26.231693 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf75f0d-6b44-48c7-8b81-07a20d2bcc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:26.232284 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf75f0d-6b44-48c7-8b81-07a20d2bcc94 admin admin] PATH_INFO: `/v3/projects/fe14a8e0c66d417aa1b7f61148ff6544/users/888df5ca072a443cbade436ba020adf2/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:26.257855 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf75f0d-6b44-48c7-8b81-07a20d2bcc94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe14a8e0c66d417aa1b7f61148ff6544, user_id=888df5ca072a443cbade436ba020adf2, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:26.261764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf75f0d-6b44-48c7-8b81-07a20d2bcc94 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:26.381443 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1332/2666] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:02:26 2022] PUT /identity/v3/projects/fe14a8e0c66d417aa1b7f61148ff6544/users/888df5ca072a443cbade436ba020adf2/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:02:26.385642 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d15f01-c6a5-40c5-a11a-ad94af123b77 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:26.397695 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d15f01-c6a5-40c5-a11a-ad94af123b77 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:26.467998 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bda7ca-9ced-4efa-831c-eae4a317c59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:26.469121 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bda7ca-9ced-4efa-831c-eae4a317c59e admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:26.469814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bda7ca-9ced-4efa-831c-eae4a317c59e admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:26.470282 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bda7ca-9ced-4efa-831c-eae4a317c59e admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:26.471315 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bda7ca-9ced-4efa-831c-eae4a317c59e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:26.474343 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bda7ca-9ced-4efa-831c-eae4a317c59e admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:26.493421 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1335/2667] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:02:26.498791 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf75f0d-6b44-48c7-8b81-07a20d2bcc94 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:26.510880 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf75f0d-6b44-48c7-8b81-07a20d2bcc94 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:26.516599 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3361ec-786f-4018-9016-7824b3952fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:26.517280 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3361ec-786f-4018-9016-7824b3952fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:26.517559 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3361ec-786f-4018-9016-7824b3952fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:26.517835 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3361ec-786f-4018-9016-7824b3952fe9 admin admin] PATH_INFO: `/v3/projects/fe14a8e0c66d417aa1b7f61148ff6544/users/888df5ca072a443cbade436ba020adf2/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:26.519907 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3361ec-786f-4018-9016-7824b3952fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe14a8e0c66d417aa1b7f61148ff6544, user_id=888df5ca072a443cbade436ba020adf2, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:26.522913 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3361ec-786f-4018-9016-7824b3952fe9 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:26.539510 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1333/2668] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:02:26 2022] PUT /identity/v3/projects/fe14a8e0c66d417aa1b7f61148ff6544/users/888df5ca072a443cbade436ba020adf2/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:02:26.551615 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c20836-c7cf-4ed1-b1ce-a7a80cad6712 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:26.552238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c20836-c7cf-4ed1-b1ce-a7a80cad6712 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:26.552805 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c20836-c7cf-4ed1-b1ce-a7a80cad6712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:26.594048 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-42c20836-c7cf-4ed1-b1ce-a7a80cad6712 None None] MFA Rules not processed for user `888df5ca072a443cbade436ba020adf2`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:26.596167 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-42c20836-c7cf-4ed1-b1ce-a7a80cad6712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:26.683488 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1336/2669] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:02:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:26.701552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3361ec-786f-4018-9016-7824b3952fe9 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:26.703345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-bc3361ec-786f-4018-9016-7824b3952fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:26.746857 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c20836-c7cf-4ed1-b1ce-a7a80cad6712 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:26.746857 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-42c20836-c7cf-4ed1-b1ce-a7a80cad6712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:26.765171 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:26.782712 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3361ec-786f-4018-9016-7824b3952fe9 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:26.809073 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4519b-cfc8-4a59-b009-b99c98788943 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:26.809073 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4519b-cfc8-4a59-b009-b99c98788943 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:26.809073 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4519b-cfc8-4a59-b009-b99c98788943 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:26.809073 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4519b-cfc8-4a59-b009-b99c98788943 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:26.809662 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4519b-cfc8-4a59-b009-b99c98788943 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:26.809662 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4519b-cfc8-4a59-b009-b99c98788943 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:26.818328 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1334/2670] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:02:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:02:26.886214 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c20836-c7cf-4ed1-b1ce-a7a80cad6712 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:26.895062 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604c860-8c78-4942-aa65-1cf896ae4b8d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e675d44d2c49929feb0ec0d2c0d0eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:26.895752 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604c860-8c78-4942-aa65-1cf896ae4b8d service placement] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:26.896035 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604c860-8c78-4942-aa65-1cf896ae4b8d service placement] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:26.896315 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604c860-8c78-4942-aa65-1cf896ae4b8d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:26.898084 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-6604c860-8c78-4942-aa65-1cf896ae4b8d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:26.911272 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604c860-8c78-4942-aa65-1cf896ae4b8d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:26.912561 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604c860-8c78-4942-aa65-1cf896ae4b8d service placement] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:26.923892 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1337/2671] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:02:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:02:28.384302 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4519b-cfc8-4a59-b009-b99c98788943 service cinder] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:28.457232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4519b-cfc8-4a59-b009-b99c98788943 service cinder] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:28.462107 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c18be-2a44-4910-8503-7afac7ae2f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:28.462747 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c18be-2a44-4910-8503-7afac7ae2f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:28.463027 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c18be-2a44-4910-8503-7afac7ae2f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:28.463299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c18be-2a44-4910-8503-7afac7ae2f19 admin admin] PATH_INFO: `/v3/users/14ac101278a246d2b1db3972545e049b` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:28.467825 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c18be-2a44-4910-8503-7afac7ae2f19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14ac101278a246d2b1db3972545e049b)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:28.469812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c18be-2a44-4910-8503-7afac7ae2f19 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:28.811295 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:28.818031 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-276c18be-2a44-4910-8503-7afac7ae2f19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14ac101278a246d2b1db3972545e049b'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:28.929996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-276c18be-2a44-4910-8503-7afac7ae2f19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14ac101278a246d2b1db3972545e049b'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:28.931829 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-276c18be-2a44-4910-8503-7afac7ae2f19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14ac101278a246d2b1db3972545e049b'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:28.955621 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-276c18be-2a44-4910-8503-7afac7ae2f19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14ac101278a246d2b1db3972545e049b'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:28.956396 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-276c18be-2a44-4910-8503-7afac7ae2f19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14ac101278a246d2b1db3972545e049b'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:28.974716 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1335/2672] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:02:28 2022] DELETE /identity/v3/users/14ac101278a246d2b1db3972545e049b => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:02:28.979882 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0891f34-2c18-4651-8703-538ac1ea2533 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:28.980394 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0891f34-2c18-4651-8703-538ac1ea2533 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:28.980515 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0891f34-2c18-4651-8703-538ac1ea2533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:29.011592 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-e0891f34-2c18-4651-8703-538ac1ea2533 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:29.012791 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-e0891f34-2c18-4651-8703-538ac1ea2533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:29.096222 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1338/2673] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:29.109286 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c18be-2a44-4910-8503-7afac7ae2f19 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:29.112710 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-276c18be-2a44-4910-8503-7afac7ae2f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:29.204504 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c18be-2a44-4910-8503-7afac7ae2f19 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:29.208462 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff96b41-368f-4fd7-ba75-a6716732291b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:29.209096 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff96b41-368f-4fd7-ba75-a6716732291b service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:29.209374 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff96b41-368f-4fd7-ba75-a6716732291b service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:29.209853 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff96b41-368f-4fd7-ba75-a6716732291b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:29.223734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff96b41-368f-4fd7-ba75-a6716732291b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:29.225325 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff96b41-368f-4fd7-ba75-a6716732291b service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:29.238081 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1336/2674] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:02:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:02:29.761724 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0891f34-2c18-4651-8703-538ac1ea2533 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:29.763458 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-e0891f34-2c18-4651-8703-538ac1ea2533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:29.776852 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0891f34-2c18-4651-8703-538ac1ea2533 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:29.782742 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c55f7-7fb0-4f53-9dd2-51ecadb92591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:29.783599 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c55f7-7fb0-4f53-9dd2-51ecadb92591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:29.784119 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c55f7-7fb0-4f53-9dd2-51ecadb92591 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:29.784701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c55f7-7fb0-4f53-9dd2-51ecadb92591 admin admin] PATH_INFO: `/v3/projects/daaeeebbbab44171913e33912d093130` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:29.786454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c55f7-7fb0-4f53-9dd2-51ecadb92591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daaeeebbbab44171913e33912d093130)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:29.788476 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c55f7-7fb0-4f53-9dd2-51ecadb92591 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:29.873109 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebca25-6220-44ee-b2eb-c60c13cc321d None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:29.873915 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebca25-6220-44ee-b2eb-c60c13cc321d None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:29.873915 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebca25-6220-44ee-b2eb-c60c13cc321d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:29.910002 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-86ebca25-6220-44ee-b2eb-c60c13cc321d None None] MFA Rules not processed for user `6f01578bf21244a5ac357e54979ffc0d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:29.911226 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-86ebca25-6220-44ee-b2eb-c60c13cc321d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:29.972675 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-2b8c55f7-7fb0-4f53-9dd2-51ecadb92591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daaeeebbbab44171913e33912d093130', 'request_id': 'req-2b8c55f7-7fb0-4f53-9dd2-51ecadb92591'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:29.973982 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1337/2675] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 1 14:02:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:29.986408 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-2b8c55f7-7fb0-4f53-9dd2-51ecadb92591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daaeeebbbab44171913e33912d093130', 'request_id': 'req-2b8c55f7-7fb0-4f53-9dd2-51ecadb92591'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:29.987303 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebca25-6220-44ee-b2eb-c60c13cc321d None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:29.989666 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-86ebca25-6220-44ee-b2eb-c60c13cc321d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:29.993709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-2b8c55f7-7fb0-4f53-9dd2-51ecadb92591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daaeeebbbab44171913e33912d093130', 'request_id': 'req-2b8c55f7-7fb0-4f53-9dd2-51ecadb92591'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:30.047825 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:30.070120 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebca25-6220-44ee-b2eb-c60c13cc321d None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:30.124438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-2b8c55f7-7fb0-4f53-9dd2-51ecadb92591 admin admin] The token cache is being invalidate because project daaeeebbbab44171913e33912d093130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:02:30.124977 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-2b8c55f7-7fb0-4f53-9dd2-51ecadb92591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:30.125903 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-2b8c55f7-7fb0-4f53-9dd2-51ecadb92591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:30.127696 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1339/2676] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:02:29 2022] DELETE /identity/v3/projects/daaeeebbbab44171913e33912d093130 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:02:30.131968 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c55f7-7fb0-4f53-9dd2-51ecadb92591 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:30.133701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-2b8c55f7-7fb0-4f53-9dd2-51ecadb92591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:30.140171 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:30.147154 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84e841-ae55-42ba-935c-71ab184447c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bbede0f8674384bcc3028ea77eb724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:30.147834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84e841-ae55-42ba-935c-71ab184447c4 service swift] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:30.148110 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84e841-ae55-42ba-935c-71ab184447c4 service swift] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:30.148380 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84e841-ae55-42ba-935c-71ab184447c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:30.150221 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-8d84e841-ae55-42ba-935c-71ab184447c4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:30.217046 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c55f7-7fb0-4f53-9dd2-51ecadb92591 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:30.217447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84e841-ae55-42ba-935c-71ab184447c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:30.219283 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84e841-ae55-42ba-935c-71ab184447c4 service swift] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:30.223075 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92046206-7fae-4dbb-b1e2-bc469f109811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:30.224175 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92046206-7fae-4dbb-b1e2-bc469f109811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:30.224682 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92046206-7fae-4dbb-b1e2-bc469f109811 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:30.225191 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92046206-7fae-4dbb-b1e2-bc469f109811 admin admin] PATH_INFO: `/v3/users/888df5ca072a443cbade436ba020adf2` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:30.227162 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92046206-7fae-4dbb-b1e2-bc469f109811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=888df5ca072a443cbade436ba020adf2)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:30.228498 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1338/2677] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 1 14:02:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 14:02:30.230698 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92046206-7fae-4dbb-b1e2-bc469f109811 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:30.424454 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-92046206-7fae-4dbb-b1e2-bc469f109811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '888df5ca072a443cbade436ba020adf2'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:30.425251 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-92046206-7fae-4dbb-b1e2-bc469f109811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '888df5ca072a443cbade436ba020adf2'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:30.439387 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-92046206-7fae-4dbb-b1e2-bc469f109811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '888df5ca072a443cbade436ba020adf2'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:30.446814 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-92046206-7fae-4dbb-b1e2-bc469f109811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '888df5ca072a443cbade436ba020adf2'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:30.541182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-92046206-7fae-4dbb-b1e2-bc469f109811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '888df5ca072a443cbade436ba020adf2'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:30.549792 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1340/2678] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:02:30 2022] DELETE /identity/v3/users/888df5ca072a443cbade436ba020adf2 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:02:30.959062 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef31ef4-e9fa-4818-bbda-a1640eaa82cd None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:30.961423 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef31ef4-e9fa-4818-bbda-a1640eaa82cd None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:30.961423 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef31ef4-e9fa-4818-bbda-a1640eaa82cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:30.991290 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-fef31ef4-e9fa-4818-bbda-a1640eaa82cd None None] MFA Rules not processed for user `6f01578bf21244a5ac357e54979ffc0d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:30.992705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-fef31ef4-e9fa-4818-bbda-a1640eaa82cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:31.099517 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1339/2679] 10.222.0.50 () {58 vars in 967 bytes} [Thu Sep 1 14:02:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:31.112882 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92046206-7fae-4dbb-b1e2-bc469f109811 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:31.116724 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-92046206-7fae-4dbb-b1e2-bc469f109811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:31.190093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92046206-7fae-4dbb-b1e2-bc469f109811 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:31.195790 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f1122-8264-4104-a42a-d4933fa28cb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bbede0f8674384bcc3028ea77eb724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:31.196390 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f1122-8264-4104-a42a-d4933fa28cb7 service swift] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:31.196672 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f1122-8264-4104-a42a-d4933fa28cb7 service swift] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:31.196943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f1122-8264-4104-a42a-d4933fa28cb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:31.205315 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f1122-8264-4104-a42a-d4933fa28cb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:31.206893 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f1122-8264-4104-a42a-d4933fa28cb7 service swift] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:31.214892 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1341/2680] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 1 14:02:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 14:02:31.257187 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef31ef4-e9fa-4818-bbda-a1640eaa82cd None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:31.258608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-fef31ef4-e9fa-4818-bbda-a1640eaa82cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:31.319036 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:31.342480 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef31ef4-e9fa-4818-bbda-a1640eaa82cd None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:31.350815 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495aa0f4-fb83-477f-be42-1f5406ad2e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:31.352233 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495aa0f4-fb83-477f-be42-1f5406ad2e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:31.352422 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495aa0f4-fb83-477f-be42-1f5406ad2e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:31.352833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495aa0f4-fb83-477f-be42-1f5406ad2e45 admin admin] PATH_INFO: `/v3/projects/fe14a8e0c66d417aa1b7f61148ff6544` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:31.355150 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495aa0f4-fb83-477f-be42-1f5406ad2e45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe14a8e0c66d417aa1b7f61148ff6544)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:31.358387 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495aa0f4-fb83-477f-be42-1f5406ad2e45 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:31.380531 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c436c1-73b2-4301-856d-b531adedc56b None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:31.380986 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c436c1-73b2-4301-856d-b531adedc56b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:31.381436 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c436c1-73b2-4301-856d-b531adedc56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:31.413620 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-36c436c1-73b2-4301-856d-b531adedc56b None None] MFA Rules not processed for user `6f01578bf21244a5ac357e54979ffc0d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:31.414881 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-36c436c1-73b2-4301-856d-b531adedc56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:31.423172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1342/2681] 10.222.0.50 () {58 vars in 967 bytes} [Thu Sep 1 14:02:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:31.442914 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c436c1-73b2-4301-856d-b531adedc56b None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:31.454359 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:31.459458 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c436c1-73b2-4301-856d-b531adedc56b None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:31.465197 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b316e0-9138-46e0-a0d2-dede63bedb99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bbede0f8674384bcc3028ea77eb724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:31.465823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b316e0-9138-46e0-a0d2-dede63bedb99 service swift] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:31.466645 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b316e0-9138-46e0-a0d2-dede63bedb99 service swift] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:31.466916 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b316e0-9138-46e0-a0d2-dede63bedb99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:31.477090 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b316e0-9138-46e0-a0d2-dede63bedb99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:31.478903 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b316e0-9138-46e0-a0d2-dede63bedb99 service swift] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:31.489486 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1343/2682] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 1 14:02:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 14:02:31.508787 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-495aa0f4-fb83-477f-be42-1f5406ad2e45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe14a8e0c66d417aa1b7f61148ff6544', 'request_id': 'req-495aa0f4-fb83-477f-be42-1f5406ad2e45'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:31.517622 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-495aa0f4-fb83-477f-be42-1f5406ad2e45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe14a8e0c66d417aa1b7f61148ff6544', 'request_id': 'req-495aa0f4-fb83-477f-be42-1f5406ad2e45'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:31.665732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-495aa0f4-fb83-477f-be42-1f5406ad2e45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe14a8e0c66d417aa1b7f61148ff6544', 'request_id': 'req-495aa0f4-fb83-477f-be42-1f5406ad2e45'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:31.678489 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-495aa0f4-fb83-477f-be42-1f5406ad2e45 admin admin] The token cache is being invalidate because project fe14a8e0c66d417aa1b7f61148ff6544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:02:31.678783 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-495aa0f4-fb83-477f-be42-1f5406ad2e45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:31.679490 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-495aa0f4-fb83-477f-be42-1f5406ad2e45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:31.681006 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1340/2683] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:02:31 2022] DELETE /identity/v3/projects/fe14a8e0c66d417aa1b7f61148ff6544 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:02:31.686039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee4fec-947b-434f-a3d6-e3b7e81e8585 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:31.686317 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee4fec-947b-434f-a3d6-e3b7e81e8585 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:31.686591 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee4fec-947b-434f-a3d6-e3b7e81e8585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:31.707897 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-beee4fec-947b-434f-a3d6-e3b7e81e8585 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:31.709115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-beee4fec-947b-434f-a3d6-e3b7e81e8585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:31.783886 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1344/2684] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:02:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:31.794892 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe579547-4696-4bf3-9bf4-fa8e28f77b8f None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:31.795175 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe579547-4696-4bf3-9bf4-fa8e28f77b8f None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:31.795643 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe579547-4696-4bf3-9bf4-fa8e28f77b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:31.818991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-fe579547-4696-4bf3-9bf4-fa8e28f77b8f None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:31.820157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-fe579547-4696-4bf3-9bf4-fa8e28f77b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:31.828732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1341/2685] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:02:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:31.834642 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee4fec-947b-434f-a3d6-e3b7e81e8585 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:31.855455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee4fec-947b-434f-a3d6-e3b7e81e8585 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:31.861344 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf31ce2-f838-4c09-b9d2-494c9951c1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:31.861966 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf31ce2-f838-4c09-b9d2-494c9951c1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:31.862242 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf31ce2-f838-4c09-b9d2-494c9951c1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:31.862513 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf31ce2-f838-4c09-b9d2-494c9951c1e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:31.863195 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf31ce2-f838-4c09-b9d2-494c9951c1e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:02:31.863526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf31ce2-f838-4c09-b9d2-494c9951c1e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:31.865150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf31ce2-f838-4c09-b9d2-494c9951c1e5 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:31.878317 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1345/2686] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 14:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:02:31.883001 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe579547-4696-4bf3-9bf4-fa8e28f77b8f None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:31.893088 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe579547-4696-4bf3-9bf4-fa8e28f77b8f None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:31.898553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fc9b1-47d1-4ba3-851c-9e375d843750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:31.898553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fc9b1-47d1-4ba3-851c-9e375d843750 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:31.898820 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fc9b1-47d1-4ba3-851c-9e375d843750 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:31.899092 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fc9b1-47d1-4ba3-851c-9e375d843750 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:31.899775 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790fc9b1-47d1-4ba3-851c-9e375d843750 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:31.901666 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790fc9b1-47d1-4ba3-851c-9e375d843750 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:32.010927 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1342/2687] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:02:31 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:02:32.015861 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf31ce2-f838-4c09-b9d2-494c9951c1e5 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:32.025941 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf31ce2-f838-4c09-b9d2-494c9951c1e5 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:32.100839 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d490c3-56c4-4b73-9412-2e189e0b71e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:32.103617 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d490c3-56c4-4b73-9412-2e189e0b71e3 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:32.103617 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d490c3-56c4-4b73-9412-2e189e0b71e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:32.103617 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d490c3-56c4-4b73-9412-2e189e0b71e3 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:32.103617 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d490c3-56c4-4b73-9412-2e189e0b71e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:32.105377 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d490c3-56c4-4b73-9412-2e189e0b71e3 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:32.217210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1346/2688] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:02:32 2022] POST /identity/v3/users => generated 287 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:02:32.221968 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fc9b1-47d1-4ba3-851c-9e375d843750 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:32.240705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fc9b1-47d1-4ba3-851c-9e375d843750 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:32.247952 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e0c8c-57ff-49a0-8354-05a4acdb37d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:32.248775 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e0c8c-57ff-49a0-8354-05a4acdb37d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:32.249236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e0c8c-57ff-49a0-8354-05a4acdb37d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:32.249789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e0c8c-57ff-49a0-8354-05a4acdb37d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:32.250949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e0c8c-57ff-49a0-8354-05a4acdb37d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:32.253263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e0c8c-57ff-49a0-8354-05a4acdb37d4 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:32.281109 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1343/2689] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:02:32.282917 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d490c3-56c4-4b73-9412-2e189e0b71e3 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:32.295458 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d490c3-56c4-4b73-9412-2e189e0b71e3 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:32.300796 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339486e-65a5-453d-81c6-7e172348ac27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:32.304136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339486e-65a5-453d-81c6-7e172348ac27 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:32.304136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339486e-65a5-453d-81c6-7e172348ac27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:32.304136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339486e-65a5-453d-81c6-7e172348ac27 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:32.304136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c339486e-65a5-453d-81c6-7e172348ac27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:32.304733 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c339486e-65a5-453d-81c6-7e172348ac27 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:32.318119 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1347/2690] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:02:32.324353 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e0c8c-57ff-49a0-8354-05a4acdb37d4 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:32.336614 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e0c8c-57ff-49a0-8354-05a4acdb37d4 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:32.342986 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bfa243-1484-40c6-a51d-21be62920ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:32.344048 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bfa243-1484-40c6-a51d-21be62920ca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:32.344547 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bfa243-1484-40c6-a51d-21be62920ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:32.344795 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bfa243-1484-40c6-a51d-21be62920ca0 admin admin] PATH_INFO: `/v3/projects/880830770beb4caba1ccb78c318e87d8/users/92bf95fde8704f2cada17232cb92251e/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:32.371051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bfa243-1484-40c6-a51d-21be62920ca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=880830770beb4caba1ccb78c318e87d8, user_id=92bf95fde8704f2cada17232cb92251e, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:32.371051 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bfa243-1484-40c6-a51d-21be62920ca0 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:32.371511 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f9696-e619-4792-9220-0b3a6d175386 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:32.371511 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f9696-e619-4792-9220-0b3a6d175386 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:32.371511 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f9696-e619-4792-9220-0b3a6d175386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:32.396698 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-1c1f9696-e619-4792-9220-0b3a6d175386 None None] MFA Rules not processed for user `6f01578bf21244a5ac357e54979ffc0d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:32.398020 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-1c1f9696-e619-4792-9220-0b3a6d175386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:32.464050 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1344/2691] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:02:32 2022] PUT /identity/v3/projects/880830770beb4caba1ccb78c318e87d8/users/92bf95fde8704f2cada17232cb92251e/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:02:32.471044 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1348/2692] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 1 14:02:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:02:32.475803 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8c922-4c75-4b65-b009-20b458ed488e None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:32.476124 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8c922-4c75-4b65-b009-20b458ed488e None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:32.476400 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8c922-4c75-4b65-b009-20b458ed488e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:32.491240 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f9696-e619-4792-9220-0b3a6d175386 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:32.493131 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-1c1f9696-e619-4792-9220-0b3a6d175386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:32.500004 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:32.509452 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-77a8c922-4c75-4b65-b009-20b458ed488e None None] MFA Rules not processed for user `92bf95fde8704f2cada17232cb92251e`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:32.510774 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-77a8c922-4c75-4b65-b009-20b458ed488e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:32.596829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f9696-e619-4792-9220-0b3a6d175386 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:32.615279 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:32.621891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1345/2693] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:02:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:32.639246 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8c922-4c75-4b65-b009-20b458ed488e None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:32.642813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-77a8c922-4c75-4b65-b009-20b458ed488e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:32.707403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79039dd-56f9-48f5-a775-2e20f7e48913 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bbede0f8674384bcc3028ea77eb724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:32.708364 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79039dd-56f9-48f5-a775-2e20f7e48913 service swift] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:32.708808 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79039dd-56f9-48f5-a775-2e20f7e48913 service swift] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:32.709257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79039dd-56f9-48f5-a775-2e20f7e48913 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:32.734470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8c922-4c75-4b65-b009-20b458ed488e None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:32.738563 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328ebed-9510-4e8f-93dd-f87c73b12764 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:32.739177 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328ebed-9510-4e8f-93dd-f87c73b12764 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:32.739474 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328ebed-9510-4e8f-93dd-f87c73b12764 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:32.739750 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328ebed-9510-4e8f-93dd-f87c73b12764 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:32.750433 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328ebed-9510-4e8f-93dd-f87c73b12764 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:32.755124 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328ebed-9510-4e8f-93dd-f87c73b12764 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:32.762858 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1346/2694] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:02:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:02:32.777492 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79039dd-56f9-48f5-a775-2e20f7e48913 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:32.779618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79039dd-56f9-48f5-a775-2e20f7e48913 service swift] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:32.789086 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1349/2695] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 1 14:02:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 14:02:33.713467 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a2c9d-333e-4fc8-94d2-48d7536264f5 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:33.713992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a2c9d-333e-4fc8-94d2-48d7536264f5 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:33.713992 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a2c9d-333e-4fc8-94d2-48d7536264f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:33.734505 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-489a2c9d-333e-4fc8-94d2-48d7536264f5 None None] MFA Rules not processed for user `6f01578bf21244a5ac357e54979ffc0d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:33.735987 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-489a2c9d-333e-4fc8-94d2-48d7536264f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:33.743195 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1347/2696] 10.222.0.50 () {58 vars in 967 bytes} [Thu Sep 1 14:02:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:33.756130 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79039dd-56f9-48f5-a775-2e20f7e48913 service swift] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:33.767021 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79039dd-56f9-48f5-a775-2e20f7e48913 service swift] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:33.772026 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9082a-9938-42a0-9880-1d1f171b0bca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bbede0f8674384bcc3028ea77eb724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:33.772684 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9082a-9938-42a0-9880-1d1f171b0bca service swift] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:33.772993 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9082a-9938-42a0-9880-1d1f171b0bca service swift] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:33.773257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9082a-9938-42a0-9880-1d1f171b0bca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:33.782195 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9082a-9938-42a0-9880-1d1f171b0bca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:33.783839 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9082a-9938-42a0-9880-1d1f171b0bca service swift] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:33.794705 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1350/2697] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 1 14:02:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 14:02:37.100870 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a2c9d-333e-4fc8-94d2-48d7536264f5 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:37.102341 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-489a2c9d-333e-4fc8-94d2-48d7536264f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:37.173011 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a2c9d-333e-4fc8-94d2-48d7536264f5 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:37.177962 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b519d3-df1b-43e3-afaf-fdac840b856c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:37.178667 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b519d3-df1b-43e3-afaf-fdac840b856c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:37.179005 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b519d3-df1b-43e3-afaf-fdac840b856c admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:37.179278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b519d3-df1b-43e3-afaf-fdac840b856c admin admin] PATH_INFO: `/v3/users/7f99cc2b4bc34d67aa65b16ad8b47f1a` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:37.180572 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b519d3-df1b-43e3-afaf-fdac840b856c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f99cc2b4bc34d67aa65b16ad8b47f1a)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:37.182508 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b519d3-df1b-43e3-afaf-fdac840b856c admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:37.394304 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-52b519d3-df1b-43e3-afaf-fdac840b856c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f99cc2b4bc34d67aa65b16ad8b47f1a'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:37.482553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-52b519d3-df1b-43e3-afaf-fdac840b856c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f99cc2b4bc34d67aa65b16ad8b47f1a'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:37.492464 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-52b519d3-df1b-43e3-afaf-fdac840b856c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f99cc2b4bc34d67aa65b16ad8b47f1a'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:37.509052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-52b519d3-df1b-43e3-afaf-fdac840b856c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f99cc2b4bc34d67aa65b16ad8b47f1a'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:37.509831 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-52b519d3-df1b-43e3-afaf-fdac840b856c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f99cc2b4bc34d67aa65b16ad8b47f1a'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:37.518224 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1348/2698] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:02:37 2022] DELETE /identity/v3/users/7f99cc2b4bc34d67aa65b16ad8b47f1a => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:02:37.519438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9082a-9938-42a0-9880-1d1f171b0bca service swift] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:37.522521 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407e7b9-b813-4aee-997d-568b6d206b6c None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:37.522829 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407e7b9-b813-4aee-997d-568b6d206b6c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:37.523091 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407e7b9-b813-4aee-997d-568b6d206b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:37.532277 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9082a-9938-42a0-9880-1d1f171b0bca service swift] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:37.559328 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-1407e7b9-b813-4aee-997d-568b6d206b6c None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:37.562836 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-1407e7b9-b813-4aee-997d-568b6d206b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:37.567159 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:37.574924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:37.608353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86fcc9-7eba-4402-b517-09f4cbffb233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:37.609198 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86fcc9-7eba-4402-b517-09f4cbffb233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:37.609478 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86fcc9-7eba-4402-b517-09f4cbffb233 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:37.609757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86fcc9-7eba-4402-b517-09f4cbffb233 admin admin] PATH_INFO: `/v3/users/92bf95fde8704f2cada17232cb92251e` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:37.612943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd86fcc9-7eba-4402-b517-09f4cbffb233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92bf95fde8704f2cada17232cb92251e)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:37.613946 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd86fcc9-7eba-4402-b517-09f4cbffb233 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:37.631163 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1349/2699] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:02:37.640712 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407e7b9-b813-4aee-997d-568b6d206b6c None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:37.645614 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-1407e7b9-b813-4aee-997d-568b6d206b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:37.721638 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407e7b9-b813-4aee-997d-568b6d206b6c None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:37.725276 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdbfe1-c768-4bf4-87ec-642dcd702e90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:37.725869 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdbfe1-c768-4bf4-87ec-642dcd702e90 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:37.726147 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdbfe1-c768-4bf4-87ec-642dcd702e90 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:37.726416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdbfe1-c768-4bf4-87ec-642dcd702e90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:37.736495 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccdbfe1-c768-4bf4-87ec-642dcd702e90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:37.737930 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccdbfe1-c768-4bf4-87ec-642dcd702e90 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:37.749470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1350/2700] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:02:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:02:37.853056 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-cd86fcc9-7eba-4402-b517-09f4cbffb233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92bf95fde8704f2cada17232cb92251e'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:37.853820 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-cd86fcc9-7eba-4402-b517-09f4cbffb233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92bf95fde8704f2cada17232cb92251e'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:37.869459 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-cd86fcc9-7eba-4402-b517-09f4cbffb233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92bf95fde8704f2cada17232cb92251e'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:37.878950 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-cd86fcc9-7eba-4402-b517-09f4cbffb233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92bf95fde8704f2cada17232cb92251e'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:37.985523 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-cd86fcc9-7eba-4402-b517-09f4cbffb233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92bf95fde8704f2cada17232cb92251e'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:37.992235 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1351/2701] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:02:37 2022] DELETE /identity/v3/users/92bf95fde8704f2cada17232cb92251e => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:02:37.997008 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cca1e-c029-4c2b-a40e-156e972de515 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:37.997358 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cca1e-c029-4c2b-a40e-156e972de515 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:37.998139 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cca1e-c029-4c2b-a40e-156e972de515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:38.018092 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-890cca1e-c029-4c2b-a40e-156e972de515 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:38.019339 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-890cca1e-c029-4c2b-a40e-156e972de515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:38.084610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1351/2702] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:38.085698 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86fcc9-7eba-4402-b517-09f4cbffb233 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:38.090467 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-cd86fcc9-7eba-4402-b517-09f4cbffb233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:38.100579 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cca1e-c029-4c2b-a40e-156e972de515 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:38.102442 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-890cca1e-c029-4c2b-a40e-156e972de515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:38.110688 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86fcc9-7eba-4402-b517-09f4cbffb233 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:38.116168 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe3693-f35d-484b-be50-797386602658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:38.116926 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe3693-f35d-484b-be50-797386602658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:38.117157 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe3693-f35d-484b-be50-797386602658 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:38.117436 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe3693-f35d-484b-be50-797386602658 admin admin] PATH_INFO: `/v3/projects/d5f855115eba40748db48675c0a6e4f1` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:38.118743 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe3693-f35d-484b-be50-797386602658 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5f855115eba40748db48675c0a6e4f1)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:38.120717 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe3693-f35d-484b-be50-797386602658 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:38.170772 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:38.186486 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cca1e-c029-4c2b-a40e-156e972de515 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:38.190190 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93618cd9-4441-4c3a-9ac3-cf7037c06f2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:38.190864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93618cd9-4441-4c3a-9ac3-cf7037c06f2c service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:38.191145 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93618cd9-4441-4c3a-9ac3-cf7037c06f2c service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:38.191486 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93618cd9-4441-4c3a-9ac3-cf7037c06f2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:38.201324 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93618cd9-4441-4c3a-9ac3-cf7037c06f2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:38.211242 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93618cd9-4441-4c3a-9ac3-cf7037c06f2c service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:38.213555 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1352/2703] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:02:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:02:38.226115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-eafe3693-f35d-484b-be50-797386602658 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5f855115eba40748db48675c0a6e4f1', 'request_id': 'req-eafe3693-f35d-484b-be50-797386602658'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:38.233257 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-eafe3693-f35d-484b-be50-797386602658 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5f855115eba40748db48675c0a6e4f1', 'request_id': 'req-eafe3693-f35d-484b-be50-797386602658'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:38.245880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-eafe3693-f35d-484b-be50-797386602658 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5f855115eba40748db48675c0a6e4f1', 'request_id': 'req-eafe3693-f35d-484b-be50-797386602658'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:38.322626 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-eafe3693-f35d-484b-be50-797386602658 admin admin] The token cache is being invalidate because project d5f855115eba40748db48675c0a6e4f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:02:38.322926 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-eafe3693-f35d-484b-be50-797386602658 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:38.323678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-eafe3693-f35d-484b-be50-797386602658 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:38.325243 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1352/2704] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:02:38 2022] DELETE /identity/v3/projects/d5f855115eba40748db48675c0a6e4f1 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:02:38.696813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93618cd9-4441-4c3a-9ac3-cf7037c06f2c service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:38.699124 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-93618cd9-4441-4c3a-9ac3-cf7037c06f2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:38.720880 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93618cd9-4441-4c3a-9ac3-cf7037c06f2c service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:38.788519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb8c40-7874-4b3a-94d1-e7d12656db79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:38.789158 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb8c40-7874-4b3a-94d1-e7d12656db79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:38.789486 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb8c40-7874-4b3a-94d1-e7d12656db79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:38.789768 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb8c40-7874-4b3a-94d1-e7d12656db79 admin admin] PATH_INFO: `/v3/projects/880830770beb4caba1ccb78c318e87d8` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:38.790925 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb8c40-7874-4b3a-94d1-e7d12656db79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=880830770beb4caba1ccb78c318e87d8)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:38.792908 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb8c40-7874-4b3a-94d1-e7d12656db79 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:38.960061 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dbdb8c40-7874-4b3a-94d1-e7d12656db79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '880830770beb4caba1ccb78c318e87d8', 'request_id': 'req-dbdb8c40-7874-4b3a-94d1-e7d12656db79'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:38.965686 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dbdb8c40-7874-4b3a-94d1-e7d12656db79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '880830770beb4caba1ccb78c318e87d8', 'request_id': 'req-dbdb8c40-7874-4b3a-94d1-e7d12656db79'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:39.099770 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dbdb8c40-7874-4b3a-94d1-e7d12656db79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '880830770beb4caba1ccb78c318e87d8', 'request_id': 'req-dbdb8c40-7874-4b3a-94d1-e7d12656db79'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:39.114337 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dbdb8c40-7874-4b3a-94d1-e7d12656db79 admin admin] The token cache is being invalidate because project 880830770beb4caba1ccb78c318e87d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:02:39.115048 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dbdb8c40-7874-4b3a-94d1-e7d12656db79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:39.115499 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-dbdb8c40-7874-4b3a-94d1-e7d12656db79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:39.116999 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1353/2705] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:02:38 2022] DELETE /identity/v3/projects/880830770beb4caba1ccb78c318e87d8 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:02:39.122157 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8622a-e04d-4b4c-936a-e98c63572827 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:39.123430 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8622a-e04d-4b4c-936a-e98c63572827 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:39.123430 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8622a-e04d-4b4c-936a-e98c63572827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:39.150113 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-c0c8622a-e04d-4b4c-936a-e98c63572827 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:39.151386 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c0c8622a-e04d-4b4c-936a-e98c63572827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:39.184070 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:39.218241 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1353/2706] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:39.222417 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a6b0f-db51-4924-8f69-a661d6394773 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:39.222777 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a6b0f-db51-4924-8f69-a661d6394773 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:39.223115 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a6b0f-db51-4924-8f69-a661d6394773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:39.245058 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-1b2a6b0f-db51-4924-8f69-a661d6394773 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:39.246280 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-1b2a6b0f-db51-4924-8f69-a661d6394773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:39.255065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1354/2707] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:02:39.261274 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8622a-e04d-4b4c-936a-e98c63572827 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:39.271503 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8622a-e04d-4b4c-936a-e98c63572827 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:39.276400 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332040c-06c0-4436-a064-04b26a7c5edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:39.277008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332040c-06c0-4436-a064-04b26a7c5edb admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:39.277289 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332040c-06c0-4436-a064-04b26a7c5edb admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:39.277550 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332040c-06c0-4436-a064-04b26a7c5edb admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:39.278195 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0332040c-06c0-4436-a064-04b26a7c5edb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:02:39.278612 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0332040c-06c0-4436-a064-04b26a7c5edb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:39.280337 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0332040c-06c0-4436-a064-04b26a7c5edb admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:39.292259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1354/2708] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 14:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 14:02:39.301929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a6b0f-db51-4924-8f69-a661d6394773 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:39.312453 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a6b0f-db51-4924-8f69-a661d6394773 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:39.317175 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2359733-61c0-45aa-961a-484dd32554cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:39.317781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2359733-61c0-45aa-961a-484dd32554cb admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:39.318059 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2359733-61c0-45aa-961a-484dd32554cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:39.318356 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2359733-61c0-45aa-961a-484dd32554cb admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:39.319014 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2359733-61c0-45aa-961a-484dd32554cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:39.320981 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2359733-61c0-45aa-961a-484dd32554cb admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:39.445602 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1355/2709] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:02:39 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:02:39.450260 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332040c-06c0-4436-a064-04b26a7c5edb admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:39.461352 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332040c-06c0-4436-a064-04b26a7c5edb admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:39.539681 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50fab8-ee10-4735-b094-6c686d820b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:39.540309 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50fab8-ee10-4735-b094-6c686d820b17 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:39.540597 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50fab8-ee10-4735-b094-6c686d820b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:39.540872 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50fab8-ee10-4735-b094-6c686d820b17 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:39.541529 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50fab8-ee10-4735-b094-6c686d820b17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:39.543521 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50fab8-ee10-4735-b094-6c686d820b17 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:39.643218 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1355/2710] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:02:39 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:02:39.649799 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2359733-61c0-45aa-961a-484dd32554cb admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:39.663901 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2359733-61c0-45aa-961a-484dd32554cb admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:39.670465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7fad56-6060-45a6-9576-fd3bff6b002e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:39.671275 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fad56-6060-45a6-9576-fd3bff6b002e admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:39.671714 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fad56-6060-45a6-9576-fd3bff6b002e admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:39.672069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fad56-6060-45a6-9576-fd3bff6b002e admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:39.672990 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7fad56-6060-45a6-9576-fd3bff6b002e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:39.674775 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7fad56-6060-45a6-9576-fd3bff6b002e admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:39.687940 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1356/2711] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:02:39.692582 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50fab8-ee10-4735-b094-6c686d820b17 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:39.703617 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50fab8-ee10-4735-b094-6c686d820b17 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:39.708620 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c7632-51ce-4691-966e-03b5aa74993f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:39.709231 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c7632-51ce-4691-966e-03b5aa74993f admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:39.709512 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c7632-51ce-4691-966e-03b5aa74993f admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:39.709787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c7632-51ce-4691-966e-03b5aa74993f admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:39.710440 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c7632-51ce-4691-966e-03b5aa74993f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:39.712107 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c7632-51ce-4691-966e-03b5aa74993f admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:39.724494 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1356/2712] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:02:39.729416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7fad56-6060-45a6-9576-fd3bff6b002e admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:39.740937 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7fad56-6060-45a6-9576-fd3bff6b002e admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:39.745729 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76b31a-7660-4cdc-b996-d184b0b424e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:39.746403 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76b31a-7660-4cdc-b996-d184b0b424e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:39.746689 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76b31a-7660-4cdc-b996-d184b0b424e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:39.746967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76b31a-7660-4cdc-b996-d184b0b424e8 admin admin] PATH_INFO: `/v3/projects/41638a3cf5964976b52c14471de71bcd/users/9863d41f38b54482bb6ada74c376c9a6/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:39.763237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76b31a-7660-4cdc-b996-d184b0b424e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41638a3cf5964976b52c14471de71bcd, user_id=9863d41f38b54482bb6ada74c376c9a6, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:39.766304 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76b31a-7660-4cdc-b996-d184b0b424e8 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:39.846382 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1357/2713] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:02:39 2022] PUT /identity/v3/projects/41638a3cf5964976b52c14471de71bcd/users/9863d41f38b54482bb6ada74c376c9a6/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:02:39.862034 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f9a1d-9b7d-4bd2-ac29-f8c68e2eab2c None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:39.862477 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f9a1d-9b7d-4bd2-ac29-f8c68e2eab2c None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:39.862758 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f9a1d-9b7d-4bd2-ac29-f8c68e2eab2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:39.894041 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-641f9a1d-9b7d-4bd2-ac29-f8c68e2eab2c None None] MFA Rules not processed for user `9863d41f38b54482bb6ada74c376c9a6`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:39.895268 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-641f9a1d-9b7d-4bd2-ac29-f8c68e2eab2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:39.970001 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1357/2714] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:02:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:39.976199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76b31a-7660-4cdc-b996-d184b0b424e8 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:39.986748 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:40.043924 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76b31a-7660-4cdc-b996-d184b0b424e8 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:40.049325 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c0382-9cc4-40eb-8144-6c2ef5382bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:40.049990 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c0382-9cc4-40eb-8144-6c2ef5382bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:40.050281 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c0382-9cc4-40eb-8144-6c2ef5382bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:40.050554 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c0382-9cc4-40eb-8144-6c2ef5382bd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:40.051285 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c0382-9cc4-40eb-8144-6c2ef5382bd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:40.054249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c0382-9cc4-40eb-8144-6c2ef5382bd9 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:40.124988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1358/2715] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:02:39 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:02:40.129132 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f9a1d-9b7d-4bd2-ac29-f8c68e2eab2c None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:40.140441 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f9a1d-9b7d-4bd2-ac29-f8c68e2eab2c None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:40.171176 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:40.219524 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadd84c-acb9-4aed-a334-52f71af2e5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:40.220305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadd84c-acb9-4aed-a334-52f71af2e5ce admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:40.220811 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadd84c-acb9-4aed-a334-52f71af2e5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:40.221212 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadd84c-acb9-4aed-a334-52f71af2e5ce admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:40.222208 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeadd84c-acb9-4aed-a334-52f71af2e5ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:40.224902 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeadd84c-acb9-4aed-a334-52f71af2e5ce admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:40.337674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1358/2716] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:02:40 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:02:40.343265 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c0382-9cc4-40eb-8144-6c2ef5382bd9 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:40.356573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c0382-9cc4-40eb-8144-6c2ef5382bd9 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:40.363801 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bff2a2-2476-44ea-a8c7-32e28063fb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:40.365100 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bff2a2-2476-44ea-a8c7-32e28063fb29 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:40.365635 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bff2a2-2476-44ea-a8c7-32e28063fb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:40.365972 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bff2a2-2476-44ea-a8c7-32e28063fb29 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:40.366722 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bff2a2-2476-44ea-a8c7-32e28063fb29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:40.368815 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bff2a2-2476-44ea-a8c7-32e28063fb29 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:40.381342 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1359/2717] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:02:40.385587 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadd84c-acb9-4aed-a334-52f71af2e5ce admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:40.397020 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadd84c-acb9-4aed-a334-52f71af2e5ce admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:40.401778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fde0d6-b39f-4d41-9335-ab768d5621d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:40.402424 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fde0d6-b39f-4d41-9335-ab768d5621d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:40.402706 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fde0d6-b39f-4d41-9335-ab768d5621d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:40.403008 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fde0d6-b39f-4d41-9335-ab768d5621d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:40.403759 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fde0d6-b39f-4d41-9335-ab768d5621d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:40.405398 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fde0d6-b39f-4d41-9335-ab768d5621d4 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:40.416318 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1359/2718] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:02:40.423903 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bff2a2-2476-44ea-a8c7-32e28063fb29 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:40.440244 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bff2a2-2476-44ea-a8c7-32e28063fb29 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:40.445058 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ce00a-79af-41c5-8eb0-3b5a6b9e76de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:40.445726 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ce00a-79af-41c5-8eb0-3b5a6b9e76de admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:40.446154 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ce00a-79af-41c5-8eb0-3b5a6b9e76de admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:40.446292 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ce00a-79af-41c5-8eb0-3b5a6b9e76de admin admin] PATH_INFO: `/v3/projects/867a5ee0992748ff8bfa6e984e980e27/users/c627464837154c6a8f5be18d39287422/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:40.462822 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ce00a-79af-41c5-8eb0-3b5a6b9e76de admin admin] RBAC: Authorizing `identity:create_grant(project_id=867a5ee0992748ff8bfa6e984e980e27, user_id=c627464837154c6a8f5be18d39287422, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:40.465555 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ce00a-79af-41c5-8eb0-3b5a6b9e76de admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:40.564585 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1360/2719] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:02:40 2022] PUT /identity/v3/projects/867a5ee0992748ff8bfa6e984e980e27/users/c627464837154c6a8f5be18d39287422/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:02:40.576285 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e105624-c2bb-4864-a01b-853328e4229d None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:40.576563 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e105624-c2bb-4864-a01b-853328e4229d None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:40.576839 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e105624-c2bb-4864-a01b-853328e4229d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:40.607506 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-0e105624-c2bb-4864-a01b-853328e4229d None None] MFA Rules not processed for user `c627464837154c6a8f5be18d39287422`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:40.608770 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-0e105624-c2bb-4864-a01b-853328e4229d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:40.678577 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1360/2720] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:02:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:40.683165 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ce00a-79af-41c5-8eb0-3b5a6b9e76de admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:40.749790 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ce00a-79af-41c5-8eb0-3b5a6b9e76de admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:40.754930 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddccca-4430-4709-a483-24d64a345382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:40.755595 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddccca-4430-4709-a483-24d64a345382 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:40.755883 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddccca-4430-4709-a483-24d64a345382 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:40.756159 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddccca-4430-4709-a483-24d64a345382 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:40.756832 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddccca-4430-4709-a483-24d64a345382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:40.758757 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddccca-4430-4709-a483-24d64a345382 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:40.853637 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1361/2721] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:02:40 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:02:40.858561 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e105624-c2bb-4864-a01b-853328e4229d None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:40.870468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e105624-c2bb-4864-a01b-853328e4229d None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:40.932760 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0490afc-526a-4417-aee3-e800eebb72ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:40.933294 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0490afc-526a-4417-aee3-e800eebb72ba admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:40.933572 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0490afc-526a-4417-aee3-e800eebb72ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:40.933843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0490afc-526a-4417-aee3-e800eebb72ba admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:40.934491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0490afc-526a-4417-aee3-e800eebb72ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:40.937643 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0490afc-526a-4417-aee3-e800eebb72ba admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:41.015211 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1361/2722] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:02:40 2022] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:02:41.019823 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddccca-4430-4709-a483-24d64a345382 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:41.034418 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddccca-4430-4709-a483-24d64a345382 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:41.040332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ea655-af43-4b43-99c4-d694c48b7e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:41.041180 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ea655-af43-4b43-99c4-d694c48b7e3a admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:41.041467 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ea655-af43-4b43-99c4-d694c48b7e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:41.041737 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ea655-af43-4b43-99c4-d694c48b7e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:41.042410 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ea655-af43-4b43-99c4-d694c48b7e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:41.044716 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ea655-af43-4b43-99c4-d694c48b7e3a admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:41.056286 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1362/2723] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:02:41.062724 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0490afc-526a-4417-aee3-e800eebb72ba admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:41.073133 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0490afc-526a-4417-aee3-e800eebb72ba admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:41.077823 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e193167-7a11-4cba-a33d-25508e94b275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:41.078487 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e193167-7a11-4cba-a33d-25508e94b275 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:41.078766 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e193167-7a11-4cba-a33d-25508e94b275 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:41.079046 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e193167-7a11-4cba-a33d-25508e94b275 admin admin] PATH_INFO: `/v3/projects/4c9986355ddb45fe9d8cc618f8c0f9ea/users/3ddb6bdf43b14835869bc88ba97a57a3/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:41.095330 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e193167-7a11-4cba-a33d-25508e94b275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c9986355ddb45fe9d8cc618f8c0f9ea, user_id=3ddb6bdf43b14835869bc88ba97a57a3, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:41.098011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e193167-7a11-4cba-a33d-25508e94b275 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:41.209314 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1362/2724] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:02:41 2022] PUT /identity/v3/projects/4c9986355ddb45fe9d8cc618f8c0f9ea/users/3ddb6bdf43b14835869bc88ba97a57a3/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:02:41.213420 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ea655-af43-4b43-99c4-d694c48b7e3a admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:41.230566 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ea655-af43-4b43-99c4-d694c48b7e3a admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:41.281422 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:41.311161 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b3485-ee03-4903-baf9-51e66c080881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:41.311815 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b3485-ee03-4903-baf9-51e66c080881 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:41.312100 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b3485-ee03-4903-baf9-51e66c080881 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:41.312374 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b3485-ee03-4903-baf9-51e66c080881 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:41.313135 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b3485-ee03-4903-baf9-51e66c080881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:41.314746 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b3485-ee03-4903-baf9-51e66c080881 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:41.325468 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1363/2725] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:02:41.329730 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e193167-7a11-4cba-a33d-25508e94b275 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:41.336719 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:41.341315 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e193167-7a11-4cba-a33d-25508e94b275 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:41.351849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c1aa9-d1eb-4224-81c7-9643a9a09fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:41.351849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c1aa9-d1eb-4224-81c7-9643a9a09fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:41.351849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c1aa9-d1eb-4224-81c7-9643a9a09fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:41.351849 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c1aa9-d1eb-4224-81c7-9643a9a09fc5 admin admin] PATH_INFO: `/v3/projects/4c9986355ddb45fe9d8cc618f8c0f9ea/users/3ddb6bdf43b14835869bc88ba97a57a3/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:41.352340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c1aa9-d1eb-4224-81c7-9643a9a09fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c9986355ddb45fe9d8cc618f8c0f9ea, user_id=3ddb6bdf43b14835869bc88ba97a57a3, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:41.352340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c1aa9-d1eb-4224-81c7-9643a9a09fc5 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:41.363886 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1363/2726] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:02:41 2022] PUT /identity/v3/projects/4c9986355ddb45fe9d8cc618f8c0f9ea/users/3ddb6bdf43b14835869bc88ba97a57a3/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:02:41.374204 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568c2da-c6bf-4e75-b12f-ac44d31d334d None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:41.374491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568c2da-c6bf-4e75-b12f-ac44d31d334d None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:41.374872 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568c2da-c6bf-4e75-b12f-ac44d31d334d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:41.403067 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-c568c2da-c6bf-4e75-b12f-ac44d31d334d None None] MFA Rules not processed for user `3ddb6bdf43b14835869bc88ba97a57a3`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:41.404875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c568c2da-c6bf-4e75-b12f-ac44d31d334d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:41.473997 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1364/2727] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:02:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:41.485783 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c1aa9-d1eb-4224-81c7-9643a9a09fc5 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:41.488418 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-af8c1aa9-d1eb-4224-81c7-9643a9a09fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:41.575708 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c1aa9-d1eb-4224-81c7-9643a9a09fc5 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:41.579552 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b311e2-be32-4e8c-96ec-4890a13f5241 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:41.580154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b311e2-be32-4e8c-96ec-4890a13f5241 service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:41.580441 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b311e2-be32-4e8c-96ec-4890a13f5241 service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:41.580729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b311e2-be32-4e8c-96ec-4890a13f5241 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:41.643073 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b311e2-be32-4e8c-96ec-4890a13f5241 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:41.644589 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b311e2-be32-4e8c-96ec-4890a13f5241 service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:41.654669 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1364/2728] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:02:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:02:43.752534 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568c2da-c6bf-4e75-b12f-ac44d31d334d None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:43.754040 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c568c2da-c6bf-4e75-b12f-ac44d31d334d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:43.766722 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568c2da-c6bf-4e75-b12f-ac44d31d334d None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:43.770344 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761980e5-963d-4dc2-b996-12043e9cc3c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:43.770952 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761980e5-963d-4dc2-b996-12043e9cc3c0 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:43.771228 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761980e5-963d-4dc2-b996-12043e9cc3c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:43.771540 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761980e5-963d-4dc2-b996-12043e9cc3c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:43.834545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761980e5-963d-4dc2-b996-12043e9cc3c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:43.836049 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761980e5-963d-4dc2-b996-12043e9cc3c0 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:43.846880 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1365/2729] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:02:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:02:45.589684 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b311e2-be32-4e8c-96ec-4890a13f5241 service cinder] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:45.599578 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b311e2-be32-4e8c-96ec-4890a13f5241 service cinder] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:45.604671 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f0643-0468-4a75-8417-c1f66795104a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:45.605403 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f0643-0468-4a75-8417-c1f66795104a service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:45.605706 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f0643-0468-4a75-8417-c1f66795104a service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:45.605987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f0643-0468-4a75-8417-c1f66795104a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:45.617182 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f0643-0468-4a75-8417-c1f66795104a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:45.618735 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f0643-0468-4a75-8417-c1f66795104a service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:45.630157 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1365/2730] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:02:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:02:50.660345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761980e5-963d-4dc2-b996-12043e9cc3c0 service cinder] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:50.726666 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=100 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:50.738972 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761980e5-963d-4dc2-b996-12043e9cc3c0 service cinder] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:50.743787 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f1b20-7b8e-4644-9123-563fbfe5dea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:50.744568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f1b20-7b8e-4644-9123-563fbfe5dea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:50.744891 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f1b20-7b8e-4644-9123-563fbfe5dea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:50.745210 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f1b20-7b8e-4644-9123-563fbfe5dea3 admin admin] PATH_INFO: `/v3/users/9863d41f38b54482bb6ada74c376c9a6` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:50.746445 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f1b20-7b8e-4644-9123-563fbfe5dea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9863d41f38b54482bb6ada74c376c9a6)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:50.749035 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f1b20-7b8e-4644-9123-563fbfe5dea3 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:50.994198 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-535f1b20-7b8e-4644-9123-563fbfe5dea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9863d41f38b54482bb6ada74c376c9a6'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:51.123112 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-535f1b20-7b8e-4644-9123-563fbfe5dea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9863d41f38b54482bb6ada74c376c9a6'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:51.131708 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-535f1b20-7b8e-4644-9123-563fbfe5dea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9863d41f38b54482bb6ada74c376c9a6'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:51.145927 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-535f1b20-7b8e-4644-9123-563fbfe5dea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9863d41f38b54482bb6ada74c376c9a6'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:51.146676 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-535f1b20-7b8e-4644-9123-563fbfe5dea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9863d41f38b54482bb6ada74c376c9a6'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:51.153009 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1366/2731] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:02:50 2022] DELETE /identity/v3/users/9863d41f38b54482bb6ada74c376c9a6 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:02:51.158128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ea964-8094-422a-9aba-b829acc9fbe3 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:51.158690 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ea964-8094-422a-9aba-b829acc9fbe3 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:51.158690 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ea964-8094-422a-9aba-b829acc9fbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:51.179191 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-b35ea964-8094-422a-9aba-b829acc9fbe3 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:51.180949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b35ea964-8094-422a-9aba-b829acc9fbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:51.247730 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1366/2732] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:51.258111 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f1b20-7b8e-4644-9123-563fbfe5dea3 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:51.259674 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-535f1b20-7b8e-4644-9123-563fbfe5dea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:51.322128 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f1b20-7b8e-4644-9123-563fbfe5dea3 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:51.326539 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8235e-2484-4751-9903-fa4ffeb947b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:51.327159 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8235e-2484-4751-9903-fa4ffeb947b2 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:51.327488 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8235e-2484-4751-9903-fa4ffeb947b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:51.327764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8235e-2484-4751-9903-fa4ffeb947b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:51.337861 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8235e-2484-4751-9903-fa4ffeb947b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:51.339329 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8235e-2484-4751-9903-fa4ffeb947b2 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:51.350483 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1367/2733] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:02:51.896450 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ea964-8094-422a-9aba-b829acc9fbe3 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:51.901978 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-b35ea964-8094-422a-9aba-b829acc9fbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:51.913937 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ea964-8094-422a-9aba-b829acc9fbe3 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:51.920402 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2738c6-0629-48b5-93c5-ee704a235cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:51.921201 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2738c6-0629-48b5-93c5-ee704a235cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:51.921584 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2738c6-0629-48b5-93c5-ee704a235cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:51.922027 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2738c6-0629-48b5-93c5-ee704a235cc5 admin admin] PATH_INFO: `/v3/projects/41638a3cf5964976b52c14471de71bcd` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:51.923518 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2738c6-0629-48b5-93c5-ee704a235cc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41638a3cf5964976b52c14471de71bcd)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:51.926589 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2738c6-0629-48b5-93c5-ee704a235cc5 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:51.939258 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:52.053936 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-ba2738c6-0629-48b5-93c5-ee704a235cc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41638a3cf5964976b52c14471de71bcd', 'request_id': 'req-ba2738c6-0629-48b5-93c5-ee704a235cc5'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:52.062656 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-ba2738c6-0629-48b5-93c5-ee704a235cc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41638a3cf5964976b52c14471de71bcd', 'request_id': 'req-ba2738c6-0629-48b5-93c5-ee704a235cc5'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:52.070551 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-ba2738c6-0629-48b5-93c5-ee704a235cc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41638a3cf5964976b52c14471de71bcd', 'request_id': 'req-ba2738c6-0629-48b5-93c5-ee704a235cc5'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:52.139932 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-ba2738c6-0629-48b5-93c5-ee704a235cc5 admin admin] The token cache is being invalidate because project 41638a3cf5964976b52c14471de71bcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:02:52.140220 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-ba2738c6-0629-48b5-93c5-ee704a235cc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:52.140926 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-ba2738c6-0629-48b5-93c5-ee704a235cc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:52.142480 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1367/2734] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:02:51 2022] DELETE /identity/v3/projects/41638a3cf5964976b52c14471de71bcd => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:02:52.147036 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8235e-2484-4751-9903-fa4ffeb947b2 service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:52.157955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8235e-2484-4751-9903-fa4ffeb947b2 service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:52.226064 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4cadf-3dc2-4c98-93de-d292400808a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:52.226709 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4cadf-3dc2-4c98-93de-d292400808a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:52.226983 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4cadf-3dc2-4c98-93de-d292400808a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:52.227256 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4cadf-3dc2-4c98-93de-d292400808a3 admin admin] PATH_INFO: `/v3/users/c627464837154c6a8f5be18d39287422` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:52.228512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4cadf-3dc2-4c98-93de-d292400808a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c627464837154c6a8f5be18d39287422)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:52.230501 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4cadf-3dc2-4c98-93de-d292400808a3 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:52.250648 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:52.419217 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-5cf4cadf-3dc2-4c98-93de-d292400808a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c627464837154c6a8f5be18d39287422'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:52.529129 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-5cf4cadf-3dc2-4c98-93de-d292400808a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c627464837154c6a8f5be18d39287422'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:52.538356 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-5cf4cadf-3dc2-4c98-93de-d292400808a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c627464837154c6a8f5be18d39287422'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:52.554003 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-5cf4cadf-3dc2-4c98-93de-d292400808a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c627464837154c6a8f5be18d39287422'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:52.554753 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-5cf4cadf-3dc2-4c98-93de-d292400808a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c627464837154c6a8f5be18d39287422'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:52.562323 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1368/2735] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:02:52 2022] DELETE /identity/v3/users/c627464837154c6a8f5be18d39287422 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:02:53.051533 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2738c6-0629-48b5-93c5-ee704a235cc5 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:53.053632 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-ba2738c6-0629-48b5-93c5-ee704a235cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:53.068827 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2738c6-0629-48b5-93c5-ee704a235cc5 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:53.153947 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f135d-b0f6-4164-84e8-4f5f2316743d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:53.154641 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f135d-b0f6-4164-84e8-4f5f2316743d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:53.156190 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f135d-b0f6-4164-84e8-4f5f2316743d admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:53.156190 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f135d-b0f6-4164-84e8-4f5f2316743d admin admin] PATH_INFO: `/v3/projects/867a5ee0992748ff8bfa6e984e980e27` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:53.156524 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f135d-b0f6-4164-84e8-4f5f2316743d admin admin] RBAC: Authorizing `identity:delete_project(project_id=867a5ee0992748ff8bfa6e984e980e27)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:53.158397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f135d-b0f6-4164-84e8-4f5f2316743d admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:53.298618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c22f135d-b0f6-4164-84e8-4f5f2316743d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '867a5ee0992748ff8bfa6e984e980e27', 'request_id': 'req-c22f135d-b0f6-4164-84e8-4f5f2316743d'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:53.309064 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c22f135d-b0f6-4164-84e8-4f5f2316743d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '867a5ee0992748ff8bfa6e984e980e27', 'request_id': 'req-c22f135d-b0f6-4164-84e8-4f5f2316743d'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:53.321705 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c22f135d-b0f6-4164-84e8-4f5f2316743d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '867a5ee0992748ff8bfa6e984e980e27', 'request_id': 'req-c22f135d-b0f6-4164-84e8-4f5f2316743d'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:53.430437 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c22f135d-b0f6-4164-84e8-4f5f2316743d admin admin] The token cache is being invalidate because project 867a5ee0992748ff8bfa6e984e980e27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:02:53.430819 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c22f135d-b0f6-4164-84e8-4f5f2316743d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:53.431628 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c22f135d-b0f6-4164-84e8-4f5f2316743d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:53.433249 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1368/2736] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:02:53 2022] DELETE /identity/v3/projects/867a5ee0992748ff8bfa6e984e980e27 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:02:53.438568 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4cadf-3dc2-4c98-93de-d292400808a3 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:53.442553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-5cf4cadf-3dc2-4c98-93de-d292400808a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:53.456597 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4cadf-3dc2-4c98-93de-d292400808a3 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:53.532690 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5486a7-ee2c-46a6-bcec-a545b8a3019d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:53.533345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5486a7-ee2c-46a6-bcec-a545b8a3019d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:53.533629 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5486a7-ee2c-46a6-bcec-a545b8a3019d admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:53.533904 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5486a7-ee2c-46a6-bcec-a545b8a3019d admin admin] PATH_INFO: `/v3/users/3ddb6bdf43b14835869bc88ba97a57a3` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:53.535121 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5486a7-ee2c-46a6-bcec-a545b8a3019d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ddb6bdf43b14835869bc88ba97a57a3)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:53.537117 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5486a7-ee2c-46a6-bcec-a545b8a3019d admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:53.753384 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-cc5486a7-ee2c-46a6-bcec-a545b8a3019d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ddb6bdf43b14835869bc88ba97a57a3'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:53.854583 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-cc5486a7-ee2c-46a6-bcec-a545b8a3019d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ddb6bdf43b14835869bc88ba97a57a3'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:53.864892 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-cc5486a7-ee2c-46a6-bcec-a545b8a3019d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ddb6bdf43b14835869bc88ba97a57a3'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:53.880658 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-cc5486a7-ee2c-46a6-bcec-a545b8a3019d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ddb6bdf43b14835869bc88ba97a57a3'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:53.881660 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-cc5486a7-ee2c-46a6-bcec-a545b8a3019d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ddb6bdf43b14835869bc88ba97a57a3'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:53.888813 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1369/2737] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:02:53 2022] DELETE /identity/v3/users/3ddb6bdf43b14835869bc88ba97a57a3 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:02:54.365498 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f135d-b0f6-4164-84e8-4f5f2316743d admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:54.368390 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c22f135d-b0f6-4164-84e8-4f5f2316743d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:54.391161 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f135d-b0f6-4164-84e8-4f5f2316743d admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:54.433955 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:54.491231 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8226a-42e7-4362-abd0-2e5959462217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:54.492362 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8226a-42e7-4362-abd0-2e5959462217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:54.492851 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8226a-42e7-4362-abd0-2e5959462217 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:54.493344 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8226a-42e7-4362-abd0-2e5959462217 admin admin] PATH_INFO: `/v3/projects/4c9986355ddb45fe9d8cc618f8c0f9ea` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:54.495458 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8226a-42e7-4362-abd0-2e5959462217 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c9986355ddb45fe9d8cc618f8c0f9ea)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:54.499956 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8226a-42e7-4362-abd0-2e5959462217 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:54.634101 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-74a8226a-42e7-4362-abd0-2e5959462217 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c9986355ddb45fe9d8cc618f8c0f9ea', 'request_id': 'req-74a8226a-42e7-4362-abd0-2e5959462217'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:54.641115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-74a8226a-42e7-4362-abd0-2e5959462217 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c9986355ddb45fe9d8cc618f8c0f9ea', 'request_id': 'req-74a8226a-42e7-4362-abd0-2e5959462217'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:54.647637 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-74a8226a-42e7-4362-abd0-2e5959462217 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c9986355ddb45fe9d8cc618f8c0f9ea', 'request_id': 'req-74a8226a-42e7-4362-abd0-2e5959462217'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:54.744937 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-74a8226a-42e7-4362-abd0-2e5959462217 admin admin] The token cache is being invalidate because project 4c9986355ddb45fe9d8cc618f8c0f9ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:02:54.745241 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-74a8226a-42e7-4362-abd0-2e5959462217 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:54.745920 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-74a8226a-42e7-4362-abd0-2e5959462217 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:54.747952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1369/2738] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:02:54 2022] DELETE /identity/v3/projects/4c9986355ddb45fe9d8cc618f8c0f9ea => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:02:54.753097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64ed4e-54a8-4295-93f1-0f1939169bbd None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:54.753660 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64ed4e-54a8-4295-93f1-0f1939169bbd None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:54.753660 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64ed4e-54a8-4295-93f1-0f1939169bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:54.774581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-9d64ed4e-54a8-4295-93f1-0f1939169bbd None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:54.775836 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-9d64ed4e-54a8-4295-93f1-0f1939169bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:54.785413 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:54.842636 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1370/2739] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:54.912340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa6904-bdc8-4ce6-ab2f-c013a3209906 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:54.912602 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa6904-bdc8-4ce6-ab2f-c013a3209906 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:54.912774 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa6904-bdc8-4ce6-ab2f-c013a3209906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:54.941375 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-05aa6904-bdc8-4ce6-ab2f-c013a3209906 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:54.943060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-05aa6904-bdc8-4ce6-ab2f-c013a3209906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:54.954244 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1370/2740] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:54.958911 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64ed4e-54a8-4295-93f1-0f1939169bbd None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:54.969570 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64ed4e-54a8-4295-93f1-0f1939169bbd None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:54.974414 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4507a23-d692-4ec1-8033-ac81038e86ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:54.975029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4507a23-d692-4ec1-8033-ac81038e86ab admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:54.975305 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4507a23-d692-4ec1-8033-ac81038e86ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:54.975607 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4507a23-d692-4ec1-8033-ac81038e86ab admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:54.976258 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4507a23-d692-4ec1-8033-ac81038e86ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:02:54.976564 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4507a23-d692-4ec1-8033-ac81038e86ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:54.978356 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4507a23-d692-4ec1-8033-ac81038e86ab admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:54.992510 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1371/2741] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 14:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:02:54.997337 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa6904-bdc8-4ce6-ab2f-c013a3209906 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:55.007952 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa6904-bdc8-4ce6-ab2f-c013a3209906 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:55.013203 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c3545-51ed-4924-bc2d-f24d94f469d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:55.013820 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c3545-51ed-4924-bc2d-f24d94f469d2 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:55.014096 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c3545-51ed-4924-bc2d-f24d94f469d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:55.014369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c3545-51ed-4924-bc2d-f24d94f469d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:55.015004 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c3545-51ed-4924-bc2d-f24d94f469d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:55.016958 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c3545-51ed-4924-bc2d-f24d94f469d2 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:55.102173 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1371/2742] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:02:54 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:02:55.108566 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4507a23-d692-4ec1-8033-ac81038e86ab admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:55.120717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4507a23-d692-4ec1-8033-ac81038e86ab admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:55.195785 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8ef6f-043f-4da4-958d-e94431d39fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:55.196318 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8ef6f-043f-4da4-958d-e94431d39fcb admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:55.196600 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8ef6f-043f-4da4-958d-e94431d39fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:55.196874 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8ef6f-043f-4da4-958d-e94431d39fcb admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:55.197603 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8ef6f-043f-4da4-958d-e94431d39fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:55.199580 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8ef6f-043f-4da4-958d-e94431d39fcb admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:55.293227 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1372/2743] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:02:55 2022] POST /identity/v3/users => generated 285 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:02:55.298061 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c3545-51ed-4924-bc2d-f24d94f469d2 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:55.309296 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c3545-51ed-4924-bc2d-f24d94f469d2 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:55.314099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4b8bd-cdc6-47c4-902b-56dd13694ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:55.314715 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4b8bd-cdc6-47c4-902b-56dd13694ffe admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:55.314992 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4b8bd-cdc6-47c4-902b-56dd13694ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:55.315262 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4b8bd-cdc6-47c4-902b-56dd13694ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:55.315961 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4b8bd-cdc6-47c4-902b-56dd13694ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:55.317608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4b8bd-cdc6-47c4-902b-56dd13694ffe admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:55.329460 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1372/2744] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:02:55.334090 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8ef6f-043f-4da4-958d-e94431d39fcb admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:55.345414 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8ef6f-043f-4da4-958d-e94431d39fcb admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:55.350491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44debe9b-00cf-4b94-b96c-ba8f49823fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:55.351117 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44debe9b-00cf-4b94-b96c-ba8f49823fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:55.351438 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44debe9b-00cf-4b94-b96c-ba8f49823fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:55.351718 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44debe9b-00cf-4b94-b96c-ba8f49823fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:55.352492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44debe9b-00cf-4b94-b96c-ba8f49823fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:55.354179 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44debe9b-00cf-4b94-b96c-ba8f49823fd9 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:55.367123 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1373/2745] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:02:55.374013 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4b8bd-cdc6-47c4-902b-56dd13694ffe admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:55.389114 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4b8bd-cdc6-47c4-902b-56dd13694ffe admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:55.394252 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d721b-eb20-41ed-85d1-5a9e22b9e99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:55.394930 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d721b-eb20-41ed-85d1-5a9e22b9e99c admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:55.395213 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d721b-eb20-41ed-85d1-5a9e22b9e99c admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:55.395518 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d721b-eb20-41ed-85d1-5a9e22b9e99c admin admin] PATH_INFO: `/v3/projects/6cdbd91b73a444c4ae24bbcd5192f440/users/5ca2aad7197d4bffb0efb443f0013a33/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:55.412129 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d721b-eb20-41ed-85d1-5a9e22b9e99c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cdbd91b73a444c4ae24bbcd5192f440, user_id=5ca2aad7197d4bffb0efb443f0013a33, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:55.414813 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d721b-eb20-41ed-85d1-5a9e22b9e99c admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:55.529906 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1373/2746] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:02:55 2022] PUT /identity/v3/projects/6cdbd91b73a444c4ae24bbcd5192f440/users/5ca2aad7197d4bffb0efb443f0013a33/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:02:55.541071 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51edb9-2df8-42a1-bd52-f807da9c8072 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:55.541427 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51edb9-2df8-42a1-bd52-f807da9c8072 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:55.541643 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51edb9-2df8-42a1-bd52-f807da9c8072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:55.577571 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-7b51edb9-2df8-42a1-bd52-f807da9c8072 None None] MFA Rules not processed for user `5ca2aad7197d4bffb0efb443f0013a33`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:55.578815 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-7b51edb9-2df8-42a1-bd52-f807da9c8072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:55.649909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1374/2747] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:02:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:02:55.662731 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d721b-eb20-41ed-85d1-5a9e22b9e99c admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:55.664554 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-aa1d721b-eb20-41ed-85d1-5a9e22b9e99c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:55.742477 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d721b-eb20-41ed-85d1-5a9e22b9e99c admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:55.746709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff88eb4-123f-4019-8fe1-96ad601969bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc11fe25135d4bf1b1a06b8619e4a2e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:55.747331 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff88eb4-123f-4019-8fe1-96ad601969bb service glance] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:55.747716 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff88eb4-123f-4019-8fe1-96ad601969bb service glance] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:55.747989 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff88eb4-123f-4019-8fe1-96ad601969bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:55.755092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:55.758039 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff88eb4-123f-4019-8fe1-96ad601969bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:55.759544 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff88eb4-123f-4019-8fe1-96ad601969bb service glance] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:55.770421 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1374/2748] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:02:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:03:05.646871 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:05.859458 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:16.118437 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51edb9-2df8-42a1-bd52-f807da9c8072 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:16.120111 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-7b51edb9-2df8-42a1-bd52-f807da9c8072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:03:16.186316 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51edb9-2df8-42a1-bd52-f807da9c8072 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:16.190097 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aaaa69-98df-4847-8c33-8f3fab5b6344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:16.190727 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aaaa69-98df-4847-8c33-8f3fab5b6344 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:16.191009 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aaaa69-98df-4847-8c33-8f3fab5b6344 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:16.191281 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aaaa69-98df-4847-8c33-8f3fab5b6344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:16.193215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-11aaaa69-98df-4847-8c33-8f3fab5b6344 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:03:16.286255 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aaaa69-98df-4847-8c33-8f3fab5b6344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:16.287780 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aaaa69-98df-4847-8c33-8f3fab5b6344 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:16.299712 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1375/2749] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:03:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:03:21.322357 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff88eb4-123f-4019-8fe1-96ad601969bb service glance] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:21.324809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-9ff88eb4-123f-4019-8fe1-96ad601969bb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:03:21.349349 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff88eb4-123f-4019-8fe1-96ad601969bb service glance] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:21.355037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2642907-0764-483f-a372-e695104d9e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:21.356338 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2642907-0764-483f-a372-e695104d9e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:21.356662 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2642907-0764-483f-a372-e695104d9e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:21.356980 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2642907-0764-483f-a372-e695104d9e09 admin admin] PATH_INFO: `/v3/users/658108c26fb74eba911e249819f8b290` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:21.358275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2642907-0764-483f-a372-e695104d9e09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=658108c26fb74eba911e249819f8b290)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:21.360901 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2642907-0764-483f-a372-e695104d9e09 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:21.584659 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-d2642907-0764-483f-a372-e695104d9e09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '658108c26fb74eba911e249819f8b290'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:03:21.585278 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-d2642907-0764-483f-a372-e695104d9e09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '658108c26fb74eba911e249819f8b290'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:03:21.602979 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-d2642907-0764-483f-a372-e695104d9e09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '658108c26fb74eba911e249819f8b290'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:03:21.612719 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-d2642907-0764-483f-a372-e695104d9e09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '658108c26fb74eba911e249819f8b290'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:03:21.724270 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-d2642907-0764-483f-a372-e695104d9e09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '658108c26fb74eba911e249819f8b290'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:03:21.737779 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1375/2750] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:03:21 2022] DELETE /identity/v3/users/658108c26fb74eba911e249819f8b290 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:03:22.074394 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aaaa69-98df-4847-8c33-8f3fab5b6344 service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:22.091601 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aaaa69-98df-4847-8c33-8f3fab5b6344 service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:22.177623 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f6aa2-6072-4f8e-9730-6ebfca8d6efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:22.178262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f6aa2-6072-4f8e-9730-6ebfca8d6efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:22.178543 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f6aa2-6072-4f8e-9730-6ebfca8d6efe admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:22.178817 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f6aa2-6072-4f8e-9730-6ebfca8d6efe admin admin] PATH_INFO: `/v3/projects/a5ccb0fe770a41e99a822a6d4f88d401` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:22.179997 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f6aa2-6072-4f8e-9730-6ebfca8d6efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5ccb0fe770a41e99a822a6d4f88d401)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:22.181882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f6aa2-6072-4f8e-9730-6ebfca8d6efe admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:22.322069 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-064f6aa2-6072-4f8e-9730-6ebfca8d6efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5ccb0fe770a41e99a822a6d4f88d401', 'request_id': 'req-064f6aa2-6072-4f8e-9730-6ebfca8d6efe'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:03:22.324091 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:22.327965 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-064f6aa2-6072-4f8e-9730-6ebfca8d6efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5ccb0fe770a41e99a822a6d4f88d401', 'request_id': 'req-064f6aa2-6072-4f8e-9730-6ebfca8d6efe'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:03:22.448287 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-064f6aa2-6072-4f8e-9730-6ebfca8d6efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5ccb0fe770a41e99a822a6d4f88d401', 'request_id': 'req-064f6aa2-6072-4f8e-9730-6ebfca8d6efe'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:03:22.461214 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-064f6aa2-6072-4f8e-9730-6ebfca8d6efe admin admin] The token cache is being invalidate because project a5ccb0fe770a41e99a822a6d4f88d401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:03:22.461510 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-064f6aa2-6072-4f8e-9730-6ebfca8d6efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:03:22.462220 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-064f6aa2-6072-4f8e-9730-6ebfca8d6efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:03:22.463819 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1376/2751] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:03:22 2022] DELETE /identity/v3/projects/a5ccb0fe770a41e99a822a6d4f88d401 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:03:22.469554 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9d384-6cad-4250-a750-d61b688c1a16 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:22.470245 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9d384-6cad-4250-a750-d61b688c1a16 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:22.470245 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9d384-6cad-4250-a750-d61b688c1a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:22.493473 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-d4c9d384-6cad-4250-a750-d61b688c1a16 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:03:22.494725 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-d4c9d384-6cad-4250-a750-d61b688c1a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:03:22.565345 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1376/2752] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:03:22.574385 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650e55c-1b31-4a45-8103-25ffdca115c4 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:22.574767 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650e55c-1b31-4a45-8103-25ffdca115c4 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:22.575098 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650e55c-1b31-4a45-8103-25ffdca115c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:22.595790 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-1650e55c-1b31-4a45-8103-25ffdca115c4 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:03:22.597017 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-1650e55c-1b31-4a45-8103-25ffdca115c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:03:22.605037 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1377/2753] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:03:22.610226 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9d384-6cad-4250-a750-d61b688c1a16 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:22.637468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9d384-6cad-4250-a750-d61b688c1a16 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:22.637468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc663c39-1eed-4e07-9831-dcc1e0a81895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:22.637468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc663c39-1eed-4e07-9831-dcc1e0a81895 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:22.637468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc663c39-1eed-4e07-9831-dcc1e0a81895 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:22.637885 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc663c39-1eed-4e07-9831-dcc1e0a81895 admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:22.637885 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc663c39-1eed-4e07-9831-dcc1e0a81895 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:03:22.637885 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc663c39-1eed-4e07-9831-dcc1e0a81895 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:22.637885 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc663c39-1eed-4e07-9831-dcc1e0a81895 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:22.642524 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1377/2754] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 14:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:03:22.646892 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650e55c-1b31-4a45-8103-25ffdca115c4 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:22.657857 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650e55c-1b31-4a45-8103-25ffdca115c4 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:22.662827 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9f361-fe7a-4ef6-b41b-d153d52b01a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:22.663490 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9f361-fe7a-4ef6-b41b-d153d52b01a9 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:22.663795 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9f361-fe7a-4ef6-b41b-d153d52b01a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:22.664040 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9f361-fe7a-4ef6-b41b-d153d52b01a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:22.664677 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9f361-fe7a-4ef6-b41b-d153d52b01a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:22.667889 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9f361-fe7a-4ef6-b41b-d153d52b01a9 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:22.890012 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1378/2755] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:03:22 2022] POST /identity/v3/projects => generated 385 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:03:22.894365 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc663c39-1eed-4e07-9831-dcc1e0a81895 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:22.905306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc663c39-1eed-4e07-9831-dcc1e0a81895 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:22.973865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefecda-33f3-472a-92ef-e04f50cc4802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:22.974480 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefecda-33f3-472a-92ef-e04f50cc4802 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:22.974756 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefecda-33f3-472a-92ef-e04f50cc4802 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:22.975026 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefecda-33f3-472a-92ef-e04f50cc4802 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:22.975694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cefecda-33f3-472a-92ef-e04f50cc4802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:22.977616 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cefecda-33f3-472a-92ef-e04f50cc4802 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:22.986018 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:23.168193 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1378/2756] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:03:22 2022] POST /identity/v3/users => generated 293 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:03:23.172440 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9f361-fe7a-4ef6-b41b-d153d52b01a9 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:23.182533 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9f361-fe7a-4ef6-b41b-d153d52b01a9 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:23.187563 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03abe3d-f341-4e12-a00a-dc674714a04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:23.188152 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03abe3d-f341-4e12-a00a-dc674714a04e admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:23.188431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03abe3d-f341-4e12-a00a-dc674714a04e admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:23.188721 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03abe3d-f341-4e12-a00a-dc674714a04e admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:23.189337 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03abe3d-f341-4e12-a00a-dc674714a04e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:23.190905 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03abe3d-f341-4e12-a00a-dc674714a04e admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:23.201303 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1379/2757] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:03:23.212185 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefecda-33f3-472a-92ef-e04f50cc4802 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:23.222868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefecda-33f3-472a-92ef-e04f50cc4802 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:23.227714 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b0d9b-e8b9-49b3-b8c6-99444169addc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:23.228325 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b0d9b-e8b9-49b3-b8c6-99444169addc admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:23.228603 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b0d9b-e8b9-49b3-b8c6-99444169addc admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:23.228876 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b0d9b-e8b9-49b3-b8c6-99444169addc admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:23.229579 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b0d9b-e8b9-49b3-b8c6-99444169addc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:23.231170 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b0d9b-e8b9-49b3-b8c6-99444169addc admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:23.243766 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1379/2758] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:03:23.250289 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03abe3d-f341-4e12-a00a-dc674714a04e admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:23.262391 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03abe3d-f341-4e12-a00a-dc674714a04e admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:23.271157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649eb76-6d2f-44bf-9a40-7b0161c3b996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:23.271859 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649eb76-6d2f-44bf-9a40-7b0161c3b996 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:23.272142 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649eb76-6d2f-44bf-9a40-7b0161c3b996 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:23.272415 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649eb76-6d2f-44bf-9a40-7b0161c3b996 admin admin] PATH_INFO: `/v3/projects/53d9dd68ca6b4376992d408b1718c070/users/5ca20ec26ae045dbb778dfe190d474ec/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:23.288201 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649eb76-6d2f-44bf-9a40-7b0161c3b996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53d9dd68ca6b4376992d408b1718c070, user_id=5ca20ec26ae045dbb778dfe190d474ec, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:23.290862 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649eb76-6d2f-44bf-9a40-7b0161c3b996 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:23.408618 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1380/2759] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:03:23 2022] PUT /identity/v3/projects/53d9dd68ca6b4376992d408b1718c070/users/5ca20ec26ae045dbb778dfe190d474ec/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:03:23.413868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23a61f-b5d1-4afd-9b00-c9003530852a None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:23.414160 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23a61f-b5d1-4afd-9b00-c9003530852a None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:23.414474 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23a61f-b5d1-4afd-9b00-c9003530852a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:23.443238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-1d23a61f-b5d1-4afd-9b00-c9003530852a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:03:23.443238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-1d23a61f-b5d1-4afd-9b00-c9003530852a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:03:23.508795 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1380/2760] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:03:23.520354 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649eb76-6d2f-44bf-9a40-7b0161c3b996 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:23.522151 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a649eb76-6d2f-44bf-9a40-7b0161c3b996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:03:23.585235 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649eb76-6d2f-44bf-9a40-7b0161c3b996 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:23.589232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348f0cd-b13e-4dab-a359-f0a1efc740c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:23.589890 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348f0cd-b13e-4dab-a359-f0a1efc740c2 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:23.590169 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348f0cd-b13e-4dab-a359-f0a1efc740c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:23.590439 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348f0cd-b13e-4dab-a359-f0a1efc740c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:23.600368 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348f0cd-b13e-4dab-a359-f0a1efc740c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:23.601844 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348f0cd-b13e-4dab-a359-f0a1efc740c2 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:23.615449 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1381/2761] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:03:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:03:26.570624 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23a61f-b5d1-4afd-9b00-c9003530852a None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:26.572997 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-1d23a61f-b5d1-4afd-9b00-c9003530852a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:03:26.594093 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23a61f-b5d1-4afd-9b00-c9003530852a None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:26.602880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78a2d7-56b5-4954-aabd-903a03f2970c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:26.602880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78a2d7-56b5-4954-aabd-903a03f2970c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:26.602880 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78a2d7-56b5-4954-aabd-903a03f2970c admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:26.603580 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78a2d7-56b5-4954-aabd-903a03f2970c admin admin] PATH_INFO: `/v3/users/5ca2aad7197d4bffb0efb443f0013a33` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:26.605991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78a2d7-56b5-4954-aabd-903a03f2970c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ca2aad7197d4bffb0efb443f0013a33)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:26.608590 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78a2d7-56b5-4954-aabd-903a03f2970c admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:26.906895 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-8c78a2d7-56b5-4954-aabd-903a03f2970c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ca2aad7197d4bffb0efb443f0013a33'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:03:26.907868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-8c78a2d7-56b5-4954-aabd-903a03f2970c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ca2aad7197d4bffb0efb443f0013a33'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:03:26.933222 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-8c78a2d7-56b5-4954-aabd-903a03f2970c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ca2aad7197d4bffb0efb443f0013a33'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:03:26.948723 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-8c78a2d7-56b5-4954-aabd-903a03f2970c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ca2aad7197d4bffb0efb443f0013a33'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:03:27.059863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-8c78a2d7-56b5-4954-aabd-903a03f2970c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ca2aad7197d4bffb0efb443f0013a33'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:03:27.071349 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1381/2762] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:03:26 2022] DELETE /identity/v3/users/5ca2aad7197d4bffb0efb443f0013a33 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:03:27.078457 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429982a-7697-4a00-bf81-d1dc7f79e46a None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:27.079283 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429982a-7697-4a00-bf81-d1dc7f79e46a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:27.079624 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429982a-7697-4a00-bf81-d1dc7f79e46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:27.104751 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-9429982a-7697-4a00-bf81-d1dc7f79e46a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:03:27.106487 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-9429982a-7697-4a00-bf81-d1dc7f79e46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:03:27.195199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1382/2763] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:03:27.211652 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78a2d7-56b5-4954-aabd-903a03f2970c admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:27.215332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-8c78a2d7-56b5-4954-aabd-903a03f2970c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:03:27.338145 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78a2d7-56b5-4954-aabd-903a03f2970c admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:27.350289 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99bb0d-c0f1-443d-a25b-5d38ea7a21d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:27.350963 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99bb0d-c0f1-443d-a25b-5d38ea7a21d7 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:27.352178 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99bb0d-c0f1-443d-a25b-5d38ea7a21d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:27.352178 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99bb0d-c0f1-443d-a25b-5d38ea7a21d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:27.367755 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:27.375615 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99bb0d-c0f1-443d-a25b-5d38ea7a21d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:27.379179 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99bb0d-c0f1-443d-a25b-5d38ea7a21d7 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:27.414297 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1382/2764] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:03:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:03:28.122959 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429982a-7697-4a00-bf81-d1dc7f79e46a None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:28.124603 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-9429982a-7697-4a00-bf81-d1dc7f79e46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:03:28.142030 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429982a-7697-4a00-bf81-d1dc7f79e46a None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:28.148181 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d0bf0-f298-44f3-9160-a5cf2037e1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:28.149122 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d0bf0-f298-44f3-9160-a5cf2037e1c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:28.149600 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d0bf0-f298-44f3-9160-a5cf2037e1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:28.150079 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d0bf0-f298-44f3-9160-a5cf2037e1c3 admin admin] PATH_INFO: `/v3/projects/6cdbd91b73a444c4ae24bbcd5192f440` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:28.151738 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d0bf0-f298-44f3-9160-a5cf2037e1c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cdbd91b73a444c4ae24bbcd5192f440)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:28.155263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d0bf0-f298-44f3-9160-a5cf2037e1c3 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:28.176327 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:28.340749 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-257d0bf0-f298-44f3-9160-a5cf2037e1c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cdbd91b73a444c4ae24bbcd5192f440', 'request_id': 'req-257d0bf0-f298-44f3-9160-a5cf2037e1c3'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:03:28.352638 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-257d0bf0-f298-44f3-9160-a5cf2037e1c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cdbd91b73a444c4ae24bbcd5192f440', 'request_id': 'req-257d0bf0-f298-44f3-9160-a5cf2037e1c3'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:03:28.453984 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-257d0bf0-f298-44f3-9160-a5cf2037e1c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cdbd91b73a444c4ae24bbcd5192f440', 'request_id': 'req-257d0bf0-f298-44f3-9160-a5cf2037e1c3'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:03:28.469454 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-257d0bf0-f298-44f3-9160-a5cf2037e1c3 admin admin] The token cache is being invalidate because project 6cdbd91b73a444c4ae24bbcd5192f440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:03:28.472705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-257d0bf0-f298-44f3-9160-a5cf2037e1c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:03:28.472705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-257d0bf0-f298-44f3-9160-a5cf2037e1c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:03:28.472705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1383/2765] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:03:28 2022] DELETE /identity/v3/projects/6cdbd91b73a444c4ae24bbcd5192f440 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:03:28.477871 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6364cb-05c5-4434-9667-4536bfc477ce None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:28.478592 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6364cb-05c5-4434-9667-4536bfc477ce None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:28.479117 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6364cb-05c5-4434-9667-4536bfc477ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:28.504547 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-0d6364cb-05c5-4434-9667-4536bfc477ce None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:03:28.512041 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-0d6364cb-05c5-4434-9667-4536bfc477ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:03:28.588879 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1383/2766] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:03:28.600062 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10250ae-4b6c-49e3-a67f-957f3d3437ba None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:28.600331 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10250ae-4b6c-49e3-a67f-957f3d3437ba None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:28.600632 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10250ae-4b6c-49e3-a67f-957f3d3437ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:28.624360 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-a10250ae-4b6c-49e3-a67f-957f3d3437ba None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:03:28.625610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a10250ae-4b6c-49e3-a67f-957f3d3437ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:03:28.634260 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1384/2767] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:03:28.639256 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6364cb-05c5-4434-9667-4536bfc477ce None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:28.658318 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6364cb-05c5-4434-9667-4536bfc477ce None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:28.666637 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2490f-ba8d-4a96-8827-80724d61d0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:28.668328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2490f-ba8d-4a96-8827-80724d61d0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:28.669043 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2490f-ba8d-4a96-8827-80724d61d0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:28.669757 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2490f-ba8d-4a96-8827-80724d61d0a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:28.671095 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2490f-ba8d-4a96-8827-80724d61d0a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:03:28.671960 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2490f-ba8d-4a96-8827-80724d61d0a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:28.676014 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2490f-ba8d-4a96-8827-80724d61d0a6 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:28.703413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1384/2768] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 14:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:03:28.713930 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10250ae-4b6c-49e3-a67f-957f3d3437ba None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:28.728351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10250ae-4b6c-49e3-a67f-957f3d3437ba None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:28.738566 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b78e58-7124-420c-9cbf-f17b753b73d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:28.747178 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b78e58-7124-420c-9cbf-f17b753b73d5 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:28.747178 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b78e58-7124-420c-9cbf-f17b753b73d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:28.747178 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b78e58-7124-420c-9cbf-f17b753b73d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:28.747178 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b78e58-7124-420c-9cbf-f17b753b73d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:28.747178 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b78e58-7124-420c-9cbf-f17b753b73d5 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:28.922305 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1385/2769] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:03:28 2022] POST /identity/v3/projects => generated 385 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:03:28.927939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2490f-ba8d-4a96-8827-80724d61d0a6 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:28.947400 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2490f-ba8d-4a96-8827-80724d61d0a6 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:29.022840 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9454c-4663-490c-bf4c-05633671924b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:29.023579 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9454c-4663-490c-bf4c-05633671924b admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:29.023863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9454c-4663-490c-bf4c-05633671924b admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:29.024135 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9454c-4663-490c-bf4c-05633671924b admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:29.024794 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9454c-4663-490c-bf4c-05633671924b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:29.027351 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9454c-4663-490c-bf4c-05633671924b admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:29.213210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1385/2770] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:03:28 2022] POST /identity/v3/users => generated 293 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:03:29.215170 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b78e58-7124-420c-9cbf-f17b753b73d5 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:29.226757 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b78e58-7124-420c-9cbf-f17b753b73d5 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:29.234244 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e283f61-f998-4149-a660-f5df19683cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:29.234888 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e283f61-f998-4149-a660-f5df19683cfd admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:29.235171 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e283f61-f998-4149-a660-f5df19683cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:29.235484 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e283f61-f998-4149-a660-f5df19683cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:29.236209 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e283f61-f998-4149-a660-f5df19683cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:29.238140 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e283f61-f998-4149-a660-f5df19683cfd admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:29.249897 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1386/2771] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:03:29.254263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9454c-4663-490c-bf4c-05633671924b admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:29.269102 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9454c-4663-490c-bf4c-05633671924b admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:29.276540 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5eda49-c0f4-4d14-bf19-21fa1fb3bd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:29.277738 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5eda49-c0f4-4d14-bf19-21fa1fb3bd72 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:29.278680 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5eda49-c0f4-4d14-bf19-21fa1fb3bd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:29.278966 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5eda49-c0f4-4d14-bf19-21fa1fb3bd72 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:29.279681 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5eda49-c0f4-4d14-bf19-21fa1fb3bd72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:29.282094 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5eda49-c0f4-4d14-bf19-21fa1fb3bd72 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:29.306255 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1386/2772] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:03:29.306415 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e283f61-f998-4149-a660-f5df19683cfd admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:29.317760 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e283f61-f998-4149-a660-f5df19683cfd admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:29.324556 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48629ad9-d432-497a-b8b7-3e48fadb89f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:29.325374 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48629ad9-d432-497a-b8b7-3e48fadb89f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:29.325849 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48629ad9-d432-497a-b8b7-3e48fadb89f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:29.326142 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48629ad9-d432-497a-b8b7-3e48fadb89f6 admin admin] PATH_INFO: `/v3/projects/dd649af3d995442da36bf903376dff24/users/348780f9d8764fadb0564b7187c2c45a/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:29.345431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48629ad9-d432-497a-b8b7-3e48fadb89f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd649af3d995442da36bf903376dff24, user_id=348780f9d8764fadb0564b7187c2c45a, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:29.348266 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48629ad9-d432-497a-b8b7-3e48fadb89f6 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:29.538521 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1387/2773] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:03:29 2022] PUT /identity/v3/projects/dd649af3d995442da36bf903376dff24/users/348780f9d8764fadb0564b7187c2c45a/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:03:29.544607 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6638923-3b97-4e46-9a97-1a23f409d427 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:29.546065 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6638923-3b97-4e46-9a97-1a23f409d427 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:29.547067 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6638923-3b97-4e46-9a97-1a23f409d427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:29.581628 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-c6638923-3b97-4e46-9a97-1a23f409d427 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:03:29.584179 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c6638923-3b97-4e46-9a97-1a23f409d427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:03:29.692423 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:29.710289 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1387/2774] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:03:29.723053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48629ad9-d432-497a-b8b7-3e48fadb89f6 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:29.726250 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-48629ad9-d432-497a-b8b7-3e48fadb89f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:03:29.831251 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48629ad9-d432-497a-b8b7-3e48fadb89f6 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:29.836775 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483e9f4-521c-499e-a117-0c6a9f5a3e4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:29.837736 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483e9f4-521c-499e-a117-0c6a9f5a3e4d service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:29.840812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483e9f4-521c-499e-a117-0c6a9f5a3e4d service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:29.840812 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483e9f4-521c-499e-a117-0c6a9f5a3e4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:29.850830 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483e9f4-521c-499e-a117-0c6a9f5a3e4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:29.856215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483e9f4-521c-499e-a117-0c6a9f5a3e4d service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:29.868451 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1388/2775] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:03:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:03:31.027817 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25215c-2ae5-4a38-b5e0-3a25995ec3cd None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:31.031638 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25215c-2ae5-4a38-b5e0-3a25995ec3cd None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:31.031638 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25215c-2ae5-4a38-b5e0-3a25995ec3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:31.071273 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-be25215c-2ae5-4a38-b5e0-3a25995ec3cd None None] MFA Rules not processed for user `5ca20ec26ae045dbb778dfe190d474ec`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:03:31.071273 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-be25215c-2ae5-4a38-b5e0-3a25995ec3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:03:31.154041 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1388/2776] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:03:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:03:31.171962 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483e9f4-521c-499e-a117-0c6a9f5a3e4d service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:31.173719 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c483e9f4-521c-499e-a117-0c6a9f5a3e4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:03:31.237175 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:31.296662 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483e9f4-521c-499e-a117-0c6a9f5a3e4d service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:31.302933 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c005f4-aba7-4f20-9bc7-723d6c69f2b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:31.303635 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c005f4-aba7-4f20-9bc7-723d6c69f2b0 service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:31.303917 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c005f4-aba7-4f20-9bc7-723d6c69f2b0 service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:31.304197 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c005f4-aba7-4f20-9bc7-723d6c69f2b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:31.315299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c005f4-aba7-4f20-9bc7-723d6c69f2b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:31.317001 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c005f4-aba7-4f20-9bc7-723d6c69f2b0 service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:31.332022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1389/2777] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:03:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:03:35.236255 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85c52e-2d1f-4014-9cc2-a38043c44f1b None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:35.238040 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85c52e-2d1f-4014-9cc2-a38043c44f1b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:35.239071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85c52e-2d1f-4014-9cc2-a38043c44f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:35.276136 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-9f85c52e-2d1f-4014-9cc2-a38043c44f1b None None] MFA Rules not processed for user `5ca20ec26ae045dbb778dfe190d474ec`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:03:35.278479 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-9f85c52e-2d1f-4014-9cc2-a38043c44f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:03:35.292827 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1389/2778] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:03:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:03:35.834155 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c005f4-aba7-4f20-9bc7-723d6c69f2b0 service nova] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:35.837525 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-00c005f4-aba7-4f20-9bc7-723d6c69f2b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:03:35.868088 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c005f4-aba7-4f20-9bc7-723d6c69f2b0 service nova] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:35.880767 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3aa70b-7021-42d0-890e-57fca65c49b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:35.883125 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3aa70b-7021-42d0-890e-57fca65c49b9 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:35.883125 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3aa70b-7021-42d0-890e-57fca65c49b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:35.883125 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3aa70b-7021-42d0-890e-57fca65c49b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:35.885349 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-5a3aa70b-7021-42d0-890e-57fca65c49b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:03:35.912180 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3aa70b-7021-42d0-890e-57fca65c49b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:35.919963 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3aa70b-7021-42d0-890e-57fca65c49b9 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:35.940371 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1390/2779] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:03:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:03:38.363245 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0021ccd-3aa4-478c-aadf-9d0a736b0a6e None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:38.364118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0021ccd-3aa4-478c-aadf-9d0a736b0a6e None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:38.364118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0021ccd-3aa4-478c-aadf-9d0a736b0a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:38.413636 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-c0021ccd-3aa4-478c-aadf-9d0a736b0a6e None None] MFA Rules not processed for user `348780f9d8764fadb0564b7187c2c45a`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:03:38.416321 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c0021ccd-3aa4-478c-aadf-9d0a736b0a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:03:38.558853 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1390/2780] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:03:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:03:38.565929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3aa70b-7021-42d0-890e-57fca65c49b9 service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:38.583068 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3aa70b-7021-42d0-890e-57fca65c49b9 service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:38.590912 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7daa63-cd64-4898-8815-23d325c13161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:38.591587 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7daa63-cd64-4898-8815-23d325c13161 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:38.592061 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7daa63-cd64-4898-8815-23d325c13161 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:38.592332 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7daa63-cd64-4898-8815-23d325c13161 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:38.593706 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7daa63-cd64-4898-8815-23d325c13161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:38.594972 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7daa63-cd64-4898-8815-23d325c13161 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:38.708467 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1391/2781] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:03:38 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:03:38.713604 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0021ccd-3aa4-478c-aadf-9d0a736b0a6e None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:38.735105 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0021ccd-3aa4-478c-aadf-9d0a736b0a6e None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:38.825538 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87146f93-64de-498a-bfa5-ab28b4318de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:38.826208 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87146f93-64de-498a-bfa5-ab28b4318de9 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:38.826571 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87146f93-64de-498a-bfa5-ab28b4318de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:38.827033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87146f93-64de-498a-bfa5-ab28b4318de9 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:38.832027 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87146f93-64de-498a-bfa5-ab28b4318de9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:38.832196 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87146f93-64de-498a-bfa5-ab28b4318de9 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:38.912291 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1391/2782] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:03:38 2022] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:03:38.915526 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7daa63-cd64-4898-8815-23d325c13161 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:38.930361 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7daa63-cd64-4898-8815-23d325c13161 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:38.936429 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63343935-ab77-4aff-817b-f23e43947cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:38.937106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63343935-ab77-4aff-817b-f23e43947cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:38.937591 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63343935-ab77-4aff-817b-f23e43947cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:38.951991 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63343935-ab77-4aff-817b-f23e43947cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:38.957808 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63343935-ab77-4aff-817b-f23e43947cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:38.958126 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63343935-ab77-4aff-817b-f23e43947cc4 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:38.971880 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1392/2783] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:03:38.976140 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87146f93-64de-498a-bfa5-ab28b4318de9 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:38.985596 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:38.993139 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87146f93-64de-498a-bfa5-ab28b4318de9 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:39.004893 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a68fc-07f2-4694-930d-446926f8e54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:39.005783 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a68fc-07f2-4694-930d-446926f8e54c admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:39.006564 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a68fc-07f2-4694-930d-446926f8e54c admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:39.007130 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a68fc-07f2-4694-930d-446926f8e54c admin admin] PATH_INFO: `/v3/projects/8adca97cae2d448082db54b77366fc7c/users/38a4047fa7264cdb8b5e3eedf0c7c0a7/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:39.030610 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a68fc-07f2-4694-930d-446926f8e54c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8adca97cae2d448082db54b77366fc7c, user_id=38a4047fa7264cdb8b5e3eedf0c7c0a7, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:39.034153 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a68fc-07f2-4694-930d-446926f8e54c admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:39.106890 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1392/2784] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:03:38 2022] PUT /identity/v3/projects/8adca97cae2d448082db54b77366fc7c/users/38a4047fa7264cdb8b5e3eedf0c7c0a7/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:03:39.112293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63343935-ab77-4aff-817b-f23e43947cc4 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:39.125764 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63343935-ab77-4aff-817b-f23e43947cc4 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:39.211096 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e527f-3b7c-4dce-9081-01a103dd9a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:39.211772 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e527f-3b7c-4dce-9081-01a103dd9a89 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:39.212074 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e527f-3b7c-4dce-9081-01a103dd9a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:39.212328 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e527f-3b7c-4dce-9081-01a103dd9a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:39.212995 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e527f-3b7c-4dce-9081-01a103dd9a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:39.214687 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e527f-3b7c-4dce-9081-01a103dd9a89 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:39.226215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1393/2785] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:03:39.236121 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a68fc-07f2-4694-930d-446926f8e54c admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:39.247671 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a68fc-07f2-4694-930d-446926f8e54c admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:39.254898 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12c898-eade-4255-b423-f13f757f9ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:39.255655 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12c898-eade-4255-b423-f13f757f9ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:39.255939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12c898-eade-4255-b423-f13f757f9ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:39.256213 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12c898-eade-4255-b423-f13f757f9ea2 admin admin] PATH_INFO: `/v3/projects/8adca97cae2d448082db54b77366fc7c/users/38a4047fa7264cdb8b5e3eedf0c7c0a7/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:39.258328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12c898-eade-4255-b423-f13f757f9ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8adca97cae2d448082db54b77366fc7c, user_id=38a4047fa7264cdb8b5e3eedf0c7c0a7, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:39.261170 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12c898-eade-4255-b423-f13f757f9ea2 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:39.285210 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1393/2786] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:03:39 2022] PUT /identity/v3/projects/8adca97cae2d448082db54b77366fc7c/users/38a4047fa7264cdb8b5e3eedf0c7c0a7/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:03:46.814869 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecce3e-3895-40d8-81b2-12d577201e5b None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:46.815501 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecce3e-3895-40d8-81b2-12d577201e5b None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:46.815501 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecce3e-3895-40d8-81b2-12d577201e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:46.857797 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-56ecce3e-3895-40d8-81b2-12d577201e5b None None] MFA Rules not processed for user `38a4047fa7264cdb8b5e3eedf0c7c0a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:03:46.862408 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-56ecce3e-3895-40d8-81b2-12d577201e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:03:46.942630 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:46.980756 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1394/2787] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:03:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:03:47.000180 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12c898-eade-4255-b423-f13f757f9ea2 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:47.002356 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-cb12c898-eade-4255-b423-f13f757f9ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:03:47.092060 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12c898-eade-4255-b423-f13f757f9ea2 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:47.095855 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7433f87-0407-4588-9d74-2611317b0c23 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc11fe25135d4bf1b1a06b8619e4a2e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:47.096486 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7433f87-0407-4588-9d74-2611317b0c23 service glance] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:47.096762 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7433f87-0407-4588-9d74-2611317b0c23 service glance] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:47.097040 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7433f87-0407-4588-9d74-2611317b0c23 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:47.168740 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7433f87-0407-4588-9d74-2611317b0c23 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:47.170232 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7433f87-0407-4588-9d74-2611317b0c23 service glance] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:47.179655 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1394/2788] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:03:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:03:47.562541 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a47b88-a8b9-432f-8126-f64ea4564e4a None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:47.562829 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a47b88-a8b9-432f-8126-f64ea4564e4a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:47.563106 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a47b88-a8b9-432f-8126-f64ea4564e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:47.584191 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-a9a47b88-a8b9-432f-8126-f64ea4564e4a None None] MFA Rules not processed for user `6f01578bf21244a5ac357e54979ffc0d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:03:47.585420 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a9a47b88-a8b9-432f-8126-f64ea4564e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:03:47.655269 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1395/2789] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 1 14:03:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:03:47.829131 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7433f87-0407-4588-9d74-2611317b0c23 service glance] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:03:47.832007 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-e7433f87-0407-4588-9d74-2611317b0c23 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:03:47.944050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7433f87-0407-4588-9d74-2611317b0c23 service glance] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:03:47.955682 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762986f3-f85b-4def-b734-a6909b4084d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bbede0f8674384bcc3028ea77eb724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:03:47.956561 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762986f3-f85b-4def-b734-a6909b4084d4 service swift] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:47.956938 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762986f3-f85b-4def-b734-a6909b4084d4 service swift] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:47.957316 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762986f3-f85b-4def-b734-a6909b4084d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:47.966342 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762986f3-f85b-4def-b734-a6909b4084d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:03:47.968145 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762986f3-f85b-4def-b734-a6909b4084d4 service swift] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:03:47.977530 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1395/2790] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 1 14:03:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 14:03:57.646143 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=33 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:57.973729 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=94,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:58.594876 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d779b-f6e6-4fe2-8a2c-060ce83276f2 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:03:58.595162 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d779b-f6e6-4fe2-8a2c-060ce83276f2 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:03:58.595531 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d779b-f6e6-4fe2-8a2c-060ce83276f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:03:58.615469 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-aa8d779b-f6e6-4fe2-8a2c-060ce83276f2 None None] MFA Rules not processed for user `348780f9d8764fadb0564b7187c2c45a`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:03:58.616692 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-aa8d779b-f6e6-4fe2-8a2c-060ce83276f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:03:58.624251 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1396/2791] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:03:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:04:03.115085 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf1fb5-44a2-411d-a612-66aac437965e None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:03.115660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf1fb5-44a2-411d-a612-66aac437965e None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:03.115765 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf1fb5-44a2-411d-a612-66aac437965e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:03.144072 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-abaf1fb5-44a2-411d-a612-66aac437965e None None] MFA Rules not processed for user `6f01578bf21244a5ac357e54979ffc0d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:04:03.145287 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-abaf1fb5-44a2-411d-a612-66aac437965e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:04:03.153164 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1396/2792] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Sep 1 14:04:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:04:03.166311 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d779b-f6e6-4fe2-8a2c-060ce83276f2 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:04:03.178269 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d779b-f6e6-4fe2-8a2c-060ce83276f2 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:04:03.183254 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd6769-4801-4f63-9e92-c0f2512f5de3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bbede0f8674384bcc3028ea77eb724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:04:03.183896 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd6769-4801-4f63-9e92-c0f2512f5de3 service swift] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:03.184176 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd6769-4801-4f63-9e92-c0f2512f5de3 service swift] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:03.184447 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd6769-4801-4f63-9e92-c0f2512f5de3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:03.193145 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd6769-4801-4f63-9e92-c0f2512f5de3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:04:03.194746 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd6769-4801-4f63-9e92-c0f2512f5de3 service swift] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:04:03.203958 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1397/2793] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 1 14:04:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 14:04:12.631427 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf1fb5-44a2-411d-a612-66aac437965e None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:04:12.697724 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf1fb5-44a2-411d-a612-66aac437965e None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:04:12.701798 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe03ee-9af1-4359-b991-55aafa8d9270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:04:12.702433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe03ee-9af1-4359-b991-55aafa8d9270 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:12.702749 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe03ee-9af1-4359-b991-55aafa8d9270 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:12.703033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe03ee-9af1-4359-b991-55aafa8d9270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:12.705345 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-5ffe03ee-9af1-4359-b991-55aafa8d9270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:04:12.785386 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe03ee-9af1-4359-b991-55aafa8d9270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:04:12.786861 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe03ee-9af1-4359-b991-55aafa8d9270 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:04:12.799922 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1397/2794] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:04:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:04:13.200543 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=9 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:14.005794 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd6769-4801-4f63-9e92-c0f2512f5de3 service swift] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:04:14.017249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd6769-4801-4f63-9e92-c0f2512f5de3 service swift] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:04:14.021100 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acedacf-efe9-492c-81b6-571f938cd71c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:04:14.021718 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acedacf-efe9-492c-81b6-571f938cd71c service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:14.021995 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acedacf-efe9-492c-81b6-571f938cd71c service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:14.022264 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acedacf-efe9-492c-81b6-571f938cd71c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:14.024280 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-6acedacf-efe9-492c-81b6-571f938cd71c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:04:14.039656 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acedacf-efe9-492c-81b6-571f938cd71c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:04:14.041141 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acedacf-efe9-492c-81b6-571f938cd71c service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:04:14.053914 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1398/2795] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:04:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:04:22.793702 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=57 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:24.047781 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=6 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:31.985869 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe03ee-9af1-4359-b991-55aafa8d9270 service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:04:32.007165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe03ee-9af1-4359-b991-55aafa8d9270 service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:04:32.007165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81439ad-709f-4085-90bd-6817abb1dffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:04:32.008235 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81439ad-709f-4085-90bd-6817abb1dffa service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:32.009049 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81439ad-709f-4085-90bd-6817abb1dffa service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:32.009548 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81439ad-709f-4085-90bd-6817abb1dffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:32.028092 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81439ad-709f-4085-90bd-6817abb1dffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:04:32.030837 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81439ad-709f-4085-90bd-6817abb1dffa service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:04:32.047552 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1398/2796] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:04:31 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:04:42.041489 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=6 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:44.227720 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d62e7d-c318-4bc7-ba49-f7685d031a9b None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:44.227720 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d62e7d-c318-4bc7-ba49-f7685d031a9b None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:44.227720 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d62e7d-c318-4bc7-ba49-f7685d031a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:44.248929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-e0d62e7d-c318-4bc7-ba49-f7685d031a9b None None] MFA Rules not processed for user `5ca20ec26ae045dbb778dfe190d474ec`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:04:44.250465 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-e0d62e7d-c318-4bc7-ba49-f7685d031a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:04:44.316706 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1399/2797] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:04:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:04:45.423433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81439ad-709f-4085-90bd-6817abb1dffa service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:04:45.424877 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-c81439ad-709f-4085-90bd-6817abb1dffa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:04:45.521171 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81439ad-709f-4085-90bd-6817abb1dffa service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:04:45.526678 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa937f-28c5-476b-ae5e-6ff3bca7969e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e675d44d2c49929feb0ec0d2c0d0eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:04:45.527302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa937f-28c5-476b-ae5e-6ff3bca7969e service placement] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:45.527610 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa937f-28c5-476b-ae5e-6ff3bca7969e service placement] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:45.527883 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa937f-28c5-476b-ae5e-6ff3bca7969e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:45.529720 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-f3fa937f-28c5-476b-ae5e-6ff3bca7969e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:04:45.542177 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa937f-28c5-476b-ae5e-6ff3bca7969e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:04:45.543833 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa937f-28c5-476b-ae5e-6ff3bca7969e service placement] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:04:45.554698 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1399/2798] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:04:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:04:54.309280 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=25 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:55.550091 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=32 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:26.404108 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d62e7d-c318-4bc7-ba49-f7685d031a9b None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:05:26.414036 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d62e7d-c318-4bc7-ba49-f7685d031a9b None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:05:26.417618 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15909863-579f-4816-90a2-6cc0b411dbd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:05:26.418209 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15909863-579f-4816-90a2-6cc0b411dbd1 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:05:26.418483 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15909863-579f-4816-90a2-6cc0b411dbd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:05:26.418752 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15909863-579f-4816-90a2-6cc0b411dbd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:05:26.420478 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-15909863-579f-4816-90a2-6cc0b411dbd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:05:26.430088 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15909863-579f-4816-90a2-6cc0b411dbd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:05:26.431528 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15909863-579f-4816-90a2-6cc0b411dbd1 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:05:26.439388 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1400/2799] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:05:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:05:36.435939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=6 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:39.128882 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa937f-28c5-476b-ae5e-6ff3bca7969e service placement] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:05:39.130365 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-f3fa937f-28c5-476b-ae5e-6ff3bca7969e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:05:39.150055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa937f-28c5-476b-ae5e-6ff3bca7969e service placement] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:05:39.159984 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e50e5-ac57-4bb9-a9d0-b3ee0737c842 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:05:39.160797 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e50e5-ac57-4bb9-a9d0-b3ee0737c842 service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:05:39.161297 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e50e5-ac57-4bb9-a9d0-b3ee0737c842 service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:05:39.162114 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e50e5-ac57-4bb9-a9d0-b3ee0737c842 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:05:39.166193 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a23e50e5-ac57-4bb9-a9d0-b3ee0737c842 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:05:39.183027 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e50e5-ac57-4bb9-a9d0-b3ee0737c842 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:05:39.186000 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e50e5-ac57-4bb9-a9d0-b3ee0737c842 service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:05:39.205570 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1400/2800] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:05:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:05:45.436473 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15909863-579f-4816-90a2-6cc0b411dbd1 service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:05:45.451709 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15909863-579f-4816-90a2-6cc0b411dbd1 service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:05:45.460041 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838c9a3-cd9a-4f6e-98c5-4147b0a601fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:05:45.460834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838c9a3-cd9a-4f6e-98c5-4147b0a601fa service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:05:45.462371 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838c9a3-cd9a-4f6e-98c5-4147b0a601fa service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:05:45.462659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838c9a3-cd9a-4f6e-98c5-4147b0a601fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:05:45.465396 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-5838c9a3-cd9a-4f6e-98c5-4147b0a601fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:05:45.483999 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838c9a3-cd9a-4f6e-98c5-4147b0a601fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:05:45.485938 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838c9a3-cd9a-4f6e-98c5-4147b0a601fa service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:05:45.523519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1401/2801] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:05:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:05:49.197414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=6 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:54.384602 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572d45b-b8cc-4f33-97d0-e42efaf8473b None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:05:54.385243 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572d45b-b8cc-4f33-97d0-e42efaf8473b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:05:54.385243 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572d45b-b8cc-4f33-97d0-e42efaf8473b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:05:54.405859 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-1572d45b-b8cc-4f33-97d0-e42efaf8473b None None] MFA Rules not processed for user `5ca20ec26ae045dbb778dfe190d474ec`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:05:54.407104 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-1572d45b-b8cc-4f33-97d0-e42efaf8473b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:05:54.414434 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1401/2802] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:05:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:05:55.500325 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=6 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:56.264328 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c0ef0-b281-4f5e-b46f-11616b21d51c None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:05:56.264890 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c0ef0-b281-4f5e-b46f-11616b21d51c None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:05:56.265163 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c0ef0-b281-4f5e-b46f-11616b21d51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:05:56.322898 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-1c5c0ef0-b281-4f5e-b46f-11616b21d51c None None] MFA Rules not processed for user `6f01578bf21244a5ac357e54979ffc0d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:05:56.325195 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-1c5c0ef0-b281-4f5e-b46f-11616b21d51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:05:56.344403 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1402/2803] 10.222.0.50 () {58 vars in 967 bytes} [Thu Sep 1 14:05:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:05:56.391600 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572d45b-b8cc-4f33-97d0-e42efaf8473b None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:05:56.413683 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572d45b-b8cc-4f33-97d0-e42efaf8473b None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:05:56.419132 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b79ed0-a2dd-4654-830a-9f87c331eb4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85bbede0f8674384bcc3028ea77eb724', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:05:56.419783 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b79ed0-a2dd-4654-830a-9f87c331eb4e service swift] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:05:56.420057 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b79ed0-a2dd-4654-830a-9f87c331eb4e service swift] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:05:56.420355 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b79ed0-a2dd-4654-830a-9f87c331eb4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:05:56.435504 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b79ed0-a2dd-4654-830a-9f87c331eb4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:05:56.437215 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b79ed0-a2dd-4654-830a-9f87c331eb4e service swift] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:05:56.446356 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1402/2804] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Sep 1 14:05:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 14:06:06.217297 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c0ef0-b281-4f5e-b46f-11616b21d51c None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:06.284510 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c0ef0-b281-4f5e-b46f-11616b21d51c None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:06.289192 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a890a-1172-473d-b15f-d6883c88a4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:06.289769 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a890a-1172-473d-b15f-d6883c88a4d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:06.290052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a890a-1172-473d-b15f-d6883c88a4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:06.290881 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a890a-1172-473d-b15f-d6883c88a4d9 admin admin] PATH_INFO: `/v3/users/348780f9d8764fadb0564b7187c2c45a` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:06.291500 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a890a-1172-473d-b15f-d6883c88a4d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=348780f9d8764fadb0564b7187c2c45a)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:06.293456 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a890a-1172-473d-b15f-d6883c88a4d9 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:06.403996 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b79ed0-a2dd-4654-830a-9f87c331eb4e service swift] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:06.416997 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b79ed0-a2dd-4654-830a-9f87c331eb4e service swift] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:06.424899 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1de3a-9f90-43e2-a1ff-5b17a94d6493 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:06.425755 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1de3a-9f90-43e2-a1ff-5b17a94d6493 service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:06.427032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1de3a-9f90-43e2-a1ff-5b17a94d6493 service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:06.427032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1de3a-9f90-43e2-a1ff-5b17a94d6493 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:06.428244 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-8de1de3a-9f90-43e2-a1ff-5b17a94d6493 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:06.441524 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1de3a-9f90-43e2-a1ff-5b17a94d6493 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:06.443137 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1de3a-9f90-43e2-a1ff-5b17a94d6493 service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:06.454608 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1403/2805] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:06.536356 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-c77a890a-1172-473d-b15f-d6883c88a4d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '348780f9d8764fadb0564b7187c2c45a'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:06.639339 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-c77a890a-1172-473d-b15f-d6883c88a4d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '348780f9d8764fadb0564b7187c2c45a'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:06.648199 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-c77a890a-1172-473d-b15f-d6883c88a4d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '348780f9d8764fadb0564b7187c2c45a'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:06.661749 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-c77a890a-1172-473d-b15f-d6883c88a4d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '348780f9d8764fadb0564b7187c2c45a'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:06.662608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-c77a890a-1172-473d-b15f-d6883c88a4d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '348780f9d8764fadb0564b7187c2c45a'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:06.670401 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1403/2806] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:06:06 2022] DELETE /identity/v3/users/348780f9d8764fadb0564b7187c2c45a => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:07.001554 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1de3a-9f90-43e2-a1ff-5b17a94d6493 service nova] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:07.013081 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1de3a-9f90-43e2-a1ff-5b17a94d6493 service nova] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:07.079842 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e53a3a-cd93-4160-bc18-4eba18c88405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:07.080471 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e53a3a-cd93-4160-bc18-4eba18c88405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:07.080751 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e53a3a-cd93-4160-bc18-4eba18c88405 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:07.081033 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e53a3a-cd93-4160-bc18-4eba18c88405 admin admin] PATH_INFO: `/v3/projects/dd649af3d995442da36bf903376dff24` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:07.082155 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e53a3a-cd93-4160-bc18-4eba18c88405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd649af3d995442da36bf903376dff24)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:07.084157 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e53a3a-cd93-4160-bc18-4eba18c88405 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:07.230997 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-90e53a3a-cd93-4160-bc18-4eba18c88405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd649af3d995442da36bf903376dff24', 'request_id': 'req-90e53a3a-cd93-4160-bc18-4eba18c88405'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:07.238686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-90e53a3a-cd93-4160-bc18-4eba18c88405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd649af3d995442da36bf903376dff24', 'request_id': 'req-90e53a3a-cd93-4160-bc18-4eba18c88405'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:07.246595 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-90e53a3a-cd93-4160-bc18-4eba18c88405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd649af3d995442da36bf903376dff24', 'request_id': 'req-90e53a3a-cd93-4160-bc18-4eba18c88405'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:07.342491 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-90e53a3a-cd93-4160-bc18-4eba18c88405 admin admin] The token cache is being invalidate because project dd649af3d995442da36bf903376dff24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:06:07.342779 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-90e53a3a-cd93-4160-bc18-4eba18c88405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:07.343542 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-90e53a3a-cd93-4160-bc18-4eba18c88405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:07.345088 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1404/2807] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:06:07 2022] DELETE /identity/v3/projects/dd649af3d995442da36bf903376dff24 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:07.349861 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a890a-1172-473d-b15f-d6883c88a4d9 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:07.351422 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c77a890a-1172-473d-b15f-d6883c88a4d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:07.368545 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a890a-1172-473d-b15f-d6883c88a4d9 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:07.413819 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:07.432325 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2361800-9cc3-47fc-984a-faab4ef87beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:07.432964 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2361800-9cc3-47fc-984a-faab4ef87beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:07.433243 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2361800-9cc3-47fc-984a-faab4ef87beb admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:07.433515 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2361800-9cc3-47fc-984a-faab4ef87beb admin admin] PATH_INFO: `/v3/users/38a4047fa7264cdb8b5e3eedf0c7c0a7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:07.434696 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2361800-9cc3-47fc-984a-faab4ef87beb admin admin] RBAC: Authorizing `identity:delete_user(user_id=38a4047fa7264cdb8b5e3eedf0c7c0a7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:07.436814 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2361800-9cc3-47fc-984a-faab4ef87beb admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:07.713033 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b2361800-9cc3-47fc-984a-faab4ef87beb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38a4047fa7264cdb8b5e3eedf0c7c0a7'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:07.886913 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b2361800-9cc3-47fc-984a-faab4ef87beb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38a4047fa7264cdb8b5e3eedf0c7c0a7'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:07.895430 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b2361800-9cc3-47fc-984a-faab4ef87beb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38a4047fa7264cdb8b5e3eedf0c7c0a7'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:07.907967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b2361800-9cc3-47fc-984a-faab4ef87beb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38a4047fa7264cdb8b5e3eedf0c7c0a7'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:07.908712 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b2361800-9cc3-47fc-984a-faab4ef87beb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38a4047fa7264cdb8b5e3eedf0c7c0a7'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:07.921144 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1404/2808] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:06:07 2022] DELETE /identity/v3/users/38a4047fa7264cdb8b5e3eedf0c7c0a7 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:06:08.183911 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e53a3a-cd93-4160-bc18-4eba18c88405 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:08.185519 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-90e53a3a-cd93-4160-bc18-4eba18c88405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:08.200367 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e53a3a-cd93-4160-bc18-4eba18c88405 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:08.252514 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:08.275497 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719f171-3133-4fc8-b956-9a88ea1092d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:08.310787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719f171-3133-4fc8-b956-9a88ea1092d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:08.310787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719f171-3133-4fc8-b956-9a88ea1092d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:08.310787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719f171-3133-4fc8-b956-9a88ea1092d4 admin admin] PATH_INFO: `/v3/projects/8adca97cae2d448082db54b77366fc7c` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:08.310787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719f171-3133-4fc8-b956-9a88ea1092d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8adca97cae2d448082db54b77366fc7c)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:08.310787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719f171-3133-4fc8-b956-9a88ea1092d4 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:08.447397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c719f171-3133-4fc8-b956-9a88ea1092d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8adca97cae2d448082db54b77366fc7c', 'request_id': 'req-c719f171-3133-4fc8-b956-9a88ea1092d4'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:08.454459 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c719f171-3133-4fc8-b956-9a88ea1092d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8adca97cae2d448082db54b77366fc7c', 'request_id': 'req-c719f171-3133-4fc8-b956-9a88ea1092d4'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:08.461106 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c719f171-3133-4fc8-b956-9a88ea1092d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8adca97cae2d448082db54b77366fc7c', 'request_id': 'req-c719f171-3133-4fc8-b956-9a88ea1092d4'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:08.615339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c719f171-3133-4fc8-b956-9a88ea1092d4 admin admin] The token cache is being invalidate because project 8adca97cae2d448082db54b77366fc7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:06:08.615716 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c719f171-3133-4fc8-b956-9a88ea1092d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:08.616369 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-c719f171-3133-4fc8-b956-9a88ea1092d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:08.617891 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1405/2809] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:06:08 2022] DELETE /identity/v3/projects/8adca97cae2d448082db54b77366fc7c => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:08.623379 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe370e66-d1f9-4cf1-976e-26f252d8e3a4 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:08.623953 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe370e66-d1f9-4cf1-976e-26f252d8e3a4 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:08.623953 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe370e66-d1f9-4cf1-976e-26f252d8e3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:08.644675 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-fe370e66-d1f9-4cf1-976e-26f252d8e3a4 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:08.648011 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-fe370e66-d1f9-4cf1-976e-26f252d8e3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:08.712802 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1405/2810] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:08.720860 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e87c9-a323-4039-8492-b055ec04708b None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:08.721150 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e87c9-a323-4039-8492-b055ec04708b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:08.721434 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e87c9-a323-4039-8492-b055ec04708b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:08.742440 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-280e87c9-a323-4039-8492-b055ec04708b None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:08.743710 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-280e87c9-a323-4039-8492-b055ec04708b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:08.752535 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1406/2811] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:08.757075 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe370e66-d1f9-4cf1-976e-26f252d8e3a4 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:08.767385 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe370e66-d1f9-4cf1-976e-26f252d8e3a4 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:08.772431 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee0e22-da65-4524-b1b0-f1daf01f4414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:08.773062 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee0e22-da65-4524-b1b0-f1daf01f4414 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:08.773339 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee0e22-da65-4524-b1b0-f1daf01f4414 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:08.773611 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee0e22-da65-4524-b1b0-f1daf01f4414 admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:08.774399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee0e22-da65-4524-b1b0-f1daf01f4414 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:06:08.774725 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee0e22-da65-4524-b1b0-f1daf01f4414 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:08.776384 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee0e22-da65-4524-b1b0-f1daf01f4414 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:08.789321 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1406/2812] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 14:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:06:08.794726 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e87c9-a323-4039-8492-b055ec04708b None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:08.804659 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e87c9-a323-4039-8492-b055ec04708b None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:08.810160 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32e83e-f710-443a-8cf9-5d7b7a8362d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:08.810821 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32e83e-f710-443a-8cf9-5d7b7a8362d0 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:08.811077 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32e83e-f710-443a-8cf9-5d7b7a8362d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:08.811350 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32e83e-f710-443a-8cf9-5d7b7a8362d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:08.812020 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32e83e-f710-443a-8cf9-5d7b7a8362d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:08.813963 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32e83e-f710-443a-8cf9-5d7b7a8362d0 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:08.927011 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1407/2813] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:06:08 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:06:08.931552 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee0e22-da65-4524-b1b0-f1daf01f4414 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:08.942689 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee0e22-da65-4524-b1b0-f1daf01f4414 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:08.996928 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:09.020887 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8541b-768f-4d61-8e78-4243bd9c0dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:09.022046 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8541b-768f-4d61-8e78-4243bd9c0dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:09.022640 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8541b-768f-4d61-8e78-4243bd9c0dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:09.023238 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8541b-768f-4d61-8e78-4243bd9c0dd3 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:09.024642 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8541b-768f-4d61-8e78-4243bd9c0dd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:09.028402 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8541b-768f-4d61-8e78-4243bd9c0dd3 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:09.186219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1407/2814] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:06:08 2022] POST /identity/v3/users => generated 289 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:06:09.188284 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32e83e-f710-443a-8cf9-5d7b7a8362d0 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:09.203494 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32e83e-f710-443a-8cf9-5d7b7a8362d0 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:09.208409 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c91611-516d-4a3c-a9fa-8c733821db49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:09.209037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c91611-516d-4a3c-a9fa-8c733821db49 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:09.209301 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c91611-516d-4a3c-a9fa-8c733821db49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:09.209715 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c91611-516d-4a3c-a9fa-8c733821db49 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:09.210371 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c91611-516d-4a3c-a9fa-8c733821db49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:09.212041 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c91611-516d-4a3c-a9fa-8c733821db49 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:09.224508 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1408/2815] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:06:09.229046 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8541b-768f-4d61-8e78-4243bd9c0dd3 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:09.240602 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8541b-768f-4d61-8e78-4243bd9c0dd3 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:09.245920 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e19b9-7b4f-4b1b-b15e-ec2b64215d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:09.246684 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e19b9-7b4f-4b1b-b15e-ec2b64215d17 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:09.247055 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e19b9-7b4f-4b1b-b15e-ec2b64215d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:09.247271 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e19b9-7b4f-4b1b-b15e-ec2b64215d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:09.247962 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e19b9-7b4f-4b1b-b15e-ec2b64215d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:09.249557 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e19b9-7b4f-4b1b-b15e-ec2b64215d17 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:09.261492 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1408/2816] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:09.270069 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c91611-516d-4a3c-a9fa-8c733821db49 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:09.287422 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c91611-516d-4a3c-a9fa-8c733821db49 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:09.292318 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098c092-33ee-4a09-a858-0e1fea22bd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:09.293612 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098c092-33ee-4a09-a858-0e1fea22bd7f admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:09.293612 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098c092-33ee-4a09-a858-0e1fea22bd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:09.293612 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098c092-33ee-4a09-a858-0e1fea22bd7f admin admin] PATH_INFO: `/v3/projects/156a972a658b46aaae3150b12dae797a/users/384fe3ef86de41fc939e1a3cbbc6fe13/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:09.311710 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098c092-33ee-4a09-a858-0e1fea22bd7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=156a972a658b46aaae3150b12dae797a, user_id=384fe3ef86de41fc939e1a3cbbc6fe13, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:09.315251 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098c092-33ee-4a09-a858-0e1fea22bd7f admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:09.429204 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1409/2817] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:06:09 2022] PUT /identity/v3/projects/156a972a658b46aaae3150b12dae797a/users/384fe3ef86de41fc939e1a3cbbc6fe13/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:09.437437 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ebcf3-3aec-4495-a5c6-34b7170412ba None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:09.444259 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ebcf3-3aec-4495-a5c6-34b7170412ba None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:09.444259 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ebcf3-3aec-4495-a5c6-34b7170412ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:09.457765 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-9e4ebcf3-3aec-4495-a5c6-34b7170412ba None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:09.459095 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-9e4ebcf3-3aec-4495-a5c6-34b7170412ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:09.533375 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1409/2818] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:06:09.552325 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098c092-33ee-4a09-a858-0e1fea22bd7f admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:09.554958 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-5098c092-33ee-4a09-a858-0e1fea22bd7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:09.621428 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098c092-33ee-4a09-a858-0e1fea22bd7f admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:09.625198 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855845cb-c9d2-4447-b351-4431a162c030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:09.625845 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855845cb-c9d2-4447-b351-4431a162c030 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:09.626169 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855845cb-c9d2-4447-b351-4431a162c030 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:09.626448 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855845cb-c9d2-4447-b351-4431a162c030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:09.637889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855845cb-c9d2-4447-b351-4431a162c030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:09.639348 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855845cb-c9d2-4447-b351-4431a162c030 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:09.649600 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1410/2819] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:15.818196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4e183-8b5b-4bf3-8ca6-8ef5b477f6ea None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:15.818783 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4e183-8b5b-4bf3-8ca6-8ef5b477f6ea None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:15.818903 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4e183-8b5b-4bf3-8ca6-8ef5b477f6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:15.852361 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-2bd4e183-8b5b-4bf3-8ca6-8ef5b477f6ea None None] MFA Rules not processed for user `384fe3ef86de41fc939e1a3cbbc6fe13`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:15.853687 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-2bd4e183-8b5b-4bf3-8ca6-8ef5b477f6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:15.935854 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1410/2820] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:06:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:15.940412 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855845cb-c9d2-4447-b351-4431a162c030 service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:15.950780 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855845cb-c9d2-4447-b351-4431a162c030 service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:15.955953 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24939013-2eeb-4aea-a6e7-bd343078e38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:15.956633 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24939013-2eeb-4aea-a6e7-bd343078e38c admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:15.956987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24939013-2eeb-4aea-a6e7-bd343078e38c admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:15.957352 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24939013-2eeb-4aea-a6e7-bd343078e38c admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:15.958070 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24939013-2eeb-4aea-a6e7-bd343078e38c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:15.960111 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24939013-2eeb-4aea-a6e7-bd343078e38c admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:15.966790 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:16.058354 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1411/2821] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:06:15 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:06:16.062293 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4e183-8b5b-4bf3-8ca6-8ef5b477f6ea None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:16.076329 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4e183-8b5b-4bf3-8ca6-8ef5b477f6ea None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:16.139785 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:16.146502 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7567d21-a165-47f4-81a5-897fa61d81f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:16.147117 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7567d21-a165-47f4-81a5-897fa61d81f6 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:16.147473 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7567d21-a165-47f4-81a5-897fa61d81f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:16.147747 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7567d21-a165-47f4-81a5-897fa61d81f6 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:16.148390 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7567d21-a165-47f4-81a5-897fa61d81f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:16.150335 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7567d21-a165-47f4-81a5-897fa61d81f6 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:16.230761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1411/2822] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:06:16 2022] POST /identity/v3/users => generated 295 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:16.232185 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24939013-2eeb-4aea-a6e7-bd343078e38c admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:16.243171 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24939013-2eeb-4aea-a6e7-bd343078e38c admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:16.252023 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c02c3f-aa28-4113-970d-48c9f3e6f015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:16.252638 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c02c3f-aa28-4113-970d-48c9f3e6f015 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:16.252923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c02c3f-aa28-4113-970d-48c9f3e6f015 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:16.253191 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c02c3f-aa28-4113-970d-48c9f3e6f015 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:16.253836 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c02c3f-aa28-4113-970d-48c9f3e6f015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:16.255471 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c02c3f-aa28-4113-970d-48c9f3e6f015 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:16.267085 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1412/2823] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:16.271194 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7567d21-a165-47f4-81a5-897fa61d81f6 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:16.282014 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7567d21-a165-47f4-81a5-897fa61d81f6 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:16.286843 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5feb45-7122-4e97-952b-8cfad420b0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:16.287542 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5feb45-7122-4e97-952b-8cfad420b0cf admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:16.287822 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5feb45-7122-4e97-952b-8cfad420b0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:16.288091 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5feb45-7122-4e97-952b-8cfad420b0cf admin admin] PATH_INFO: `/v3/projects/397089677b0944a6a755b4256d1e27d9/users/2ad36f1791a34b5f865970d49ea62900/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:16.303039 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5feb45-7122-4e97-952b-8cfad420b0cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=397089677b0944a6a755b4256d1e27d9, user_id=2ad36f1791a34b5f865970d49ea62900, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:16.305774 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5feb45-7122-4e97-952b-8cfad420b0cf admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:16.388432 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1412/2824] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:06:16 2022] PUT /identity/v3/projects/397089677b0944a6a755b4256d1e27d9/users/2ad36f1791a34b5f865970d49ea62900/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:16.392718 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c02c3f-aa28-4113-970d-48c9f3e6f015 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:16.403276 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c02c3f-aa28-4113-970d-48c9f3e6f015 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:16.469926 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee68bd-db3b-4326-85cc-bd3a4a9be73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:16.470536 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee68bd-db3b-4326-85cc-bd3a4a9be73c admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:16.470811 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee68bd-db3b-4326-85cc-bd3a4a9be73c admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:16.471090 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee68bd-db3b-4326-85cc-bd3a4a9be73c admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:16.471776 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee68bd-db3b-4326-85cc-bd3a4a9be73c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:16.473395 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee68bd-db3b-4326-85cc-bd3a4a9be73c admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:16.483494 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1413/2825] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:16.487980 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5feb45-7122-4e97-952b-8cfad420b0cf admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:16.499179 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5feb45-7122-4e97-952b-8cfad420b0cf admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:16.504674 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c54dd8-b44e-439c-bc11-9b8c8e1ceaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:16.506250 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c54dd8-b44e-439c-bc11-9b8c8e1ceaac admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:16.506250 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c54dd8-b44e-439c-bc11-9b8c8e1ceaac admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:16.506250 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c54dd8-b44e-439c-bc11-9b8c8e1ceaac admin admin] PATH_INFO: `/v3/projects/397089677b0944a6a755b4256d1e27d9/users/2ad36f1791a34b5f865970d49ea62900/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:16.507833 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c54dd8-b44e-439c-bc11-9b8c8e1ceaac admin admin] RBAC: Authorizing `identity:create_grant(project_id=397089677b0944a6a755b4256d1e27d9, user_id=2ad36f1791a34b5f865970d49ea62900, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:16.510519 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c54dd8-b44e-439c-bc11-9b8c8e1ceaac admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:16.523593 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1413/2826] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:06:16 2022] PUT /identity/v3/projects/397089677b0944a6a755b4256d1e27d9/users/2ad36f1791a34b5f865970d49ea62900/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:22.466329 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97303835-0447-4610-b9b8-9fe6e6d23ef8 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:22.466869 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97303835-0447-4610-b9b8-9fe6e6d23ef8 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:22.466992 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97303835-0447-4610-b9b8-9fe6e6d23ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:22.515630 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-97303835-0447-4610-b9b8-9fe6e6d23ef8 None None] MFA Rules not processed for user `2ad36f1791a34b5f865970d49ea62900`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:22.517429 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-97303835-0447-4610-b9b8-9fe6e6d23ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:22.605945 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1414/2827] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:06:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:22.621910 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c54dd8-b44e-439c-bc11-9b8c8e1ceaac admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:22.627286 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-38c54dd8-b44e-439c-bc11-9b8c8e1ceaac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:22.707407 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c54dd8-b44e-439c-bc11-9b8c8e1ceaac admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:22.714722 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5637977-530b-4c87-9e5e-a9285fbfaf6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:22.715486 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5637977-530b-4c87-9e5e-a9285fbfaf6f service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:22.715892 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5637977-530b-4c87-9e5e-a9285fbfaf6f service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:22.716231 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5637977-530b-4c87-9e5e-a9285fbfaf6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:22.778078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5637977-530b-4c87-9e5e-a9285fbfaf6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:22.783263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5637977-530b-4c87-9e5e-a9285fbfaf6f service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:22.793295 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1414/2828] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:32.601674 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=73,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:32.787448 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=75,keystone:INSERT=5 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:42.420499 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597b751-6708-4177-bac0-caa8f2ec196b None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:42.421109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597b751-6708-4177-bac0-caa8f2ec196b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:42.421275 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597b751-6708-4177-bac0-caa8f2ec196b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:42.441286 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-5597b751-6708-4177-bac0-caa8f2ec196b None None] MFA Rules not processed for user `384fe3ef86de41fc939e1a3cbbc6fe13`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:42.442531 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-5597b751-6708-4177-bac0-caa8f2ec196b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:42.449529 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1415/2829] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:06:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:06:52.435492 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:05.132995 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5637977-530b-4c87-9e5e-a9285fbfaf6f service nova] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:05.194805 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5637977-530b-4c87-9e5e-a9285fbfaf6f service nova] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:05.199032 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d3f4a-93ff-4c97-a307-40cbefa3899b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:05.199677 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d3f4a-93ff-4c97-a307-40cbefa3899b service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:05.199964 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d3f4a-93ff-4c97-a307-40cbefa3899b service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:05.200242 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d3f4a-93ff-4c97-a307-40cbefa3899b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:05.210355 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d3f4a-93ff-4c97-a307-40cbefa3899b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:05.211932 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d3f4a-93ff-4c97-a307-40cbefa3899b service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:05.221724 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1415/2830] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:08.637071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d38a95-1976-4298-b3e0-e58aa6a33dd2 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:08.637657 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d38a95-1976-4298-b3e0-e58aa6a33dd2 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:08.637657 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d38a95-1976-4298-b3e0-e58aa6a33dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:08.656811 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-20d38a95-1976-4298-b3e0-e58aa6a33dd2 None None] MFA Rules not processed for user `5ca20ec26ae045dbb778dfe190d474ec`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:08.657996 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-20d38a95-1976-4298-b3e0-e58aa6a33dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:08.721449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1416/2831] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:07:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:09.028091 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d3f4a-93ff-4c97-a307-40cbefa3899b service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:09.034446 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d3f4a-93ff-4c97-a307-40cbefa3899b service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:09.038262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a27a2a-f74c-4a57-8a66-645b9d196fb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:09.038884 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a27a2a-f74c-4a57-8a66-645b9d196fb0 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:09.039164 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a27a2a-f74c-4a57-8a66-645b9d196fb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:09.039466 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a27a2a-f74c-4a57-8a66-645b9d196fb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:09.041307 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-e5a27a2a-f74c-4a57-8a66-645b9d196fb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:09.051353 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a27a2a-f74c-4a57-8a66-645b9d196fb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:09.052844 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a27a2a-f74c-4a57-8a66-645b9d196fb0 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:09.061849 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1416/2832] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:18.715982 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=25 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:19.058624 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=32 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:28.693496 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d38a95-1976-4298-b3e0-e58aa6a33dd2 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:28.694903 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-20d38a95-1976-4298-b3e0-e58aa6a33dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:28.762915 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d38a95-1976-4298-b3e0-e58aa6a33dd2 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:28.768125 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbe13c-f7aa-4001-bb44-f9f1fcac454b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e675d44d2c49929feb0ec0d2c0d0eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:28.768736 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbe13c-f7aa-4001-bb44-f9f1fcac454b service placement] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:28.769050 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbe13c-f7aa-4001-bb44-f9f1fcac454b service placement] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:28.769331 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbe13c-f7aa-4001-bb44-f9f1fcac454b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:28.771075 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-5fcbe13c-f7aa-4001-bb44-f9f1fcac454b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:28.782574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbe13c-f7aa-4001-bb44-f9f1fcac454b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:28.784196 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbe13c-f7aa-4001-bb44-f9f1fcac454b service placement] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:28.794514 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1417/2833] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:38.790274 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=32 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:24.897279 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a27a2a-f74c-4a57-8a66-645b9d196fb0 service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:24.906862 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a27a2a-f74c-4a57-8a66-645b9d196fb0 service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:24.910540 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084013b-8102-4e98-b940-edae3b667ec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:24.911124 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084013b-8102-4e98-b940-edae3b667ec5 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:24.911560 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084013b-8102-4e98-b940-edae3b667ec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:24.911824 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084013b-8102-4e98-b940-edae3b667ec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:24.913542 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-5084013b-8102-4e98-b940-edae3b667ec5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:24.978466 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084013b-8102-4e98-b940-edae3b667ec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:24.983988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084013b-8102-4e98-b940-edae3b667ec5 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:24.995185 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1417/2834] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:08:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:08:28.720566 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbe13c-f7aa-4001-bb44-f9f1fcac454b service placement] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:28.722026 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-5fcbe13c-f7aa-4001-bb44-f9f1fcac454b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:28.736128 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbe13c-f7aa-4001-bb44-f9f1fcac454b service placement] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:28.741865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6480ca2-0cff-44a4-8c67-c4a24cf08c29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e675d44d2c49929feb0ec0d2c0d0eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:28.742659 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6480ca2-0cff-44a4-8c67-c4a24cf08c29 service placement] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:28.742863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6480ca2-0cff-44a4-8c67-c4a24cf08c29 service placement] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:28.743096 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6480ca2-0cff-44a4-8c67-c4a24cf08c29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:28.745096 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a6480ca2-0cff-44a4-8c67-c4a24cf08c29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:28.758417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6480ca2-0cff-44a4-8c67-c4a24cf08c29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:28.760310 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6480ca2-0cff-44a4-8c67-c4a24cf08c29 service placement] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:28.772339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1418/2835] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:08:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:08:28.874370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084013b-8102-4e98-b940-edae3b667ec5 service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:28.876471 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-5084013b-8102-4e98-b940-edae3b667ec5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:28.890277 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084013b-8102-4e98-b940-edae3b667ec5 service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:28.894938 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fadc3f-e2a6-4dde-8cc5-f35a18313f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:28.895597 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fadc3f-e2a6-4dde-8cc5-f35a18313f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:28.895873 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fadc3f-e2a6-4dde-8cc5-f35a18313f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:28.896143 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fadc3f-e2a6-4dde-8cc5-f35a18313f75 admin admin] PATH_INFO: `/v3/users/5ca20ec26ae045dbb778dfe190d474ec` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:28.897324 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fadc3f-e2a6-4dde-8cc5-f35a18313f75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ca20ec26ae045dbb778dfe190d474ec)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:28.899797 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fadc3f-e2a6-4dde-8cc5-f35a18313f75 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:29.114349 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-56fadc3f-e2a6-4dde-8cc5-f35a18313f75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ca20ec26ae045dbb778dfe190d474ec'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:29.190150 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-56fadc3f-e2a6-4dde-8cc5-f35a18313f75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ca20ec26ae045dbb778dfe190d474ec'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:29.198872 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-56fadc3f-e2a6-4dde-8cc5-f35a18313f75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ca20ec26ae045dbb778dfe190d474ec'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:29.212250 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-56fadc3f-e2a6-4dde-8cc5-f35a18313f75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ca20ec26ae045dbb778dfe190d474ec'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:29.216541 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-56fadc3f-e2a6-4dde-8cc5-f35a18313f75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ca20ec26ae045dbb778dfe190d474ec'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:29.219291 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1418/2836] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:08:28 2022] DELETE /identity/v3/users/5ca20ec26ae045dbb778dfe190d474ec => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:08:29.546513 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6480ca2-0cff-44a4-8c67-c4a24cf08c29 service placement] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:29.560754 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6480ca2-0cff-44a4-8c67-c4a24cf08c29 service placement] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:29.628508 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9c8d8-4589-4519-8304-7ff3065e20df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:29.629044 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9c8d8-4589-4519-8304-7ff3065e20df admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:29.629328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9c8d8-4589-4519-8304-7ff3065e20df admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:29.629605 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9c8d8-4589-4519-8304-7ff3065e20df admin admin] PATH_INFO: `/v3/projects/53d9dd68ca6b4376992d408b1718c070` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:29.630847 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9c8d8-4589-4519-8304-7ff3065e20df admin admin] RBAC: Authorizing `identity:delete_project(project_id=53d9dd68ca6b4376992d408b1718c070)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:29.632886 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9c8d8-4589-4519-8304-7ff3065e20df admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:29.843209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-8ec9c8d8-4589-4519-8304-7ff3065e20df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53d9dd68ca6b4376992d408b1718c070', 'request_id': 'req-8ec9c8d8-4589-4519-8304-7ff3065e20df'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:29.849843 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-8ec9c8d8-4589-4519-8304-7ff3065e20df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53d9dd68ca6b4376992d408b1718c070', 'request_id': 'req-8ec9c8d8-4589-4519-8304-7ff3065e20df'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:29.859954 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-8ec9c8d8-4589-4519-8304-7ff3065e20df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53d9dd68ca6b4376992d408b1718c070', 'request_id': 'req-8ec9c8d8-4589-4519-8304-7ff3065e20df'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:29.996543 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-8ec9c8d8-4589-4519-8304-7ff3065e20df admin admin] The token cache is being invalidate because project 53d9dd68ca6b4376992d408b1718c070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:08:29.996845 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-8ec9c8d8-4589-4519-8304-7ff3065e20df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:29.997618 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-8ec9c8d8-4589-4519-8304-7ff3065e20df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:30.004837 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1419/2837] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:08:29 2022] DELETE /identity/v3/projects/53d9dd68ca6b4376992d408b1718c070 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:30.009972 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516868b-73b0-4413-ab52-941d3fd36f77 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:30.016232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516868b-73b0-4413-ab52-941d3fd36f77 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:30.016232 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516868b-73b0-4413-ab52-941d3fd36f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:30.033596 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-7516868b-73b0-4413-ab52-941d3fd36f77 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:30.035094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-7516868b-73b0-4413-ab52-941d3fd36f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:30.101390 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1419/2838] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:08:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:08:30.110918 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d5a4e-65c1-42e5-a738-37967953e67e None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:30.111201 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d5a4e-65c1-42e5-a738-37967953e67e None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:30.111516 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d5a4e-65c1-42e5-a738-37967953e67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:30.133658 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-768d5a4e-65c1-42e5-a738-37967953e67e None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:30.134889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-768d5a4e-65c1-42e5-a738-37967953e67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:30.142969 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1420/2839] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:08:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:08:30.147585 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516868b-73b0-4413-ab52-941d3fd36f77 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:30.158573 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516868b-73b0-4413-ab52-941d3fd36f77 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:30.163315 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4e619-09ac-4071-87fd-63fe7e93441e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:30.163949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4e619-09ac-4071-87fd-63fe7e93441e admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:30.164225 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4e619-09ac-4071-87fd-63fe7e93441e admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:30.164493 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4e619-09ac-4071-87fd-63fe7e93441e admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:30.165800 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4e619-09ac-4071-87fd-63fe7e93441e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:08:30.166102 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4e619-09ac-4071-87fd-63fe7e93441e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:30.167740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4e619-09ac-4071-87fd-63fe7e93441e admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:30.169432 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:30.181955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1420/2840] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 14:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:08:30.186788 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d5a4e-65c1-42e5-a738-37967953e67e None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:30.198736 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d5a4e-65c1-42e5-a738-37967953e67e None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:30.204010 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c45e62-8029-4984-b336-6f12b144c547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:30.204629 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c45e62-8029-4984-b336-6f12b144c547 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:30.204913 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c45e62-8029-4984-b336-6f12b144c547 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:30.205177 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c45e62-8029-4984-b336-6f12b144c547 admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:30.205827 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c45e62-8029-4984-b336-6f12b144c547 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:30.207829 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c45e62-8029-4984-b336-6f12b144c547 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:30.409226 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1421/2841] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:08:30 2022] POST /identity/v3/projects => generated 365 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:08:30.413671 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4e619-09ac-4071-87fd-63fe7e93441e admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:30.429319 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4e619-09ac-4071-87fd-63fe7e93441e admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:30.489418 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc97b6-bdfa-49e2-8ff5-2515ec3743f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:30.489946 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc97b6-bdfa-49e2-8ff5-2515ec3743f2 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:30.490228 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc97b6-bdfa-49e2-8ff5-2515ec3743f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:30.490498 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc97b6-bdfa-49e2-8ff5-2515ec3743f2 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:30.491133 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc97b6-bdfa-49e2-8ff5-2515ec3743f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:30.493818 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc97b6-bdfa-49e2-8ff5-2515ec3743f2 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:30.635787 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1421/2842] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:08:30 2022] POST /identity/v3/users => generated 283 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:08:30.640037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c45e62-8029-4984-b336-6f12b144c547 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:30.650482 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c45e62-8029-4984-b336-6f12b144c547 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:30.655629 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d75296-b166-4546-8fbc-eabbc3e2e985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:30.657559 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d75296-b166-4546-8fbc-eabbc3e2e985 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:30.657559 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d75296-b166-4546-8fbc-eabbc3e2e985 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:30.657559 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d75296-b166-4546-8fbc-eabbc3e2e985 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:30.657559 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d75296-b166-4546-8fbc-eabbc3e2e985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:30.658731 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d75296-b166-4546-8fbc-eabbc3e2e985 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:30.669803 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1422/2843] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:08:30.674341 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc97b6-bdfa-49e2-8ff5-2515ec3743f2 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:30.685934 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc97b6-bdfa-49e2-8ff5-2515ec3743f2 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:30.691226 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5b3a6-5dad-47b8-a865-62db1ee42846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:30.692180 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5b3a6-5dad-47b8-a865-62db1ee42846 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:30.692643 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5b3a6-5dad-47b8-a865-62db1ee42846 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:30.693089 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5b3a6-5dad-47b8-a865-62db1ee42846 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:30.694152 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5b3a6-5dad-47b8-a865-62db1ee42846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:30.697092 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5b3a6-5dad-47b8-a865-62db1ee42846 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:30.709173 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1422/2844] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:08:30.713665 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d75296-b166-4546-8fbc-eabbc3e2e985 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:30.723783 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d75296-b166-4546-8fbc-eabbc3e2e985 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:30.729774 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de6c54-ec02-4992-9edc-e3c743cf01b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:30.730468 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de6c54-ec02-4992-9edc-e3c743cf01b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:30.730719 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de6c54-ec02-4992-9edc-e3c743cf01b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:30.730995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de6c54-ec02-4992-9edc-e3c743cf01b7 admin admin] PATH_INFO: `/v3/projects/db535c6d3a3e4cd1a77edebb1535562f/users/8199ac9de177491c82dad1678f985697/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:30.748828 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de6c54-ec02-4992-9edc-e3c743cf01b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db535c6d3a3e4cd1a77edebb1535562f, user_id=8199ac9de177491c82dad1678f985697, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:30.751432 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de6c54-ec02-4992-9edc-e3c743cf01b7 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:30.847664 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1423/2845] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:08:30 2022] PUT /identity/v3/projects/db535c6d3a3e4cd1a77edebb1535562f/users/8199ac9de177491c82dad1678f985697/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:30.858076 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9807f-53c8-4d3f-9dd5-01028b163963 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:30.858362 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9807f-53c8-4d3f-9dd5-01028b163963 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:30.858639 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9807f-53c8-4d3f-9dd5-01028b163963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:30.889703 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-37e9807f-53c8-4d3f-9dd5-01028b163963 None None] MFA Rules not processed for user `8199ac9de177491c82dad1678f985697`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:30.890923 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-37e9807f-53c8-4d3f-9dd5-01028b163963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:30.958777 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1423/2846] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:08:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:08:30.963940 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de6c54-ec02-4992-9edc-e3c743cf01b7 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:30.979784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:31.036298 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de6c54-ec02-4992-9edc-e3c743cf01b7 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:31.041513 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae4de8-af91-4ab3-8853-633b24effd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:31.042141 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae4de8-af91-4ab3-8853-633b24effd2c admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:31.042421 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae4de8-af91-4ab3-8853-633b24effd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:31.042691 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae4de8-af91-4ab3-8853-633b24effd2c admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:31.043335 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae4de8-af91-4ab3-8853-633b24effd2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:31.045306 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae4de8-af91-4ab3-8853-633b24effd2c admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:31.277064 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1424/2847] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:08:30 2022] POST /identity/v3/projects => generated 363 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:08:31.281112 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9807f-53c8-4d3f-9dd5-01028b163963 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:31.292370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9807f-53c8-4d3f-9dd5-01028b163963 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:31.353252 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba805e57-6e8b-4807-b943-9b2f334b85d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:31.353870 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba805e57-6e8b-4807-b943-9b2f334b85d8 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:31.354150 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba805e57-6e8b-4807-b943-9b2f334b85d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:31.354420 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba805e57-6e8b-4807-b943-9b2f334b85d8 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:31.355077 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba805e57-6e8b-4807-b943-9b2f334b85d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:31.357065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba805e57-6e8b-4807-b943-9b2f334b85d8 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:31.366967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:31.516334 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1424/2848] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:08:31 2022] POST /identity/v3/users => generated 288 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:08:31.520617 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae4de8-af91-4ab3-8853-633b24effd2c admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:31.531701 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae4de8-af91-4ab3-8853-633b24effd2c admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:31.536375 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860c2f6-a528-4204-a85e-4d763ace4bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:31.536983 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860c2f6-a528-4204-a85e-4d763ace4bcf admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:31.537263 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860c2f6-a528-4204-a85e-4d763ace4bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:31.537539 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860c2f6-a528-4204-a85e-4d763ace4bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:31.538205 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860c2f6-a528-4204-a85e-4d763ace4bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:31.540391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860c2f6-a528-4204-a85e-4d763ace4bcf admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:31.551799 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1425/2849] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:08:31.556747 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba805e57-6e8b-4807-b943-9b2f334b85d8 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:31.567284 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba805e57-6e8b-4807-b943-9b2f334b85d8 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:31.572712 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bdc63c-be79-47ed-b78b-0fc7b57bc76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:31.573393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdc63c-be79-47ed-b78b-0fc7b57bc76e admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:31.573700 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdc63c-be79-47ed-b78b-0fc7b57bc76e admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:31.573969 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdc63c-be79-47ed-b78b-0fc7b57bc76e admin admin] PATH_INFO: `/v3/projects/b64124cf49fd4dac9cd8f90025e922df/users/03358c1f268d4650b973832b4503579f/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:31.590015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bdc63c-be79-47ed-b78b-0fc7b57bc76e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b64124cf49fd4dac9cd8f90025e922df, user_id=03358c1f268d4650b973832b4503579f, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:31.592752 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bdc63c-be79-47ed-b78b-0fc7b57bc76e admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:31.768091 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1425/2850] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:08:31 2022] PUT /identity/v3/projects/b64124cf49fd4dac9cd8f90025e922df/users/03358c1f268d4650b973832b4503579f/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:08:31.772144 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860c2f6-a528-4204-a85e-4d763ace4bcf admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:31.782839 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860c2f6-a528-4204-a85e-4d763ace4bcf admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:31.840299 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6837d-bcf0-448c-a5b0-9d2b55aa93ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:31.840825 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6837d-bcf0-448c-a5b0-9d2b55aa93ab admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:31.841110 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6837d-bcf0-448c-a5b0-9d2b55aa93ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:31.841383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6837d-bcf0-448c-a5b0-9d2b55aa93ab admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:31.842026 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6837d-bcf0-448c-a5b0-9d2b55aa93ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:31.843666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6837d-bcf0-448c-a5b0-9d2b55aa93ab admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:31.859612 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1426/2851] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:08:31.864677 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bdc63c-be79-47ed-b78b-0fc7b57bc76e admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:31.875834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bdc63c-be79-47ed-b78b-0fc7b57bc76e admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:31.880740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836628c2-6add-4bab-882e-c14ebaa870b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:31.881405 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836628c2-6add-4bab-882e-c14ebaa870b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:31.881684 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836628c2-6add-4bab-882e-c14ebaa870b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:31.881953 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836628c2-6add-4bab-882e-c14ebaa870b4 admin admin] PATH_INFO: `/v3/projects/b64124cf49fd4dac9cd8f90025e922df/users/03358c1f268d4650b973832b4503579f/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:31.884538 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836628c2-6add-4bab-882e-c14ebaa870b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b64124cf49fd4dac9cd8f90025e922df, user_id=03358c1f268d4650b973832b4503579f, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:31.887179 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836628c2-6add-4bab-882e-c14ebaa870b4 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:31.898697 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1426/2852] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:08:31 2022] PUT /identity/v3/projects/b64124cf49fd4dac9cd8f90025e922df/users/03358c1f268d4650b973832b4503579f/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:08:31.909886 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0adcf0-28c0-47ce-a2a6-b80e5feb96d5 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:31.910340 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0adcf0-28c0-47ce-a2a6-b80e5feb96d5 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:31.910514 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0adcf0-28c0-47ce-a2a6-b80e5feb96d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:31.941385 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-6f0adcf0-28c0-47ce-a2a6-b80e5feb96d5 None None] MFA Rules not processed for user `03358c1f268d4650b973832b4503579f`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:31.942874 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-6f0adcf0-28c0-47ce-a2a6-b80e5feb96d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:32.020014 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1427/2853] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:08:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:08:32.031598 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836628c2-6add-4bab-882e-c14ebaa870b4 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:32.033410 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-836628c2-6add-4bab-882e-c14ebaa870b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:32.095121 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836628c2-6add-4bab-882e-c14ebaa870b4 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:32.098987 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef1808-9753-4a4f-8d48-eada36acfb69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:32.099651 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef1808-9753-4a4f-8d48-eada36acfb69 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:32.099928 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef1808-9753-4a4f-8d48-eada36acfb69 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:32.100202 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef1808-9753-4a4f-8d48-eada36acfb69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:32.110553 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef1808-9753-4a4f-8d48-eada36acfb69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:32.112037 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef1808-9753-4a4f-8d48-eada36acfb69 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:32.122928 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1427/2854] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:08:32 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:08:32.390949 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0adcf0-28c0-47ce-a2a6-b80e5feb96d5 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:32.402504 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0adcf0-28c0-47ce-a2a6-b80e5feb96d5 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:32.406109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53efb5-378b-4bf5-9625-e3cc49abe0c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:32.406717 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53efb5-378b-4bf5-9625-e3cc49abe0c1 service cinder] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:32.406990 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53efb5-378b-4bf5-9625-e3cc49abe0c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:32.407260 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53efb5-378b-4bf5-9625-e3cc49abe0c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:32.412896 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:32.473707 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53efb5-378b-4bf5-9625-e3cc49abe0c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:32.475353 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53efb5-378b-4bf5-9625-e3cc49abe0c1 service cinder] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:32.485692 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1428/2855] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:08:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:08:36.583470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef1808-9753-4a4f-8d48-eada36acfb69 service cinder] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:36.646882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef1808-9753-4a4f-8d48-eada36acfb69 service cinder] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:36.652356 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bdd9b-054f-422d-bc95-137901ef458f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:36.653004 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bdd9b-054f-422d-bc95-137901ef458f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:36.653430 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bdd9b-054f-422d-bc95-137901ef458f admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:36.653731 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bdd9b-054f-422d-bc95-137901ef458f admin admin] PATH_INFO: `/v3/users/8199ac9de177491c82dad1678f985697` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:36.654889 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245bdd9b-054f-422d-bc95-137901ef458f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8199ac9de177491c82dad1678f985697)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:36.656870 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245bdd9b-054f-422d-bc95-137901ef458f admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:36.987174 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-245bdd9b-054f-422d-bc95-137901ef458f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8199ac9de177491c82dad1678f985697'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:37.087560 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-245bdd9b-054f-422d-bc95-137901ef458f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8199ac9de177491c82dad1678f985697'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:37.092771 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:37.102673 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-245bdd9b-054f-422d-bc95-137901ef458f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8199ac9de177491c82dad1678f985697'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:37.111094 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-245bdd9b-054f-422d-bc95-137901ef458f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8199ac9de177491c82dad1678f985697'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:37.111939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-245bdd9b-054f-422d-bc95-137901ef458f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8199ac9de177491c82dad1678f985697'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:37.120641 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1428/2856] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:08:36 2022] DELETE /identity/v3/users/8199ac9de177491c82dad1678f985697 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:37.124209 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576552b-803c-41c8-84fc-98a7be40ff42 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:37.124867 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576552b-803c-41c8-84fc-98a7be40ff42 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:37.124867 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576552b-803c-41c8-84fc-98a7be40ff42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:37.145015 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-a576552b-803c-41c8-84fc-98a7be40ff42 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:37.146243 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a576552b-803c-41c8-84fc-98a7be40ff42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:37.213070 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1429/2857] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:08:37.223546 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bdd9b-054f-422d-bc95-137901ef458f admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:37.225110 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-245bdd9b-054f-422d-bc95-137901ef458f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:37.291498 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bdd9b-054f-422d-bc95-137901ef458f admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:37.295201 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d369e-7919-4aa5-859e-083d6c342f7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:37.295864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d369e-7919-4aa5-859e-083d6c342f7e service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:37.296144 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d369e-7919-4aa5-859e-083d6c342f7e service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:37.296415 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d369e-7919-4aa5-859e-083d6c342f7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:37.306353 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d369e-7919-4aa5-859e-083d6c342f7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:37.307850 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d369e-7919-4aa5-859e-083d6c342f7e service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:37.318469 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1429/2858] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:08:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:08:37.895199 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576552b-803c-41c8-84fc-98a7be40ff42 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:37.896838 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a576552b-803c-41c8-84fc-98a7be40ff42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:37.909226 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576552b-803c-41c8-84fc-98a7be40ff42 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:37.914032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9ebfa-3223-4075-96e5-91835bd120e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:37.915187 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9ebfa-3223-4075-96e5-91835bd120e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:37.915535 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9ebfa-3223-4075-96e5-91835bd120e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:37.915805 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9ebfa-3223-4075-96e5-91835bd120e2 admin admin] PATH_INFO: `/v3/projects/db535c6d3a3e4cd1a77edebb1535562f` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:37.916990 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9ebfa-3223-4075-96e5-91835bd120e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db535c6d3a3e4cd1a77edebb1535562f)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:37.918937 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9ebfa-3223-4075-96e5-91835bd120e2 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:38.071922 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-e6e9ebfa-3223-4075-96e5-91835bd120e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db535c6d3a3e4cd1a77edebb1535562f', 'request_id': 'req-e6e9ebfa-3223-4075-96e5-91835bd120e2'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:38.077791 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-e6e9ebfa-3223-4075-96e5-91835bd120e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db535c6d3a3e4cd1a77edebb1535562f', 'request_id': 'req-e6e9ebfa-3223-4075-96e5-91835bd120e2'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:38.084564 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-e6e9ebfa-3223-4075-96e5-91835bd120e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db535c6d3a3e4cd1a77edebb1535562f', 'request_id': 'req-e6e9ebfa-3223-4075-96e5-91835bd120e2'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:38.206877 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-e6e9ebfa-3223-4075-96e5-91835bd120e2 admin admin] The token cache is being invalidate because project db535c6d3a3e4cd1a77edebb1535562f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:08:38.207606 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-e6e9ebfa-3223-4075-96e5-91835bd120e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:38.207822 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-e6e9ebfa-3223-4075-96e5-91835bd120e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:38.209359 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1430/2859] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:08:37 2022] DELETE /identity/v3/projects/db535c6d3a3e4cd1a77edebb1535562f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:38.214648 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d369e-7919-4aa5-859e-083d6c342f7e service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:38.225890 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d369e-7919-4aa5-859e-083d6c342f7e service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:38.305026 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61972e-5755-4c9e-a62b-38664fd16818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:38.305727 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61972e-5755-4c9e-a62b-38664fd16818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:38.306007 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61972e-5755-4c9e-a62b-38664fd16818 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:38.306281 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61972e-5755-4c9e-a62b-38664fd16818 admin admin] PATH_INFO: `/v3/users/03358c1f268d4650b973832b4503579f` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:38.307990 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61972e-5755-4c9e-a62b-38664fd16818 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03358c1f268d4650b973832b4503579f)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:38.309952 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61972e-5755-4c9e-a62b-38664fd16818 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:38.549045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-4a61972e-5755-4c9e-a62b-38664fd16818 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03358c1f268d4650b973832b4503579f'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:38.658225 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-4a61972e-5755-4c9e-a62b-38664fd16818 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03358c1f268d4650b973832b4503579f'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:38.666679 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-4a61972e-5755-4c9e-a62b-38664fd16818 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03358c1f268d4650b973832b4503579f'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:38.680486 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-4a61972e-5755-4c9e-a62b-38664fd16818 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03358c1f268d4650b973832b4503579f'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:38.681237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-4a61972e-5755-4c9e-a62b-38664fd16818 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03358c1f268d4650b973832b4503579f'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:38.682824 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:38.688555 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1430/2860] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:08:38 2022] DELETE /identity/v3/users/03358c1f268d4650b973832b4503579f => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:39.254586 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9ebfa-3223-4075-96e5-91835bd120e2 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:39.256067 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-e6e9ebfa-3223-4075-96e5-91835bd120e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:39.269772 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9ebfa-3223-4075-96e5-91835bd120e2 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:39.303650 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:39.339946 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5bcd80-0748-499e-a5f0-569a566be085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:39.340631 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bcd80-0748-499e-a5f0-569a566be085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:39.340932 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bcd80-0748-499e-a5f0-569a566be085 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:39.341214 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bcd80-0748-499e-a5f0-569a566be085 admin admin] PATH_INFO: `/v3/projects/b64124cf49fd4dac9cd8f90025e922df` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:39.342493 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5bcd80-0748-499e-a5f0-569a566be085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b64124cf49fd4dac9cd8f90025e922df)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:39.344562 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5bcd80-0748-499e-a5f0-569a566be085 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:39.477090 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-1f5bcd80-0748-499e-a5f0-569a566be085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b64124cf49fd4dac9cd8f90025e922df', 'request_id': 'req-1f5bcd80-0748-499e-a5f0-569a566be085'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:39.483568 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-1f5bcd80-0748-499e-a5f0-569a566be085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b64124cf49fd4dac9cd8f90025e922df', 'request_id': 'req-1f5bcd80-0748-499e-a5f0-569a566be085'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:39.490778 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-1f5bcd80-0748-499e-a5f0-569a566be085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b64124cf49fd4dac9cd8f90025e922df', 'request_id': 'req-1f5bcd80-0748-499e-a5f0-569a566be085'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:39.580129 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-1f5bcd80-0748-499e-a5f0-569a566be085 admin admin] The token cache is being invalidate because project b64124cf49fd4dac9cd8f90025e922df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:08:39.580576 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-1f5bcd80-0748-499e-a5f0-569a566be085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:39.581397 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-1f5bcd80-0748-499e-a5f0-569a566be085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:39.583069 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1431/2861] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:08:39 2022] DELETE /identity/v3/projects/b64124cf49fd4dac9cd8f90025e922df => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:39.588842 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19009fa4-576f-41ba-acb1-54604f8c6d7b None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:39.589712 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19009fa4-576f-41ba-acb1-54604f8c6d7b None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:39.589712 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19009fa4-576f-41ba-acb1-54604f8c6d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:39.612357 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-19009fa4-576f-41ba-acb1-54604f8c6d7b None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:39.613950 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-19009fa4-576f-41ba-acb1-54604f8c6d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:39.679527 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1431/2862] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:08:39.743667 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a6cfb-21ea-43ba-826f-1c2a254e3a86 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:39.743943 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a6cfb-21ea-43ba-826f-1c2a254e3a86 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:39.744225 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a6cfb-21ea-43ba-826f-1c2a254e3a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:39.765471 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-7c5a6cfb-21ea-43ba-826f-1c2a254e3a86 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:39.766739 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-7c5a6cfb-21ea-43ba-826f-1c2a254e3a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:39.775913 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1432/2863] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:08:39.779939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19009fa4-576f-41ba-acb1-54604f8c6d7b None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:39.793002 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19009fa4-576f-41ba-acb1-54604f8c6d7b None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:39.800575 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a91fd-d222-4d17-8a92-b1fb2a1aad4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:39.801594 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a91fd-d222-4d17-8a92-b1fb2a1aad4f admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:39.801816 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a91fd-d222-4d17-8a92-b1fb2a1aad4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:39.802276 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a91fd-d222-4d17-8a92-b1fb2a1aad4f admin admin] PATH_INFO: `/v3/domains` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:39.803321 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a91fd-d222-4d17-8a92-b1fb2a1aad4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:08:39.803707 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a91fd-d222-4d17-8a92-b1fb2a1aad4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:39.805717 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a91fd-d222-4d17-8a92-b1fb2a1aad4f admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:39.819111 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1432/2864] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 14:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 14:08:39.823929 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a6cfb-21ea-43ba-826f-1c2a254e3a86 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:39.835059 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a6cfb-21ea-43ba-826f-1c2a254e3a86 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:39.843147 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e73fb-5f20-45fa-a25d-23725ab0d78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:39.844156 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e73fb-5f20-45fa-a25d-23725ab0d78a admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:39.844565 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e73fb-5f20-45fa-a25d-23725ab0d78a admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:39.844965 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e73fb-5f20-45fa-a25d-23725ab0d78a admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:39.845945 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e73fb-5f20-45fa-a25d-23725ab0d78a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:39.848936 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e73fb-5f20-45fa-a25d-23725ab0d78a admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:39.980307 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1433/2865] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:08:39 2022] POST /identity/v3/projects => generated 379 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:08:39.985324 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a91fd-d222-4d17-8a92-b1fb2a1aad4f admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:39.997019 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a91fd-d222-4d17-8a92-b1fb2a1aad4f admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:40.059283 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb07de-46e6-47c2-aaa7-bbb254b08881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:40.059847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb07de-46e6-47c2-aaa7-bbb254b08881 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:40.060131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb07de-46e6-47c2-aaa7-bbb254b08881 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:40.060408 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb07de-46e6-47c2-aaa7-bbb254b08881 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:40.061058 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb07de-46e6-47c2-aaa7-bbb254b08881 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:40.062988 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb07de-46e6-47c2-aaa7-bbb254b08881 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:40.173335 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1433/2866] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:08:39 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:08:40.177630 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e73fb-5f20-45fa-a25d-23725ab0d78a admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:40.188721 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e73fb-5f20-45fa-a25d-23725ab0d78a admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:40.193268 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c9db1-a368-4215-badc-6f3b18c6c89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:40.193864 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c9db1-a368-4215-badc-6f3b18c6c89a admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:40.194138 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c9db1-a368-4215-badc-6f3b18c6c89a admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:40.194407 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c9db1-a368-4215-badc-6f3b18c6c89a admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:40.195049 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c9db1-a368-4215-badc-6f3b18c6c89a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:40.196727 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c9db1-a368-4215-badc-6f3b18c6c89a admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:40.208764 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1434/2867] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:08:40.217152 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb07de-46e6-47c2-aaa7-bbb254b08881 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:40.228245 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb07de-46e6-47c2-aaa7-bbb254b08881 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:40.233000 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafbf62-5af3-4ca1-b26c-1295a5e162ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:40.233620 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafbf62-5af3-4ca1-b26c-1295a5e162ca admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:40.233903 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafbf62-5af3-4ca1-b26c-1295a5e162ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:40.234180 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafbf62-5af3-4ca1-b26c-1295a5e162ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:40.234830 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafbf62-5af3-4ca1-b26c-1295a5e162ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:40.236510 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafbf62-5af3-4ca1-b26c-1295a5e162ca admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:40.249438 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1434/2868] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:08:40.255226 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c9db1-a368-4215-badc-6f3b18c6c89a admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:40.266482 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c9db1-a368-4215-badc-6f3b18c6c89a admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:40.271817 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ccecb-9310-48c2-8049-cbd9746ef90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:40.272490 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ccecb-9310-48c2-8049-cbd9746ef90d admin admin] REQUEST_METHOD: `PUT` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:40.272765 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ccecb-9310-48c2-8049-cbd9746ef90d admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:40.273037 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ccecb-9310-48c2-8049-cbd9746ef90d admin admin] PATH_INFO: `/v3/projects/2e7f8decf2f347ee8ed9e8b04dfc0633/users/0e3d779dabf14f7cb20bf29b4fd9c998/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:40.292318 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ccecb-9310-48c2-8049-cbd9746ef90d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e7f8decf2f347ee8ed9e8b04dfc0633, user_id=0e3d779dabf14f7cb20bf29b4fd9c998, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:40.295527 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ccecb-9310-48c2-8049-cbd9746ef90d admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:40.973361 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1435/2869] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:08:40 2022] PUT /identity/v3/projects/2e7f8decf2f347ee8ed9e8b04dfc0633/users/0e3d779dabf14f7cb20bf29b4fd9c998/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:40.985013 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c0b8a-50b9-4d82-a2de-05c64c7186de None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:40.985916 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c0b8a-50b9-4d82-a2de-05c64c7186de None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:40.985916 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c0b8a-50b9-4d82-a2de-05c64c7186de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:41.018645 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-ef4c0b8a-50b9-4d82-a2de-05c64c7186de None None] MFA Rules not processed for user `0e3d779dabf14f7cb20bf29b4fd9c998`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:41.019890 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ef4c0b8a-50b9-4d82-a2de-05c64c7186de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:41.082363 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:41.095188 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1435/2870] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:08:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:08:41.099995 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ccecb-9310-48c2-8049-cbd9746ef90d admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:41.168754 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:41.176801 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ccecb-9310-48c2-8049-cbd9746ef90d admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:41.183919 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9d221-500f-4788-ad03-5079a4da5c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:41.184517 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9d221-500f-4788-ad03-5079a4da5c3e admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:41.184802 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9d221-500f-4788-ad03-5079a4da5c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:41.185075 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9d221-500f-4788-ad03-5079a4da5c3e admin admin] PATH_INFO: `/v3/projects` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:41.185744 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9d221-500f-4788-ad03-5079a4da5c3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:41.187765 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9d221-500f-4788-ad03-5079a4da5c3e admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:41.425719 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1436/2871] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:08:41 2022] POST /identity/v3/projects => generated 381 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:08:41.430494 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c0b8a-50b9-4d82-a2de-05c64c7186de None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:41.441913 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c0b8a-50b9-4d82-a2de-05c64c7186de None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:41.528398 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743f8dd-aa43-4e51-a59e-d1f57da3b6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:41.529488 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743f8dd-aa43-4e51-a59e-d1f57da3b6c1 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:41.529982 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743f8dd-aa43-4e51-a59e-d1f57da3b6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:41.530450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743f8dd-aa43-4e51-a59e-d1f57da3b6c1 admin admin] PATH_INFO: `/v3/users` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:41.531879 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743f8dd-aa43-4e51-a59e-d1f57da3b6c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:41.535868 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743f8dd-aa43-4e51-a59e-d1f57da3b6c1 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:41.710385 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1436/2872] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:08:41 2022] POST /identity/v3/users => generated 297 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:08:41.715331 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9d221-500f-4788-ad03-5079a4da5c3e admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:41.726243 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9d221-500f-4788-ad03-5079a4da5c3e admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:41.731808 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceaf0f8-39d2-4529-801e-97115885b6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:41.732415 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaf0f8-39d2-4529-801e-97115885b6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:41.732694 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaf0f8-39d2-4529-801e-97115885b6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:41.732961 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaf0f8-39d2-4529-801e-97115885b6f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:41.733630 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceaf0f8-39d2-4529-801e-97115885b6f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:41.735239 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceaf0f8-39d2-4529-801e-97115885b6f9 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:41.749638 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1437/2873] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:08:41.754387 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743f8dd-aa43-4e51-a59e-d1f57da3b6c1 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:41.766078 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743f8dd-aa43-4e51-a59e-d1f57da3b6c1 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:41.771020 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891df7b-5f29-46ee-a929-21b53655506e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:41.771837 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891df7b-5f29-46ee-a929-21b53655506e admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:41.772142 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891df7b-5f29-46ee-a929-21b53655506e admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:41.772417 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891df7b-5f29-46ee-a929-21b53655506e admin admin] PATH_INFO: `/v3/projects/6792de36211243418f86a17ccd6ef42f/users/3dc4600d28494d6e83e0e9a17f062f6e/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:41.789146 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891df7b-5f29-46ee-a929-21b53655506e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6792de36211243418f86a17ccd6ef42f, user_id=3dc4600d28494d6e83e0e9a17f062f6e, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:41.791842 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891df7b-5f29-46ee-a929-21b53655506e admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:41.996394 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1437/2874] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:08:41 2022] PUT /identity/v3/projects/6792de36211243418f86a17ccd6ef42f/users/3dc4600d28494d6e83e0e9a17f062f6e/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:42.002214 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceaf0f8-39d2-4529-801e-97115885b6f9 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:42.014520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceaf0f8-39d2-4529-801e-97115885b6f9 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:42.075466 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a189b9-a5ca-4844-bb2a-61ab36711ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:42.076088 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a189b9-a5ca-4844-bb2a-61ab36711ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:42.076365 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a189b9-a5ca-4844-bb2a-61ab36711ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:42.076639 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a189b9-a5ca-4844-bb2a-61ab36711ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:42.077291 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a189b9-a5ca-4844-bb2a-61ab36711ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:42.078938 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a189b9-a5ca-4844-bb2a-61ab36711ff5 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:42.090361 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1438/2875] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:08:42.096402 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891df7b-5f29-46ee-a929-21b53655506e admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:42.107839 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891df7b-5f29-46ee-a929-21b53655506e admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:42.112600 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39145a-3993-43f5-8792-3d010c55c6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:42.113285 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39145a-3993-43f5-8792-3d010c55c6f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:42.113823 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39145a-3993-43f5-8792-3d010c55c6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:42.114099 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39145a-3993-43f5-8792-3d010c55c6f3 admin admin] PATH_INFO: `/v3/projects/6792de36211243418f86a17ccd6ef42f/users/3dc4600d28494d6e83e0e9a17f062f6e/roles/98ffd3c114804da292d7cb33721e9085` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:42.116192 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39145a-3993-43f5-8792-3d010c55c6f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6792de36211243418f86a17ccd6ef42f, user_id=3dc4600d28494d6e83e0e9a17f062f6e, role_id=98ffd3c114804da292d7cb33721e9085)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:42.119483 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39145a-3993-43f5-8792-3d010c55c6f3 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:42.131439 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1438/2876] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:08:42 2022] PUT /identity/v3/projects/6792de36211243418f86a17ccd6ef42f/users/3dc4600d28494d6e83e0e9a17f062f6e/roles/98ffd3c114804da292d7cb33721e9085 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:42.144137 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44705dff-8f47-4e44-a006-aa5736836e63 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:42.144475 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44705dff-8f47-4e44-a006-aa5736836e63 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:42.144809 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44705dff-8f47-4e44-a006-aa5736836e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:42.176545 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-44705dff-8f47-4e44-a006-aa5736836e63 None None] MFA Rules not processed for user `3dc4600d28494d6e83e0e9a17f062f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:42.177787 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-44705dff-8f47-4e44-a006-aa5736836e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:42.259187 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1439/2877] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:08:42 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:08:42.273351 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39145a-3993-43f5-8792-3d010c55c6f3 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:42.275944 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-2d39145a-3993-43f5-8792-3d010c55c6f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:42.362971 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39145a-3993-43f5-8792-3d010c55c6f3 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:42.367028 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f20905-88a4-40f1-b2d4-961d06c726c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:42.367732 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f20905-88a4-40f1-b2d4-961d06c726c9 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:42.368012 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f20905-88a4-40f1-b2d4-961d06c726c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:42.368286 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f20905-88a4-40f1-b2d4-961d06c726c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:42.378157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f20905-88a4-40f1-b2d4-961d06c726c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:42.379666 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f20905-88a4-40f1-b2d4-961d06c726c9 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:42.390315 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1439/2878] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:08:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:08:44.180233 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44705dff-8f47-4e44-a006-aa5736836e63 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:44.190193 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44705dff-8f47-4e44-a006-aa5736836e63 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:44.195196 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd10b33-c974-425f-a8ff-5722e78d303b tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc4600d28494d6e83e0e9a17f062f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6792de36211243418f86a17ccd6ef42f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:44.195867 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd10b33-c974-425f-a8ff-5722e78d303b tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:44.196154 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd10b33-c974-425f-a8ff-5722e78d303b tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:44.196438 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd10b33-c974-425f-a8ff-5722e78d303b tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:44.197115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd10b33-c974-425f-a8ff-5722e78d303b tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:08:44.197427 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd10b33-c974-425f-a8ff-5722e78d303b tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:44.199080 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd10b33-c974-425f-a8ff-5722e78d303b tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:44.212556 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1440/2879] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 14:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:08:44.217893 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f20905-88a4-40f1-b2d4-961d06c726c9 service cinder] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:44.233602 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f20905-88a4-40f1-b2d4-961d06c726c9 service cinder] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:44.241653 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6a5c5-8793-46a6-9ad5-4ada792bff38 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc4600d28494d6e83e0e9a17f062f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6792de36211243418f86a17ccd6ef42f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:44.243327 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6a5c5-8793-46a6-9ad5-4ada792bff38 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:44.243864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6a5c5-8793-46a6-9ad5-4ada792bff38 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:44.244334 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6a5c5-8793-46a6-9ad5-4ada792bff38 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:44.245491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6a5c5-8793-46a6-9ad5-4ada792bff38 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:44.249229 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6a5c5-8793-46a6-9ad5-4ada792bff38 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:44.460364 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1440/2880] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:08:44 2022] POST /identity/v3/projects => generated 353 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:08:44.465487 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd10b33-c974-425f-a8ff-5722e78d303b tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:44.476142 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd10b33-c974-425f-a8ff-5722e78d303b tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:44.518446 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:44.538089 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46897cdb-5841-4157-b6b7-46bcd10d9149 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc4600d28494d6e83e0e9a17f062f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6792de36211243418f86a17ccd6ef42f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:44.538818 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46897cdb-5841-4157-b6b7-46bcd10d9149 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:44.539668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46897cdb-5841-4157-b6b7-46bcd10d9149 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:44.539955 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46897cdb-5841-4157-b6b7-46bcd10d9149 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:44.540664 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46897cdb-5841-4157-b6b7-46bcd10d9149 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:08:44.540977 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46897cdb-5841-4157-b6b7-46bcd10d9149 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:44.542640 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46897cdb-5841-4157-b6b7-46bcd10d9149 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:44.555297 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1441/2881] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 14:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 14:08:44.596044 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6a5c5-8793-46a6-9ad5-4ada792bff38 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:44.609336 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6a5c5-8793-46a6-9ad5-4ada792bff38 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:44.616631 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4e4b4-54ad-415d-9086-6ecb8aabec66 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc4600d28494d6e83e0e9a17f062f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6792de36211243418f86a17ccd6ef42f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:44.617370 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4e4b4-54ad-415d-9086-6ecb8aabec66 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:44.617705 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4e4b4-54ad-415d-9086-6ecb8aabec66 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:44.618614 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4e4b4-54ad-415d-9086-6ecb8aabec66 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] PATH_INFO: `/v3/projects/17310191289c430db30f4c5015ccc996` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:44.620030 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4e4b4-54ad-415d-9086-6ecb8aabec66 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] RBAC: Authorizing `identity:delete_project(project_id=17310191289c430db30f4c5015ccc996)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:44.623448 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4e4b4-54ad-415d-9086-6ecb8aabec66 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:44.648587 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:45.069905 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-34e4e4b4-54ad-415d-9086-6ecb8aabec66 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17310191289c430db30f4c5015ccc996', 'request_id': 'req-34e4e4b4-54ad-415d-9086-6ecb8aabec66'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:45.076399 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-34e4e4b4-54ad-415d-9086-6ecb8aabec66 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17310191289c430db30f4c5015ccc996', 'request_id': 'req-34e4e4b4-54ad-415d-9086-6ecb8aabec66'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:45.263883 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-34e4e4b4-54ad-415d-9086-6ecb8aabec66 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17310191289c430db30f4c5015ccc996', 'request_id': 'req-34e4e4b4-54ad-415d-9086-6ecb8aabec66'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:45.279292 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-34e4e4b4-54ad-415d-9086-6ecb8aabec66 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] The token cache is being invalidate because project 17310191289c430db30f4c5015ccc996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:08:45.279636 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-34e4e4b4-54ad-415d-9086-6ecb8aabec66 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:45.280277 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-34e4e4b4-54ad-415d-9086-6ecb8aabec66 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:45.281803 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1441/2882] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:08:44 2022] DELETE /identity/v3/projects/17310191289c430db30f4c5015ccc996 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:46.625383 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46897cdb-5841-4157-b6b7-46bcd10d9149 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:46.627202 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-46897cdb-5841-4157-b6b7-46bcd10d9149 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:46.694015 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46897cdb-5841-4157-b6b7-46bcd10d9149 tempest-VolumeQuotaClassesTest-1699529020 tempest-VolumeQuotaClassesTest-1699529020-project-admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:46.751073 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1bf85-5ebc-4d6b-baa0-bc34ad2f9538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:46.751725 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1bf85-5ebc-4d6b-baa0-bc34ad2f9538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:46.752001 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1bf85-5ebc-4d6b-baa0-bc34ad2f9538 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:46.752269 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1bf85-5ebc-4d6b-baa0-bc34ad2f9538 admin admin] PATH_INFO: `/v3/users/0e3d779dabf14f7cb20bf29b4fd9c998` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:46.753386 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1bf85-5ebc-4d6b-baa0-bc34ad2f9538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e3d779dabf14f7cb20bf29b4fd9c998)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:46.755302 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1bf85-5ebc-4d6b-baa0-bc34ad2f9538 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:47.200362 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-d4b1bf85-5ebc-4d6b-baa0-bc34ad2f9538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e3d779dabf14f7cb20bf29b4fd9c998'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:47.201471 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-d4b1bf85-5ebc-4d6b-baa0-bc34ad2f9538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e3d779dabf14f7cb20bf29b4fd9c998'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:47.218449 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-d4b1bf85-5ebc-4d6b-baa0-bc34ad2f9538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e3d779dabf14f7cb20bf29b4fd9c998'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:47.225772 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-d4b1bf85-5ebc-4d6b-baa0-bc34ad2f9538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e3d779dabf14f7cb20bf29b4fd9c998'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:47.368214 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-d4b1bf85-5ebc-4d6b-baa0-bc34ad2f9538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e3d779dabf14f7cb20bf29b4fd9c998'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:47.371520 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:47.376080 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1442/2883] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:08:46 2022] DELETE /identity/v3/users/0e3d779dabf14f7cb20bf29b4fd9c998 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:47.380963 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929fd9d-c5bf-4f47-a24f-ed37e81f70b1 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:47.381536 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929fd9d-c5bf-4f47-a24f-ed37e81f70b1 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:47.381659 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929fd9d-c5bf-4f47-a24f-ed37e81f70b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:47.408983 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-1929fd9d-c5bf-4f47-a24f-ed37e81f70b1 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:47.410333 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-1929fd9d-c5bf-4f47-a24f-ed37e81f70b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:47.474628 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1442/2884] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:08:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:08:47.484443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1bf85-5ebc-4d6b-baa0-bc34ad2f9538 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:47.485959 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-d4b1bf85-5ebc-4d6b-baa0-bc34ad2f9538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:47.546755 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1bf85-5ebc-4d6b-baa0-bc34ad2f9538 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:47.550533 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f6bca-80df-4f60-8211-be6db5a81318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:47.551147 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f6bca-80df-4f60-8211-be6db5a81318 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:47.551461 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f6bca-80df-4f60-8211-be6db5a81318 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:47.551739 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f6bca-80df-4f60-8211-be6db5a81318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:47.562824 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f6bca-80df-4f60-8211-be6db5a81318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:47.564356 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f6bca-80df-4f60-8211-be6db5a81318 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:47.575906 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1443/2885] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:08:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:08:48.187415 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929fd9d-c5bf-4f47-a24f-ed37e81f70b1 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:48.189142 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-1929fd9d-c5bf-4f47-a24f-ed37e81f70b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:48.205668 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929fd9d-c5bf-4f47-a24f-ed37e81f70b1 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:48.212294 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c073b40-499c-438e-8a14-f0c88e0a031d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:48.213378 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c073b40-499c-438e-8a14-f0c88e0a031d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:48.213870 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c073b40-499c-438e-8a14-f0c88e0a031d admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:48.214349 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c073b40-499c-438e-8a14-f0c88e0a031d admin admin] PATH_INFO: `/v3/projects/2e7f8decf2f347ee8ed9e8b04dfc0633` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:48.216448 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c073b40-499c-438e-8a14-f0c88e0a031d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e7f8decf2f347ee8ed9e8b04dfc0633)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:48.220450 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c073b40-499c-438e-8a14-f0c88e0a031d admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:48.371045 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-3c073b40-499c-438e-8a14-f0c88e0a031d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e7f8decf2f347ee8ed9e8b04dfc0633', 'request_id': 'req-3c073b40-499c-438e-8a14-f0c88e0a031d'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:48.377475 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-3c073b40-499c-438e-8a14-f0c88e0a031d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e7f8decf2f347ee8ed9e8b04dfc0633', 'request_id': 'req-3c073b40-499c-438e-8a14-f0c88e0a031d'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:48.458357 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-3c073b40-499c-438e-8a14-f0c88e0a031d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e7f8decf2f347ee8ed9e8b04dfc0633', 'request_id': 'req-3c073b40-499c-438e-8a14-f0c88e0a031d'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:48.471401 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-3c073b40-499c-438e-8a14-f0c88e0a031d admin admin] The token cache is being invalidate because project 2e7f8decf2f347ee8ed9e8b04dfc0633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:08:48.471687 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-3c073b40-499c-438e-8a14-f0c88e0a031d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:48.472358 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-3c073b40-499c-438e-8a14-f0c88e0a031d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:48.473931 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1443/2886] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:08:48 2022] DELETE /identity/v3/projects/2e7f8decf2f347ee8ed9e8b04dfc0633 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:48.478348 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f6bca-80df-4f60-8211-be6db5a81318 service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:48.489753 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f6bca-80df-4f60-8211-be6db5a81318 service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:48.583579 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16676f-f3bd-41d5-92c7-438ac79c2b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:48.584227 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16676f-f3bd-41d5-92c7-438ac79c2b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:48.584509 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16676f-f3bd-41d5-92c7-438ac79c2b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:48.584784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16676f-f3bd-41d5-92c7-438ac79c2b85 admin admin] PATH_INFO: `/v3/users/3dc4600d28494d6e83e0e9a17f062f6e` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:48.586024 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16676f-f3bd-41d5-92c7-438ac79c2b85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dc4600d28494d6e83e0e9a17f062f6e)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:48.588574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16676f-f3bd-41d5-92c7-438ac79c2b85 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:48.971535 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-6d16676f-f3bd-41d5-92c7-438ac79c2b85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dc4600d28494d6e83e0e9a17f062f6e'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:48.972240 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-6d16676f-f3bd-41d5-92c7-438ac79c2b85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dc4600d28494d6e83e0e9a17f062f6e'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:48.992484 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-6d16676f-f3bd-41d5-92c7-438ac79c2b85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dc4600d28494d6e83e0e9a17f062f6e'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:49.005570 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-6d16676f-f3bd-41d5-92c7-438ac79c2b85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dc4600d28494d6e83e0e9a17f062f6e'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:49.150598 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-6d16676f-f3bd-41d5-92c7-438ac79c2b85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dc4600d28494d6e83e0e9a17f062f6e'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:49.157184 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1444/2887] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:08:48 2022] DELETE /identity/v3/users/3dc4600d28494d6e83e0e9a17f062f6e => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:49.723919 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c073b40-499c-438e-8a14-f0c88e0a031d admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:49.726001 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-3c073b40-499c-438e-8a14-f0c88e0a031d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:49.746023 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c073b40-499c-438e-8a14-f0c88e0a031d admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:49.797567 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:49.830278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdea7a4-072c-4a77-bfa5-686df75868b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:49.834386 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdea7a4-072c-4a77-bfa5-686df75868b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:49.834386 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdea7a4-072c-4a77-bfa5-686df75868b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:49.834386 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdea7a4-072c-4a77-bfa5-686df75868b4 admin admin] PATH_INFO: `/v3/projects/6792de36211243418f86a17ccd6ef42f` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:49.834386 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdea7a4-072c-4a77-bfa5-686df75868b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6792de36211243418f86a17ccd6ef42f)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:49.836148 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdea7a4-072c-4a77-bfa5-686df75868b4 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:50.021052 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-ffdea7a4-072c-4a77-bfa5-686df75868b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6792de36211243418f86a17ccd6ef42f', 'request_id': 'req-ffdea7a4-072c-4a77-bfa5-686df75868b4'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:50.030955 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-ffdea7a4-072c-4a77-bfa5-686df75868b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6792de36211243418f86a17ccd6ef42f', 'request_id': 'req-ffdea7a4-072c-4a77-bfa5-686df75868b4'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:50.229958 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-ffdea7a4-072c-4a77-bfa5-686df75868b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6792de36211243418f86a17ccd6ef42f', 'request_id': 'req-ffdea7a4-072c-4a77-bfa5-686df75868b4'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:50.244321 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-ffdea7a4-072c-4a77-bfa5-686df75868b4 admin admin] The token cache is being invalidate because project 6792de36211243418f86a17ccd6ef42f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:08:50.244835 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-ffdea7a4-072c-4a77-bfa5-686df75868b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:50.245776 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-ffdea7a4-072c-4a77-bfa5-686df75868b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:50.247624 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1444/2888] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:08:49 2022] DELETE /identity/v3/projects/6792de36211243418f86a17ccd6ef42f => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:50.253221 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ba7cb-0288-48d9-8a70-eaa941ca1865 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:50.253862 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ba7cb-0288-48d9-8a70-eaa941ca1865 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:50.253862 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ba7cb-0288-48d9-8a70-eaa941ca1865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:50.278792 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-426ba7cb-0288-48d9-8a70-eaa941ca1865 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:50.278792 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-426ba7cb-0288-48d9-8a70-eaa941ca1865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:50.299531 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:50.355327 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1445/2889] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:08:50.364348 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fbc48-4e0b-45b1-99c6-168e3da1021a None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:50.364787 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fbc48-4e0b-45b1-99c6-168e3da1021a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:50.365096 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fbc48-4e0b-45b1-99c6-168e3da1021a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:50.387708 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-3a9fbc48-4e0b-45b1-99c6-168e3da1021a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:50.388953 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-3a9fbc48-4e0b-45b1-99c6-168e3da1021a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:50.402362 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1445/2890] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:08:50.406420 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ba7cb-0288-48d9-8a70-eaa941ca1865 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:50.421723 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ba7cb-0288-48d9-8a70-eaa941ca1865 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:50.427130 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4ca03-7fb2-459f-9420-17899be5d20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:50.427790 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4ca03-7fb2-459f-9420-17899be5d20e admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:50.428074 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4ca03-7fb2-459f-9420-17899be5d20e admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:50.428428 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4ca03-7fb2-459f-9420-17899be5d20e admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:50.429101 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf4ca03-7fb2-459f-9420-17899be5d20e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:08:50.429911 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf4ca03-7fb2-459f-9420-17899be5d20e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:50.431612 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf4ca03-7fb2-459f-9420-17899be5d20e admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:50.446856 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1446/2891] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 14:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:08:50.451423 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fbc48-4e0b-45b1-99c6-168e3da1021a None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:50.461985 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fbc48-4e0b-45b1-99c6-168e3da1021a None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:50.466838 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5bae6-2a77-49ce-af2c-cb0fe3a7dbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:50.467507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5bae6-2a77-49ce-af2c-cb0fe3a7dbd6 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:50.467858 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5bae6-2a77-49ce-af2c-cb0fe3a7dbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:50.468163 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5bae6-2a77-49ce-af2c-cb0fe3a7dbd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:50.468829 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5bae6-2a77-49ce-af2c-cb0fe3a7dbd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:50.470744 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5bae6-2a77-49ce-af2c-cb0fe3a7dbd6 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:50.643871 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1446/2892] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:08:50 2022] POST /identity/v3/projects => generated 385 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:08:50.648524 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4ca03-7fb2-459f-9420-17899be5d20e admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:50.659398 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4ca03-7fb2-459f-9420-17899be5d20e admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:50.727299 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea984a48-6a38-4323-8e21-8cf33ca41420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:50.728055 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea984a48-6a38-4323-8e21-8cf33ca41420 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:50.728455 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea984a48-6a38-4323-8e21-8cf33ca41420 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:50.728863 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea984a48-6a38-4323-8e21-8cf33ca41420 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:50.729687 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea984a48-6a38-4323-8e21-8cf33ca41420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:50.732032 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea984a48-6a38-4323-8e21-8cf33ca41420 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:50.864193 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1447/2893] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:08:50 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:08:50.869584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5bae6-2a77-49ce-af2c-cb0fe3a7dbd6 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:50.889129 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5bae6-2a77-49ce-af2c-cb0fe3a7dbd6 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:50.897512 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fd9fb-e3c0-4470-92b0-e748e4cf714f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:50.899092 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fd9fb-e3c0-4470-92b0-e748e4cf714f admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:50.899637 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fd9fb-e3c0-4470-92b0-e748e4cf714f admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:50.900143 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fd9fb-e3c0-4470-92b0-e748e4cf714f admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:50.901409 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fd9fb-e3c0-4470-92b0-e748e4cf714f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:50.904605 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fd9fb-e3c0-4470-92b0-e748e4cf714f admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:50.924596 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1447/2894] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:08:50.929118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea984a48-6a38-4323-8e21-8cf33ca41420 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:50.940535 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea984a48-6a38-4323-8e21-8cf33ca41420 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:50.946227 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88347d78-33bc-4de1-b0ee-267a8fccd547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:50.946895 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88347d78-33bc-4de1-b0ee-267a8fccd547 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:50.947176 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88347d78-33bc-4de1-b0ee-267a8fccd547 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:50.947487 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88347d78-33bc-4de1-b0ee-267a8fccd547 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:50.948230 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88347d78-33bc-4de1-b0ee-267a8fccd547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:50.949858 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88347d78-33bc-4de1-b0ee-267a8fccd547 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:50.962321 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1448/2895] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:08:50.967072 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fd9fb-e3c0-4470-92b0-e748e4cf714f admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:50.978329 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fd9fb-e3c0-4470-92b0-e748e4cf714f admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:50.983473 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05700cc-bc0a-49e3-ac8b-d1b1a9d88413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:50.984290 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05700cc-bc0a-49e3-ac8b-d1b1a9d88413 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:50.984620 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05700cc-bc0a-49e3-ac8b-d1b1a9d88413 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:50.985018 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05700cc-bc0a-49e3-ac8b-d1b1a9d88413 admin admin] PATH_INFO: `/v3/projects/60f637b1a5df45c58ec7b4fae18a5262/users/c89162f381274e16a767f1f4f43d348a/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:51.002744 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05700cc-bc0a-49e3-ac8b-d1b1a9d88413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f637b1a5df45c58ec7b4fae18a5262, user_id=c89162f381274e16a767f1f4f43d348a, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:51.005730 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05700cc-bc0a-49e3-ac8b-d1b1a9d88413 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:51.088298 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1448/2896] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:08:50 2022] PUT /identity/v3/projects/60f637b1a5df45c58ec7b4fae18a5262/users/c89162f381274e16a767f1f4f43d348a/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:51.099922 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b6463-1931-4408-94f9-9ec6961ff1b8 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:51.100366 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b6463-1931-4408-94f9-9ec6961ff1b8 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:51.100982 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b6463-1931-4408-94f9-9ec6961ff1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:51.134414 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-9e2b6463-1931-4408-94f9-9ec6961ff1b8 None None] MFA Rules not processed for user `c89162f381274e16a767f1f4f43d348a`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:51.135754 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-9e2b6463-1931-4408-94f9-9ec6961ff1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:51.234422 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1449/2897] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:08:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:08:51.250131 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05700cc-bc0a-49e3-ac8b-d1b1a9d88413 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:51.252493 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b05700cc-bc0a-49e3-ac8b-d1b1a9d88413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:51.326455 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05700cc-bc0a-49e3-ac8b-d1b1a9d88413 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:51.330482 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73224d96-3d85-488a-830c-a8af97fb6f68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:51.331118 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73224d96-3d85-488a-830c-a8af97fb6f68 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:51.331470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73224d96-3d85-488a-830c-a8af97fb6f68 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:51.331748 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73224d96-3d85-488a-830c-a8af97fb6f68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:51.341718 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73224d96-3d85-488a-830c-a8af97fb6f68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:51.343393 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73224d96-3d85-488a-830c-a8af97fb6f68 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:51.354694 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1449/2898] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:08:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:08:51.375706 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b6463-1931-4408-94f9-9ec6961ff1b8 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:51.397451 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:51.449954 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b6463-1931-4408-94f9-9ec6961ff1b8 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:51.455532 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ea34a-2cac-4c16-b2e5-c18374b4810e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:51.456463 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ea34a-2cac-4c16-b2e5-c18374b4810e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:51.456838 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ea34a-2cac-4c16-b2e5-c18374b4810e admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:51.457232 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ea34a-2cac-4c16-b2e5-c18374b4810e admin admin] PATH_INFO: `/v3/users/c89162f381274e16a767f1f4f43d348a` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:51.458633 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ea34a-2cac-4c16-b2e5-c18374b4810e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c89162f381274e16a767f1f4f43d348a)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:51.460767 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ea34a-2cac-4c16-b2e5-c18374b4810e admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:51.919981 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-4c1ea34a-2cac-4c16-b2e5-c18374b4810e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c89162f381274e16a767f1f4f43d348a'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:51.920635 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-4c1ea34a-2cac-4c16-b2e5-c18374b4810e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c89162f381274e16a767f1f4f43d348a'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:51.932948 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-4c1ea34a-2cac-4c16-b2e5-c18374b4810e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c89162f381274e16a767f1f4f43d348a'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:51.939954 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-4c1ea34a-2cac-4c16-b2e5-c18374b4810e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c89162f381274e16a767f1f4f43d348a'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:52.103813 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-4c1ea34a-2cac-4c16-b2e5-c18374b4810e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c89162f381274e16a767f1f4f43d348a'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:52.110472 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1450/2899] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:08:51 2022] DELETE /identity/v3/users/c89162f381274e16a767f1f4f43d348a => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:52.115644 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9184b-cdcb-4d2f-a443-e6292eca6302 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:52.116210 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9184b-cdcb-4d2f-a443-e6292eca6302 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:52.116210 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9184b-cdcb-4d2f-a443-e6292eca6302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:52.123842 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:52.136835 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-27f9184b-cdcb-4d2f-a443-e6292eca6302 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:52.138119 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-27f9184b-cdcb-4d2f-a443-e6292eca6302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:52.206262 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1450/2900] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:08:52.216739 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ea34a-2cac-4c16-b2e5-c18374b4810e admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:52.220034 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-4c1ea34a-2cac-4c16-b2e5-c18374b4810e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:52.281987 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ea34a-2cac-4c16-b2e5-c18374b4810e admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:52.285784 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4cc485-0e07-482b-aad4-6b0ce0035d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:52.286440 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cc485-0e07-482b-aad4-6b0ce0035d51 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:52.286719 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cc485-0e07-482b-aad4-6b0ce0035d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:52.286991 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cc485-0e07-482b-aad4-6b0ce0035d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:52.297172 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4cc485-0e07-482b-aad4-6b0ce0035d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:52.298643 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4cc485-0e07-482b-aad4-6b0ce0035d51 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:52.309460 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1451/2901] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:08:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:08:52.871718 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9184b-cdcb-4d2f-a443-e6292eca6302 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:52.873152 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-27f9184b-cdcb-4d2f-a443-e6292eca6302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:52.888890 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9184b-cdcb-4d2f-a443-e6292eca6302 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:52.895034 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad662c2-d6f6-4bc0-92d4-4b6f8047f404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:52.896076 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad662c2-d6f6-4bc0-92d4-4b6f8047f404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:52.896907 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad662c2-d6f6-4bc0-92d4-4b6f8047f404 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:52.897392 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad662c2-d6f6-4bc0-92d4-4b6f8047f404 admin admin] PATH_INFO: `/v3/projects/60f637b1a5df45c58ec7b4fae18a5262` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:52.899423 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad662c2-d6f6-4bc0-92d4-4b6f8047f404 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60f637b1a5df45c58ec7b4fae18a5262)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:52.903510 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad662c2-d6f6-4bc0-92d4-4b6f8047f404 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:53.093879 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-7ad662c2-d6f6-4bc0-92d4-4b6f8047f404 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60f637b1a5df45c58ec7b4fae18a5262', 'request_id': 'req-7ad662c2-d6f6-4bc0-92d4-4b6f8047f404'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:53.099289 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-7ad662c2-d6f6-4bc0-92d4-4b6f8047f404 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60f637b1a5df45c58ec7b4fae18a5262', 'request_id': 'req-7ad662c2-d6f6-4bc0-92d4-4b6f8047f404'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:53.269766 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-7ad662c2-d6f6-4bc0-92d4-4b6f8047f404 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60f637b1a5df45c58ec7b4fae18a5262', 'request_id': 'req-7ad662c2-d6f6-4bc0-92d4-4b6f8047f404'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:53.286909 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-7ad662c2-d6f6-4bc0-92d4-4b6f8047f404 admin admin] The token cache is being invalidate because project 60f637b1a5df45c58ec7b4fae18a5262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:08:53.297196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-7ad662c2-d6f6-4bc0-92d4-4b6f8047f404 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:53.297196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-7ad662c2-d6f6-4bc0-92d4-4b6f8047f404 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:53.297196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1451/2902] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:08:52 2022] DELETE /identity/v3/projects/60f637b1a5df45c58ec7b4fae18a5262 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:53.297703 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf5877-caa2-42cf-8dc6-6fb25b277866 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:53.297703 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf5877-caa2-42cf-8dc6-6fb25b277866 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:53.297703 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf5877-caa2-42cf-8dc6-6fb25b277866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:53.330889 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-34cf5877-caa2-42cf-8dc6-6fb25b277866 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:53.332175 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-34cf5877-caa2-42cf-8dc6-6fb25b277866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:53.370709 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:53.406497 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1452/2903] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:08:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:08:53.419007 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814739bb-3401-496c-9fbb-10b901eb0e5a None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:53.419273 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814739bb-3401-496c-9fbb-10b901eb0e5a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:53.419581 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814739bb-3401-496c-9fbb-10b901eb0e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:53.441740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-814739bb-3401-496c-9fbb-10b901eb0e5a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:53.442985 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-814739bb-3401-496c-9fbb-10b901eb0e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:53.451775 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1452/2904] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:08:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:08:53.456525 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf5877-caa2-42cf-8dc6-6fb25b277866 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:53.467101 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf5877-caa2-42cf-8dc6-6fb25b277866 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:53.471896 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141d5dc-630a-48e0-8e37-0630784231df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:53.472509 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141d5dc-630a-48e0-8e37-0630784231df admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:53.472785 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141d5dc-630a-48e0-8e37-0630784231df admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:53.473079 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141d5dc-630a-48e0-8e37-0630784231df admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:53.473731 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141d5dc-630a-48e0-8e37-0630784231df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:08:53.474029 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141d5dc-630a-48e0-8e37-0630784231df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:53.475668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141d5dc-630a-48e0-8e37-0630784231df admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:53.488660 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1453/2905] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 14:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:08:53.494060 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814739bb-3401-496c-9fbb-10b901eb0e5a None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:53.505065 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814739bb-3401-496c-9fbb-10b901eb0e5a None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:53.510960 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef13f6-85ba-4587-9449-22d5eacc32d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:53.511609 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef13f6-85ba-4587-9449-22d5eacc32d8 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:53.511886 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef13f6-85ba-4587-9449-22d5eacc32d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:53.512155 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef13f6-85ba-4587-9449-22d5eacc32d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:53.512806 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef13f6-85ba-4587-9449-22d5eacc32d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:53.514716 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef13f6-85ba-4587-9449-22d5eacc32d8 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:53.648470 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1453/2906] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:08:53 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:08:53.652680 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141d5dc-630a-48e0-8e37-0630784231df admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:53.662914 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141d5dc-630a-48e0-8e37-0630784231df admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:53.722278 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f4a59-fbfe-4136-b0c8-5955287bf4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:53.722896 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f4a59-fbfe-4136-b0c8-5955287bf4ca admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:53.723180 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f4a59-fbfe-4136-b0c8-5955287bf4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:53.723497 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f4a59-fbfe-4136-b0c8-5955287bf4ca admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:53.724145 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f4a59-fbfe-4136-b0c8-5955287bf4ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:53.726581 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f4a59-fbfe-4136-b0c8-5955287bf4ca admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:53.910493 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1454/2907] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:08:53 2022] POST /identity/v3/users => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:08:53.915507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef13f6-85ba-4587-9449-22d5eacc32d8 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:53.928184 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef13f6-85ba-4587-9449-22d5eacc32d8 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:53.936608 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1716c1d-3695-49ce-9856-d11e7bae3ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:53.937660 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1716c1d-3695-49ce-9856-d11e7bae3ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:53.938157 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1716c1d-3695-49ce-9856-d11e7bae3ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:53.938657 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1716c1d-3695-49ce-9856-d11e7bae3ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:53.939878 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1716c1d-3695-49ce-9856-d11e7bae3ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:53.942892 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1716c1d-3695-49ce-9856-d11e7bae3ea5 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:53.963309 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1454/2908] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:08:53.967339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f4a59-fbfe-4136-b0c8-5955287bf4ca admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:53.978158 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f4a59-fbfe-4136-b0c8-5955287bf4ca admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:53.983594 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03ebad-868f-4c01-b6ca-f6eae2dcd4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:53.984713 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03ebad-868f-4c01-b6ca-f6eae2dcd4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:53.984713 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03ebad-868f-4c01-b6ca-f6eae2dcd4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:53.984713 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03ebad-868f-4c01-b6ca-f6eae2dcd4a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:53.985378 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03ebad-868f-4c01-b6ca-f6eae2dcd4a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:53.986989 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03ebad-868f-4c01-b6ca-f6eae2dcd4a7 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:53.998939 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1455/2909] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:08:54.003352 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1716c1d-3695-49ce-9856-d11e7bae3ea5 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:54.017596 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1716c1d-3695-49ce-9856-d11e7bae3ea5 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:54.025032 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0380c-9b25-4304-9485-d97ca160d8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:54.025716 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0380c-9b25-4304-9485-d97ca160d8ac admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:54.025996 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0380c-9b25-4304-9485-d97ca160d8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:54.026271 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0380c-9b25-4304-9485-d97ca160d8ac admin admin] PATH_INFO: `/v3/projects/3185457bb1844512aed00c0c877396ed/users/6f0c3cbb363742128300b6b3ad19f5a0/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:54.043535 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0380c-9b25-4304-9485-d97ca160d8ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=3185457bb1844512aed00c0c877396ed, user_id=6f0c3cbb363742128300b6b3ad19f5a0, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:54.046309 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0380c-9b25-4304-9485-d97ca160d8ac admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:54.298949 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1455/2910] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:08:54 2022] PUT /identity/v3/projects/3185457bb1844512aed00c0c877396ed/users/6f0c3cbb363742128300b6b3ad19f5a0/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:54.309284 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524eff8-da58-463b-82c1-2aa3a2248517 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:54.309817 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524eff8-da58-463b-82c1-2aa3a2248517 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:54.309817 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524eff8-da58-463b-82c1-2aa3a2248517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:54.340630 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-9524eff8-da58-463b-82c1-2aa3a2248517 None None] MFA Rules not processed for user `6f0c3cbb363742128300b6b3ad19f5a0`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:54.341865 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-9524eff8-da58-463b-82c1-2aa3a2248517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:54.407676 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1456/2911] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:08:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:08:54.419871 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0380c-9b25-4304-9485-d97ca160d8ac admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:54.421610 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-3bc0380c-9b25-4304-9485-d97ca160d8ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:54.449299 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:54.514015 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0380c-9b25-4304-9485-d97ca160d8ac admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:54.517708 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fad16-f0ec-46b5-a861-0a4d90429e86 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc11fe25135d4bf1b1a06b8619e4a2e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:54.518345 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fad16-f0ec-46b5-a861-0a4d90429e86 service glance] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:54.518624 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fad16-f0ec-46b5-a861-0a4d90429e86 service glance] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:54.518893 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fad16-f0ec-46b5-a861-0a4d90429e86 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:54.528597 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fad16-f0ec-46b5-a861-0a4d90429e86 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:54.530037 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fad16-f0ec-46b5-a861-0a4d90429e86 service glance] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:54.539178 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1456/2912] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:08:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:09:04.404632 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:04.681010 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=25 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:09.951105 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06f454-807e-4f57-9140-bc411082ffee None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:09.951684 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06f454-807e-4f57-9140-bc411082ffee None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:09.951684 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06f454-807e-4f57-9140-bc411082ffee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:09.971602 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-af06f454-807e-4f57-9140-bc411082ffee None None] MFA Rules not processed for user `384fe3ef86de41fc939e1a3cbbc6fe13`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:09:09.972801 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-af06f454-807e-4f57-9140-bc411082ffee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:10.030475 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1457/2913] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:09:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:09:13.741489 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fad16-f0ec-46b5-a861-0a4d90429e86 service glance] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:13.742761 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-0c6fad16-f0ec-46b5-a861-0a4d90429e86 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:13.803636 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fad16-f0ec-46b5-a861-0a4d90429e86 service glance] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:13.807144 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ea0da-563a-4736-9252-71ea467b89f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:13.807789 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ea0da-563a-4736-9252-71ea467b89f2 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:13.808067 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ea0da-563a-4736-9252-71ea467b89f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:13.808338 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ea0da-563a-4736-9252-71ea467b89f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:13.810073 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ea2ea0da-563a-4736-9252-71ea467b89f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:13.901767 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ea0da-563a-4736-9252-71ea467b89f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:13.913167 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ea0da-563a-4736-9252-71ea467b89f2 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:13.915317 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1457/2914] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:09:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:09:14.956562 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06f454-807e-4f57-9140-bc411082ffee None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:15.044401 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ea0da-563a-4736-9252-71ea467b89f2 service neutron] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:15.059077 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ea2ea0da-563a-4736-9252-71ea467b89f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:15.059077 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ea0da-563a-4736-9252-71ea467b89f2 service neutron] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:15.069914 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed80e5f-928f-417b-8b89-4a5e4761e4d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:15.070847 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed80e5f-928f-417b-8b89-4a5e4761e4d9 service neutron] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:15.071999 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed80e5f-928f-417b-8b89-4a5e4761e4d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:15.072452 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed80e5f-928f-417b-8b89-4a5e4761e4d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:15.076287 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-8ed80e5f-928f-417b-8b89-4a5e4761e4d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:15.108660 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed80e5f-928f-417b-8b89-4a5e4761e4d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:15.111491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed80e5f-928f-417b-8b89-4a5e4761e4d9 service neutron] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:15.116308 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06f454-807e-4f57-9140-bc411082ffee None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:15.121191 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5aa323-1321-45e7-bec6-2046ba067a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:15.121964 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5aa323-1321-45e7-bec6-2046ba067a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:15.122316 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5aa323-1321-45e7-bec6-2046ba067a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:15.122718 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5aa323-1321-45e7-bec6-2046ba067a91 admin admin] PATH_INFO: `/v3/users/6f0c3cbb363742128300b6b3ad19f5a0` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:15.124024 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5aa323-1321-45e7-bec6-2046ba067a91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f0c3cbb363742128300b6b3ad19f5a0)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:15.128012 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5aa323-1321-45e7-bec6-2046ba067a91 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:15.131929 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1458/2915] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:09:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:09:15.515099 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-3c5aa323-1321-45e7-bec6-2046ba067a91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f0c3cbb363742128300b6b3ad19f5a0'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:15.515817 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-3c5aa323-1321-45e7-bec6-2046ba067a91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f0c3cbb363742128300b6b3ad19f5a0'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:15.529558 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-3c5aa323-1321-45e7-bec6-2046ba067a91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f0c3cbb363742128300b6b3ad19f5a0'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:15.538574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-3c5aa323-1321-45e7-bec6-2046ba067a91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f0c3cbb363742128300b6b3ad19f5a0'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:15.697702 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-3c5aa323-1321-45e7-bec6-2046ba067a91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f0c3cbb363742128300b6b3ad19f5a0'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:15.704684 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1458/2916] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:09:14 2022] DELETE /identity/v3/users/6f0c3cbb363742128300b6b3ad19f5a0 => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:09:15.709249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442a9e7-2f8f-4641-885f-e36fd7b007c1 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:15.710134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442a9e7-2f8f-4641-885f-e36fd7b007c1 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:15.710406 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442a9e7-2f8f-4641-885f-e36fd7b007c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:15.730491 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-5442a9e7-2f8f-4641-885f-e36fd7b007c1 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:09:15.731735 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-5442a9e7-2f8f-4641-885f-e36fd7b007c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:15.800142 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1459/2917] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:09:15.810612 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5aa323-1321-45e7-bec6-2046ba067a91 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:15.812602 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-3c5aa323-1321-45e7-bec6-2046ba067a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:15.856096 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:15.894337 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5aa323-1321-45e7-bec6-2046ba067a91 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:15.898998 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dc527-3c39-4969-ab0d-a7c7b2605137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:15.899768 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dc527-3c39-4969-ab0d-a7c7b2605137 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:15.900234 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dc527-3c39-4969-ab0d-a7c7b2605137 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:15.901252 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dc527-3c39-4969-ab0d-a7c7b2605137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:15.910888 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61dc527-3c39-4969-ab0d-a7c7b2605137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:15.912401 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61dc527-3c39-4969-ab0d-a7c7b2605137 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:15.923909 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1459/2918] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:09:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:09:16.604011 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442a9e7-2f8f-4641-885f-e36fd7b007c1 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:16.606881 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-5442a9e7-2f8f-4641-885f-e36fd7b007c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:16.624263 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442a9e7-2f8f-4641-885f-e36fd7b007c1 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:16.632740 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88933d5-b466-4da7-8dd1-6a2e4266785b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:16.633483 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88933d5-b466-4da7-8dd1-6a2e4266785b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:16.633763 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88933d5-b466-4da7-8dd1-6a2e4266785b admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:16.634040 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88933d5-b466-4da7-8dd1-6a2e4266785b admin admin] PATH_INFO: `/v3/projects/3185457bb1844512aed00c0c877396ed` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:16.636029 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88933d5-b466-4da7-8dd1-6a2e4266785b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3185457bb1844512aed00c0c877396ed)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:16.638196 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88933d5-b466-4da7-8dd1-6a2e4266785b admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:16.665815 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:16.837716 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b88933d5-b466-4da7-8dd1-6a2e4266785b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3185457bb1844512aed00c0c877396ed', 'request_id': 'req-b88933d5-b466-4da7-8dd1-6a2e4266785b'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:16.852114 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b88933d5-b466-4da7-8dd1-6a2e4266785b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3185457bb1844512aed00c0c877396ed', 'request_id': 'req-b88933d5-b466-4da7-8dd1-6a2e4266785b'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:16.971530 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b88933d5-b466-4da7-8dd1-6a2e4266785b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3185457bb1844512aed00c0c877396ed', 'request_id': 'req-b88933d5-b466-4da7-8dd1-6a2e4266785b'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:16.983541 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b88933d5-b466-4da7-8dd1-6a2e4266785b admin admin] The token cache is being invalidate because project 3185457bb1844512aed00c0c877396ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:09:16.983839 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b88933d5-b466-4da7-8dd1-6a2e4266785b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:16.984712 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-b88933d5-b466-4da7-8dd1-6a2e4266785b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:16.986219 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1460/2919] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:09:16 2022] DELETE /identity/v3/projects/3185457bb1844512aed00c0c877396ed => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:09:16.991916 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e01c9-b9f6-4b76-b0cf-583df83fa81b None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:16.992430 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e01c9-b9f6-4b76-b0cf-583df83fa81b None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:16.992591 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e01c9-b9f6-4b76-b0cf-583df83fa81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:17.012156 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-4a0e01c9-b9f6-4b76-b0cf-583df83fa81b None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:09:17.013373 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-4a0e01c9-b9f6-4b76-b0cf-583df83fa81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:17.094298 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1460/2920] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:09:17.102685 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92324a-d5ce-4191-9891-225da0567f61 None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:17.102965 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92324a-d5ce-4191-9891-225da0567f61 None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:17.103236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92324a-d5ce-4191-9891-225da0567f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:17.126028 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-ad92324a-d5ce-4191-9891-225da0567f61 None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:09:17.127236 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ad92324a-d5ce-4191-9891-225da0567f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:17.136072 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1461/2921] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:09:17.140625 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e01c9-b9f6-4b76-b0cf-583df83fa81b None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:17.150606 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e01c9-b9f6-4b76-b0cf-583df83fa81b None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:17.155208 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0acb2-f6f0-4008-b2d3-17388e70cf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:17.155838 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0acb2-f6f0-4008-b2d3-17388e70cf30 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:17.156116 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0acb2-f6f0-4008-b2d3-17388e70cf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:17.156382 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0acb2-f6f0-4008-b2d3-17388e70cf30 admin admin] PATH_INFO: `/v3/domains` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:17.157016 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0acb2-f6f0-4008-b2d3-17388e70cf30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88417) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:09:17.157314 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0acb2-f6f0-4008-b2d3-17388e70cf30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:17.158899 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0acb2-f6f0-4008-b2d3-17388e70cf30 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:17.170988 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1461/2922] 10.222.0.50 () {58 vars in 1153 bytes} [Thu Sep 1 14:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:09:17.175569 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92324a-d5ce-4191-9891-225da0567f61 None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:17.185805 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92324a-d5ce-4191-9891-225da0567f61 None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:17.190720 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ab10d-50e7-413e-9bb1-49105483f480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:17.191391 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ab10d-50e7-413e-9bb1-49105483f480 admin admin] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:17.191672 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ab10d-50e7-413e-9bb1-49105483f480 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:17.191946 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ab10d-50e7-413e-9bb1-49105483f480 admin admin] PATH_INFO: `/v3/projects` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:17.192600 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ab10d-50e7-413e-9bb1-49105483f480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:17.194589 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ab10d-50e7-413e-9bb1-49105483f480 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:17.338951 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1462/2923] 10.222.0.50 () {60 vars in 1153 bytes} [Thu Sep 1 14:09:17 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:09:17.343341 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0acb2-f6f0-4008-b2d3-17388e70cf30 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:17.353731 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0acb2-f6f0-4008-b2d3-17388e70cf30 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:17.412663 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36802d5-e072-4e03-ab19-2ef813d53395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:17.413286 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36802d5-e072-4e03-ab19-2ef813d53395 admin admin] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:17.413562 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36802d5-e072-4e03-ab19-2ef813d53395 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:17.413831 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36802d5-e072-4e03-ab19-2ef813d53395 admin admin] PATH_INFO: `/v3/users` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:17.414460 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36802d5-e072-4e03-ab19-2ef813d53395 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:17.416443 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36802d5-e072-4e03-ab19-2ef813d53395 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:17.567595 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1462/2924] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Sep 1 14:09:17 2022] POST /identity/v3/users => generated 292 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:09:17.572215 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ab10d-50e7-413e-9bb1-49105483f480 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:17.584734 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ab10d-50e7-413e-9bb1-49105483f480 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:17.592096 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb04bf1-2dc0-4326-aeac-5cccc23294be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:17.592866 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb04bf1-2dc0-4326-aeac-5cccc23294be admin admin] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:17.593250 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb04bf1-2dc0-4326-aeac-5cccc23294be admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:17.593782 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb04bf1-2dc0-4326-aeac-5cccc23294be admin admin] PATH_INFO: `/v3/roles` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:17.594516 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb04bf1-2dc0-4326-aeac-5cccc23294be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:17.596663 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb04bf1-2dc0-4326-aeac-5cccc23294be admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:17.612120 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1463/2925] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:09:17.616820 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36802d5-e072-4e03-ab19-2ef813d53395 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:17.627615 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36802d5-e072-4e03-ab19-2ef813d53395 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:17.632704 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cefc5-710f-489b-a0d4-16903c9dcda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:17.639417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cefc5-710f-489b-a0d4-16903c9dcda7 admin admin] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:17.639417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cefc5-710f-489b-a0d4-16903c9dcda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:17.639417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cefc5-710f-489b-a0d4-16903c9dcda7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:17.639417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082cefc5-710f-489b-a0d4-16903c9dcda7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:17.639417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082cefc5-710f-489b-a0d4-16903c9dcda7 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:17.649957 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1463/2926] 10.222.0.50 () {58 vars in 1122 bytes} [Thu Sep 1 14:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:09:17.654280 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb04bf1-2dc0-4326-aeac-5cccc23294be admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:17.665546 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb04bf1-2dc0-4326-aeac-5cccc23294be admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:17.670540 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4765c9-2755-41f0-8fe9-fc49400ff149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:17.671201 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4765c9-2755-41f0-8fe9-fc49400ff149 admin admin] REQUEST_METHOD: `PUT` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:17.671655 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4765c9-2755-41f0-8fe9-fc49400ff149 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:17.671785 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4765c9-2755-41f0-8fe9-fc49400ff149 admin admin] PATH_INFO: `/v3/projects/a98d4153eea34f9693a4148308c8d95f/users/80801ee64ac84306996952517420545f/roles/3654765b6c2644779fda2924f119aef7` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:17.687696 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4765c9-2755-41f0-8fe9-fc49400ff149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a98d4153eea34f9693a4148308c8d95f, user_id=80801ee64ac84306996952517420545f, role_id=3654765b6c2644779fda2924f119aef7)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:17.690383 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4765c9-2755-41f0-8fe9-fc49400ff149 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:17.783856 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1464/2927] 10.222.0.50 () {60 vars in 1483 bytes} [Thu Sep 1 14:09:17 2022] PUT /identity/v3/projects/a98d4153eea34f9693a4148308c8d95f/users/80801ee64ac84306996952517420545f/roles/3654765b6c2644779fda2924f119aef7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:09:17.796630 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459bba6-d455-410a-8e57-d5a67c8f997a None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:17.797047 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459bba6-d455-410a-8e57-d5a67c8f997a None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:17.797238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459bba6-d455-410a-8e57-d5a67c8f997a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:17.827071 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-5459bba6-d455-410a-8e57-d5a67c8f997a None None] MFA Rules not processed for user `80801ee64ac84306996952517420545f`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:09:17.828433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-5459bba6-d455-410a-8e57-d5a67c8f997a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:17.855332 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:17.913074 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1464/2928] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:09:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:09:17.924429 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4765c9-2755-41f0-8fe9-fc49400ff149 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:17.926201 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ed4765c9-2755-41f0-8fe9-fc49400ff149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:17.987964 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4765c9-2755-41f0-8fe9-fc49400ff149 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:17.992742 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0bf48-5854-445f-92b7-c0a10ca56613 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:17.993348 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0bf48-5854-445f-92b7-c0a10ca56613 service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:17.993627 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0bf48-5854-445f-92b7-c0a10ca56613 service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:17.993899 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0bf48-5854-445f-92b7-c0a10ca56613 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:18.002561 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0bf48-5854-445f-92b7-c0a10ca56613 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:18.004041 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0bf48-5854-445f-92b7-c0a10ca56613 service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:18.013961 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1465/2929] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:09:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:09:27.982557 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=17 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:28.009619 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=68,keystone:DELETE=6,keystone:INSERT=3 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:28.654065 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459bba6-d455-410a-8e57-d5a67c8f997a None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:28.727115 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459bba6-d455-410a-8e57-d5a67c8f997a None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:28.731831 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a16309-9054-480b-a1cd-f94b137ce233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:28.732470 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a16309-9054-480b-a1cd-f94b137ce233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:28.732748 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a16309-9054-480b-a1cd-f94b137ce233 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:28.733017 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a16309-9054-480b-a1cd-f94b137ce233 admin admin] PATH_INFO: `/v3/users/80801ee64ac84306996952517420545f` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:28.734146 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a16309-9054-480b-a1cd-f94b137ce233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80801ee64ac84306996952517420545f)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:28.736165 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a16309-9054-480b-a1cd-f94b137ce233 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:28.989955 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-10a16309-9054-480b-a1cd-f94b137ce233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80801ee64ac84306996952517420545f'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:28.991014 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-10a16309-9054-480b-a1cd-f94b137ce233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80801ee64ac84306996952517420545f'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:29.006372 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-10a16309-9054-480b-a1cd-f94b137ce233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80801ee64ac84306996952517420545f'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:29.013810 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-10a16309-9054-480b-a1cd-f94b137ce233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80801ee64ac84306996952517420545f'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:29.165521 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-10a16309-9054-480b-a1cd-f94b137ce233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80801ee64ac84306996952517420545f'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:29.172238 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1465/2930] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:09:28 2022] DELETE /identity/v3/users/80801ee64ac84306996952517420545f => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:09:29.187158 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bc6f5-5ef8-4386-a1bc-e2bb4835165a None None] REQUEST_METHOD: `POST` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:29.187158 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bc6f5-5ef8-4386-a1bc-e2bb4835165a None None] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:29.187158 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bc6f5-5ef8-4386-a1bc-e2bb4835165a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:29.197782 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.auth.core [None req-873bc6f5-5ef8-4386-a1bc-e2bb4835165a None None] MFA Rules not processed for user `f72e2116699d4d6889af55d666d2817d`. Rule list: `[]` (Enabled: `True`). {{(pid=88418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:09:29.199099 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-873bc6f5-5ef8-4386-a1bc-e2bb4835165a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:29.261936 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1466/2931] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:09:29.278752 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a16309-9054-480b-a1cd-f94b137ce233 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:29.278752 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-10a16309-9054-480b-a1cd-f94b137ce233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:29.336668 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a16309-9054-480b-a1cd-f94b137ce233 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:29.340702 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a5fc9-8121-49c2-8502-f0f0299ce2d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:29.341318 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a5fc9-8121-49c2-8502-f0f0299ce2d3 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:29.341585 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a5fc9-8121-49c2-8502-f0f0299ce2d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:29.341909 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a5fc9-8121-49c2-8502-f0f0299ce2d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:29.353830 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a5fc9-8121-49c2-8502-f0f0299ce2d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:29.355338 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a5fc9-8121-49c2-8502-f0f0299ce2d3 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:29.366218 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1466/2932] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:09:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:09:30.052278 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bc6f5-5ef8-4386-a1bc-e2bb4835165a None None] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:30.054842 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-873bc6f5-5ef8-4386-a1bc-e2bb4835165a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:30.072041 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bc6f5-5ef8-4386-a1bc-e2bb4835165a None None] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:30.079670 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8135c0d-51dd-4a73-b607-c0b1b711a854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:30.080323 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8135c0d-51dd-4a73-b607-c0b1b711a854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:30.080604 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8135c0d-51dd-4a73-b607-c0b1b711a854 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:30.080874 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8135c0d-51dd-4a73-b607-c0b1b711a854 admin admin] PATH_INFO: `/v3/projects/a98d4153eea34f9693a4148308c8d95f` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:30.082022 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8135c0d-51dd-4a73-b607-c0b1b711a854 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a98d4153eea34f9693a4148308c8d95f)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:30.093834 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8135c0d-51dd-4a73-b607-c0b1b711a854 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:30.225365 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a8135c0d-51dd-4a73-b607-c0b1b711a854 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a98d4153eea34f9693a4148308c8d95f', 'request_id': 'req-a8135c0d-51dd-4a73-b607-c0b1b711a854'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:30.231434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a8135c0d-51dd-4a73-b607-c0b1b711a854 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a98d4153eea34f9693a4148308c8d95f', 'request_id': 'req-a8135c0d-51dd-4a73-b607-c0b1b711a854'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:30.297501 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a8135c0d-51dd-4a73-b607-c0b1b711a854 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a98d4153eea34f9693a4148308c8d95f', 'request_id': 'req-a8135c0d-51dd-4a73-b607-c0b1b711a854'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:30.310429 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a8135c0d-51dd-4a73-b607-c0b1b711a854 admin admin] The token cache is being invalidate because project a98d4153eea34f9693a4148308c8d95f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:09:30.310790 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a8135c0d-51dd-4a73-b607-c0b1b711a854 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:30.311518 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-a8135c0d-51dd-4a73-b607-c0b1b711a854 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:30.313055 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1467/2933] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:09:30 2022] DELETE /identity/v3/projects/a98d4153eea34f9693a4148308c8d95f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:09:39.361074 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:40.306964 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:28.388166 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a5fc9-8121-49c2-8502-f0f0299ce2d3 service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:10:28.389795 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-429a5fc9-8121-49c2-8502-f0f0299ce2d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:10:28.401335 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a5fc9-8121-49c2-8502-f0f0299ce2d3 service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:10:28.451923 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0513c8-f92d-4003-bdca-d00c2bdfd45b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:10:28.452526 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0513c8-f92d-4003-bdca-d00c2bdfd45b service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:10:28.452810 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0513c8-f92d-4003-bdca-d00c2bdfd45b service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:10:28.453108 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0513c8-f92d-4003-bdca-d00c2bdfd45b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:10:28.454848 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-5b0513c8-f92d-4003-bdca-d00c2bdfd45b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:10:28.465062 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0513c8-f92d-4003-bdca-d00c2bdfd45b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:10:28.466528 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0513c8-f92d-4003-bdca-d00c2bdfd45b service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:10:28.475143 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1467/2934] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:10:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:10:38.471160 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=26 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:22.672300 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8135c0d-51dd-4a73-b607-c0b1b711a854 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:11:22.673989 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-a8135c0d-51dd-4a73-b607-c0b1b711a854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:11:22.738008 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8135c0d-51dd-4a73-b607-c0b1b711a854 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:11:22.742044 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea160883-6c15-481f-9a59-0a8fe062c8de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dc5b80f0e4c48189389d23507a9d2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:11:22.742656 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea160883-6c15-481f-9a59-0a8fe062c8de service cinder] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:11:22.742935 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea160883-6c15-481f-9a59-0a8fe062c8de service cinder] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:11:22.743206 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea160883-6c15-481f-9a59-0a8fe062c8de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:11:22.745081 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ea160883-6c15-481f-9a59-0a8fe062c8de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:11:22.806323 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea160883-6c15-481f-9a59-0a8fe062c8de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:11:22.807841 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea160883-6c15-481f-9a59-0a8fe062c8de service cinder] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:11:22.818640 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1468/2935] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:11:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:11:30.080145 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c313e-a37b-480b-921a-2c0ac14891c4 None None] REQUEST_METHOD: `POST` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:11:30.080755 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c313e-a37b-480b-921a-2c0ac14891c4 None None] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:11:30.081058 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c313e-a37b-480b-921a-2c0ac14891c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:11:30.111722 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.auth.core [None req-a47c313e-a37b-480b-921a-2c0ac14891c4 None None] MFA Rules not processed for user `384fe3ef86de41fc939e1a3cbbc6fe13`. Rule list: `[]` (Enabled: `True`). {{(pid=88417) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:11:30.111722 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a47c313e-a37b-480b-921a-2c0ac14891c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:11:30.111722 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1468/2936] 10.222.0.50 () {58 vars in 958 bytes} [Thu Sep 1 14:11:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:11:31.329392 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea160883-6c15-481f-9a59-0a8fe062c8de service cinder] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:11:31.336276 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-ea160883-6c15-481f-9a59-0a8fe062c8de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:11:31.422088 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea160883-6c15-481f-9a59-0a8fe062c8de service cinder] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:11:31.427602 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525eea1e-35a6-4014-b767-93b42111d7e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e675d44d2c49929feb0ec0d2c0d0eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:11:31.428214 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525eea1e-35a6-4014-b767-93b42111d7e9 service placement] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:11:31.428619 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525eea1e-35a6-4014-b767-93b42111d7e9 service placement] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:11:31.428895 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525eea1e-35a6-4014-b767-93b42111d7e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:11:31.430895 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-525eea1e-35a6-4014-b767-93b42111d7e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:11:31.444134 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525eea1e-35a6-4014-b767-93b42111d7e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:11:31.451780 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525eea1e-35a6-4014-b767-93b42111d7e9 service placement] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:11:31.456334 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1469/2937] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:11:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:11:36.161350 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c313e-a37b-480b-921a-2c0ac14891c4 None None] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:11:36.163083 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a47c313e-a37b-480b-921a-2c0ac14891c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:11:36.241286 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c313e-a37b-480b-921a-2c0ac14891c4 None None] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:11:36.247398 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c8606-cc7a-4210-a908-c0d5a47db016 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:11:36.248041 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c8606-cc7a-4210-a908-c0d5a47db016 service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:11:36.248304 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c8606-cc7a-4210-a908-c0d5a47db016 service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:11:36.248577 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c8606-cc7a-4210-a908-c0d5a47db016 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:11:36.250339 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-435c8606-cc7a-4210-a908-c0d5a47db016 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:11:36.263902 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c8606-cc7a-4210-a908-c0d5a47db016 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:11:36.265574 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c8606-cc7a-4210-a908-c0d5a47db016 service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:11:36.278305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1469/2938] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:11:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:11:41.452110 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=80 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:45.912900 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525eea1e-35a6-4014-b767-93b42111d7e9 service placement] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:11:45.914439 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-525eea1e-35a6-4014-b767-93b42111d7e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:11:45.930864 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525eea1e-35a6-4014-b767-93b42111d7e9 service placement] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:11:45.936443 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afff11c-8582-40e6-ab3a-aa2a55986994 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:11:45.937062 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afff11c-8582-40e6-ab3a-aa2a55986994 service nova] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:11:45.937346 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afff11c-8582-40e6-ab3a-aa2a55986994 service nova] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:11:45.937625 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afff11c-8582-40e6-ab3a-aa2a55986994 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:11:45.939347 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-4afff11c-8582-40e6-ab3a-aa2a55986994 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:11:45.952137 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afff11c-8582-40e6-ab3a-aa2a55986994 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:11:45.953972 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afff11c-8582-40e6-ab3a-aa2a55986994 service nova] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:11:45.966751 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1470/2939] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:11:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:11:46.272281 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=37 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:51.460413 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c8606-cc7a-4210-a908-c0d5a47db016 service nova] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:11:51.475545 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c8606-cc7a-4210-a908-c0d5a47db016 service nova] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:11:51.485992 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e591e5-765f-49f7-bcb7-cd66f2281424 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d231136bcd44d9a97efe6c257f936ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:11:51.487002 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e591e5-765f-49f7-bcb7-cd66f2281424 service nova] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:11:51.487493 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e591e5-765f-49f7-bcb7-cd66f2281424 service nova] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:11:51.488239 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e591e5-765f-49f7-bcb7-cd66f2281424 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:11:51.491006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-52e591e5-765f-49f7-bcb7-cd66f2281424 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:11:51.511430 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e591e5-765f-49f7-bcb7-cd66f2281424 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:11:51.513109 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e591e5-765f-49f7-bcb7-cd66f2281424 service nova] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:11:51.525250 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1470/2940] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:11:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:11:55.961201 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=6 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:01.519815 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=6 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:33.380523 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afff11c-8582-40e6-ab3a-aa2a55986994 service nova] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:33.387838 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-4afff11c-8582-40e6-ab3a-aa2a55986994 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:33.469077 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afff11c-8582-40e6-ab3a-aa2a55986994 service nova] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:33.474944 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1475c03-c324-4707-bfbd-7ad93cf0f4f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e675d44d2c49929feb0ec0d2c0d0eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:33.475614 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1475c03-c324-4707-bfbd-7ad93cf0f4f1 service placement] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:33.475911 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1475c03-c324-4707-bfbd-7ad93cf0f4f1 service placement] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:33.476180 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1475c03-c324-4707-bfbd-7ad93cf0f4f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:33.477905 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-b1475c03-c324-4707-bfbd-7ad93cf0f4f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:33.489844 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1475c03-c324-4707-bfbd-7ad93cf0f4f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:33.491444 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1475c03-c324-4707-bfbd-7ad93cf0f4f1 service placement] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:33.501750 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1471/2941] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:12:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:12:43.497339 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=37 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:13:47.269648 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e591e5-765f-49f7-bcb7-cd66f2281424 service nova] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:13:47.271073 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-52e591e5-765f-49f7-bcb7-cd66f2281424 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:13:47.333212 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e591e5-765f-49f7-bcb7-cd66f2281424 service nova] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:13:47.336868 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafc0f3-ae12-48c6-9451-2c171a2bbb16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72f0d372f6c34d1a9a990222d6b98948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:13:47.337475 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafc0f3-ae12-48c6-9451-2c171a2bbb16 service neutron] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:13:47.337754 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafc0f3-ae12-48c6-9451-2c171a2bbb16 service neutron] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:13:47.338025 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafc0f3-ae12-48c6-9451-2c171a2bbb16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:13:47.339875 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-3eafc0f3-ae12-48c6-9451-2c171a2bbb16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:13:47.430066 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eafc0f3-ae12-48c6-9451-2c171a2bbb16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:13:47.431537 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eafc0f3-ae12-48c6-9451-2c171a2bbb16 service neutron] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:13:47.450562 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1471/2942] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:13:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:13:51.182369 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1475c03-c324-4707-bfbd-7ad93cf0f4f1 service placement] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:13:51.193875 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1475c03-c324-4707-bfbd-7ad93cf0f4f1 service placement] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:13:51.199237 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10eb13-2d6d-4775-ac8a-db0a53e093e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e675d44d2c49929feb0ec0d2c0d0eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:13:51.199882 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10eb13-2d6d-4775-ac8a-db0a53e093e5 service placement] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:13:51.200249 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10eb13-2d6d-4775-ac8a-db0a53e093e5 service placement] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:13:51.201162 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10eb13-2d6d-4775-ac8a-db0a53e093e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:13:51.203025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-4a10eb13-2d6d-4775-ac8a-db0a53e093e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:13:51.215416 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10eb13-2d6d-4775-ac8a-db0a53e093e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:13:51.217059 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10eb13-2d6d-4775-ac8a-db0a53e093e5 service placement] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:13:51.227584 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1472/2943] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:13:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:13:55.183118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafc0f3-ae12-48c6-9451-2c171a2bbb16 service neutron] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:13:55.199628 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafc0f3-ae12-48c6-9451-2c171a2bbb16 service neutron] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:13:55.206040 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979fb40-73fc-4a05-ba94-462dd0e94592 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e675d44d2c49929feb0ec0d2c0d0eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:13:55.206666 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979fb40-73fc-4a05-ba94-462dd0e94592 service placement] REQUEST_METHOD: `GET` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:13:55.207142 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979fb40-73fc-4a05-ba94-462dd0e94592 service placement] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:13:55.207447 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979fb40-73fc-4a05-ba94-462dd0e94592 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:13:55.209213 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-a979fb40-73fc-4a05-ba94-462dd0e94592 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:13:55.222644 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979fb40-73fc-4a05-ba94-462dd0e94592 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:13:55.224328 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979fb40-73fc-4a05-ba94-462dd0e94592 service placement] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:13:55.234297 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1472/2944] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:13:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:13:55.330080 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10eb13-2d6d-4775-ac8a-db0a53e093e5 service placement] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:13:55.332010 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-4a10eb13-2d6d-4775-ac8a-db0a53e093e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:13:55.349346 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10eb13-2d6d-4775-ac8a-db0a53e093e5 service placement] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:13:55.353987 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539272e-f610-4027-b165-6bd63326ced1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:13:55.358178 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539272e-f610-4027-b165-6bd63326ced1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:13:55.358178 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539272e-f610-4027-b165-6bd63326ced1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:13:55.358178 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539272e-f610-4027-b165-6bd63326ced1 admin admin] PATH_INFO: `/v3/users/384fe3ef86de41fc939e1a3cbbc6fe13` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:13:55.358178 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539272e-f610-4027-b165-6bd63326ced1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=384fe3ef86de41fc939e1a3cbbc6fe13)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:13:55.358178 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539272e-f610-4027-b165-6bd63326ced1 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:13:55.547680 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-1539272e-f610-4027-b165-6bd63326ced1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '384fe3ef86de41fc939e1a3cbbc6fe13'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:13:55.670962 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-1539272e-f610-4027-b165-6bd63326ced1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '384fe3ef86de41fc939e1a3cbbc6fe13'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:13:55.679057 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-1539272e-f610-4027-b165-6bd63326ced1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '384fe3ef86de41fc939e1a3cbbc6fe13'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:13:55.691238 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-1539272e-f610-4027-b165-6bd63326ced1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '384fe3ef86de41fc939e1a3cbbc6fe13'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:13:55.691939 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-1539272e-f610-4027-b165-6bd63326ced1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '384fe3ef86de41fc939e1a3cbbc6fe13'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:13:55.697967 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1473/2945] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:13:55 2022] DELETE /identity/v3/users/384fe3ef86de41fc939e1a3cbbc6fe13 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:13:55.972212 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979fb40-73fc-4a05-ba94-462dd0e94592 service placement] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:13:55.983118 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979fb40-73fc-4a05-ba94-462dd0e94592 service placement] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:13:56.042641 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efeb988-9872-4c8b-a412-06b89a237806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:13:56.043305 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efeb988-9872-4c8b-a412-06b89a237806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:13:56.043621 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efeb988-9872-4c8b-a412-06b89a237806 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:13:56.043892 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efeb988-9872-4c8b-a412-06b89a237806 admin admin] PATH_INFO: `/v3/projects/156a972a658b46aaae3150b12dae797a` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:13:56.045007 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efeb988-9872-4c8b-a412-06b89a237806 admin admin] RBAC: Authorizing `identity:delete_project(project_id=156a972a658b46aaae3150b12dae797a)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:13:56.046936 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efeb988-9872-4c8b-a412-06b89a237806 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:13:56.053273 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=100 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:13:56.232433 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-4efeb988-9872-4c8b-a412-06b89a237806 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '156a972a658b46aaae3150b12dae797a', 'request_id': 'req-4efeb988-9872-4c8b-a412-06b89a237806'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:13:56.238259 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-4efeb988-9872-4c8b-a412-06b89a237806 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '156a972a658b46aaae3150b12dae797a', 'request_id': 'req-4efeb988-9872-4c8b-a412-06b89a237806'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:13:56.244453 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-4efeb988-9872-4c8b-a412-06b89a237806 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '156a972a658b46aaae3150b12dae797a', 'request_id': 'req-4efeb988-9872-4c8b-a412-06b89a237806'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:13:56.333417 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-4efeb988-9872-4c8b-a412-06b89a237806 admin admin] The token cache is being invalidate because project 156a972a658b46aaae3150b12dae797a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:13:56.333686 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-4efeb988-9872-4c8b-a412-06b89a237806 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:13:56.334320 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-4efeb988-9872-4c8b-a412-06b89a237806 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:13:56.335894 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1473/2946] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:13:55 2022] DELETE /identity/v3/projects/156a972a658b46aaae3150b12dae797a => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:13:56.339999 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539272e-f610-4027-b165-6bd63326ced1 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:13:56.341434 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-1539272e-f610-4027-b165-6bd63326ced1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:13:56.354338 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539272e-f610-4027-b165-6bd63326ced1 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:13:56.414312 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d4633-654a-41a2-a379-e863e0c8de88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:13:56.414880 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d4633-654a-41a2-a379-e863e0c8de88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:13:56.415161 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d4633-654a-41a2-a379-e863e0c8de88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:13:56.415467 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d4633-654a-41a2-a379-e863e0c8de88 admin admin] PATH_INFO: `/v3/users/2ad36f1791a34b5f865970d49ea62900` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:13:56.416640 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d4633-654a-41a2-a379-e863e0c8de88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ad36f1791a34b5f865970d49ea62900)` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:13:56.418551 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d4633-654a-41a2-a379-e863e0c8de88 admin admin] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:13:56.628381 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-c10d4633-654a-41a2-a379-e863e0c8de88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad36f1791a34b5f865970d49ea62900'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:13:56.717388 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-c10d4633-654a-41a2-a379-e863e0c8de88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad36f1791a34b5f865970d49ea62900'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:13:56.723053 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:13:56.725025 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-c10d4633-654a-41a2-a379-e863e0c8de88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad36f1791a34b5f865970d49ea62900'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:13:56.737493 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-c10d4633-654a-41a2-a379-e863e0c8de88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad36f1791a34b5f865970d49ea62900'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:13:56.738187 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.notifications [None req-c10d4633-654a-41a2-a379-e863e0c8de88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad36f1791a34b5f865970d49ea62900'} {{(pid=88418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:13:56.744145 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1474/2947] 10.222.0.50 () {58 vars in 1224 bytes} [Thu Sep 1 14:13:56 2022] DELETE /identity/v3/users/2ad36f1791a34b5f865970d49ea62900 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:13:57.045318 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efeb988-9872-4c8b-a412-06b89a237806 admin admin] Authenticating user token {{(pid=88417) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:13:57.049732 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.fernet_utils [None req-4efeb988-9872-4c8b-a412-06b89a237806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88417) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:13:57.060391 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efeb988-9872-4c8b-a412-06b89a237806 admin admin] Validating token access rules against request {{(pid=88417) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:13:57.118146 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d6015-d515-4fbb-8d4b-184a241b9aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f72e2116699d4d6889af55d666d2817d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c52243fb4fdd4f1bb4f3291630bfbabe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88417) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:13:57.118771 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d6015-d515-4fbb-8d4b-184a241b9aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:13:57.119049 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d6015-d515-4fbb-8d4b-184a241b9aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:13:57.119323 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d6015-d515-4fbb-8d4b-184a241b9aa6 admin admin] PATH_INFO: `/v3/projects/397089677b0944a6a755b4256d1e27d9` {{(pid=88417) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:13:57.120448 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d6015-d515-4fbb-8d4b-184a241b9aa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=397089677b0944a6a755b4256d1e27d9)` {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:13:57.122341 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d6015-d515-4fbb-8d4b-184a241b9aa6 admin admin] RBAC: Authorization granted {{(pid=88417) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:13:57.262286 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-349d6015-d515-4fbb-8d4b-184a241b9aa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '397089677b0944a6a755b4256d1e27d9', 'request_id': 'req-349d6015-d515-4fbb-8d4b-184a241b9aa6'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:13:57.267734 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-349d6015-d515-4fbb-8d4b-184a241b9aa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '397089677b0944a6a755b4256d1e27d9', 'request_id': 'req-349d6015-d515-4fbb-8d4b-184a241b9aa6'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:13:57.273896 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-349d6015-d515-4fbb-8d4b-184a241b9aa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '397089677b0944a6a755b4256d1e27d9', 'request_id': 'req-349d6015-d515-4fbb-8d4b-184a241b9aa6'} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:13:57.391006 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-349d6015-d515-4fbb-8d4b-184a241b9aa6 admin admin] The token cache is being invalidate because project 397089677b0944a6a755b4256d1e27d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88417) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:13:57.391229 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-349d6015-d515-4fbb-8d4b-184a241b9aa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:13:57.391860 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG keystone.notifications [None req-349d6015-d515-4fbb-8d4b-184a241b9aa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88417) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:13:57.393360 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: [pid: 88417|app: 0|req: 1474/2948] 10.222.0.50 () {58 vars in 1233 bytes} [Thu Sep 1 14:13:57 2022] DELETE /identity/v3/projects/397089677b0944a6a755b4256d1e27d9 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:14:07.081670 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=8,keystone:DELETE=2 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:14:07.387571 dv-cinder-839768-5-iscsi devstack@keystone.service[88417]: DEBUG dbcounter [-] [88417] Writing DB stats keystone:SELECT=73,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88417) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:38.671684 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d4633-654a-41a2-a379-e863e0c8de88 admin admin] Authenticating user token {{(pid=88418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:38.673085 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-c10d4633-654a-41a2-a379-e863e0c8de88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:38.742622 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d4633-654a-41a2-a379-e863e0c8de88 admin admin] Validating token access rules against request {{(pid=88418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:38.801356 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338e118-5516-4297-be40-dc1d8b2baa07 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63e675d44d2c49929feb0ec0d2c0d0eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6283121e17814cd792df9d0edf81bf2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:38.801960 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338e118-5516-4297-be40-dc1d8b2baa07 service placement] REQUEST_METHOD: `GET` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:38.802238 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338e118-5516-4297-be40-dc1d8b2baa07 service placement] SCRIPT_NAME: `/identity` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:38.802507 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338e118-5516-4297-be40-dc1d8b2baa07 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:38.804343 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.fernet_utils [None req-d338e118-5516-4297-be40-dc1d8b2baa07 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:38.815387 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338e118-5516-4297-be40-dc1d8b2baa07 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:38.816957 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338e118-5516-4297-be40-dc1d8b2baa07 service placement] RBAC: Authorization granted {{(pid=88418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:38.826755 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: [pid: 88418|app: 0|req: 1475/2949] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Sep 1 14:17:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:17:48.822500 dv-cinder-839768-5-iscsi devstack@keystone.service[88418]: DEBUG dbcounter [-] [88418] Writing DB stats keystone:SELECT=58 {{(pid=88418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}